2025-02-03 17:05:19 INFO juju unit_agent.go:289 Starting unit workers for "etcd/0" 2025-02-03 17:05:19 INFO juju.worker.apicaller connect.go:163 [7c40f1] "unit-etcd-0" successfully connected to "10.0.0.33:17070" 2025-02-03 17:05:19 INFO juju.worker.apicaller connect.go:260 [7c40f1] password changed for "unit-etcd-0" 2025-02-03 17:05:19 INFO juju.worker.apicaller connect.go:163 [7c40f1] "unit-etcd-0" successfully connected to "10.0.0.33:17070" 2025-02-03 17:05:19 INFO juju.worker.migrationminion worker.go:142 migration phase is now: NONE 2025-02-03 17:05:19 INFO juju.worker.logger logger.go:120 logger worker started 2025-02-03 17:05:19 DEBUG juju.worker.dependency engine.go:580 "hook-retry-strategy" manifold worker started at 2025-02-03 17:05:19.588723397 +0000 UTC 2025-02-03 17:05:19 DEBUG juju.worker.dependency engine.go:580 "leadership-tracker" manifold worker started at 2025-02-03 17:05:19.591369103 +0000 UTC 2025-02-03 17:05:19 DEBUG juju.worker.dependency engine.go:580 "api-address-updater" manifold worker started at 2025-02-03 17:05:19.59250418 +0000 UTC 2025-02-03 17:05:19 DEBUG juju.worker.dependency engine.go:580 "meter-status" manifold worker started at 2025-02-03 17:05:19.592575958 +0000 UTC 2025-02-03 17:05:19 DEBUG juju.worker.dependency engine.go:580 "metric-spool" manifold worker started at 2025-02-03 17:05:19.592587228 +0000 UTC 2025-02-03 17:05:19 DEBUG juju.worker.dependency engine.go:580 "uniter" manifold worker started at 2025-02-03 17:05:19.602999596 +0000 UTC 2025-02-03 17:05:19 DEBUG juju.worker.dependency engine.go:580 "metric-sender" manifold worker started at 2025-02-03 17:05:19.604586078 +0000 UTC 2025-02-03 17:05:19 DEBUG juju.worker.meterstatus connected.go:93 got meter status change signal from watcher 2025-02-03 17:05:19 INFO juju.worker.upgrader upgrader.go:216 no waiter, upgrader is done 2025-02-03 17:05:19 DEBUG juju.worker.dependency engine.go:603 "upgrader" manifold worker completed successfully 2025-02-03 17:05:19 DEBUG juju.worker.apiaddressupdater apiaddressupdater.go:98 updating API hostPorts to [[10.0.0.33:17070 252.33.0.1:17070 127.0.0.1:17070 [::1]:17070]] 2025-02-03 17:05:19 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for meterstatus (meter-status-changed) 2025-02-03 17:05:19 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for meterstatus (meter-status-changed) 2025-02-03 17:05:19 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-0/agent.socket } 2025-02-03 17:05:19 ERROR juju.worker.meterstatus runner.go:93 error running "meter-status-changed": charm missing from disk 2025-02-03 17:05:19 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2025-02-03 17:05:19 DEBUG juju.machinelock machinelock.go:186 machine lock released for meterstatus (meter-status-changed) 2025-02-03 17:05:19 DEBUG juju.worker.uniter uniter.go:883 starting local juju-run listener on {unix /var/lib/juju/agents/unit-etcd-0/run.socket } 2025-02-03 17:05:19 INFO juju.worker.uniter uniter.go:335 unit "etcd/0" started 2025-02-03 17:05:19 DEBUG juju.worker.uniter runlistener.go:117 juju-run listener running 2025-02-03 17:05:19 INFO juju.worker.uniter uniter.go:651 resuming charm install 2025-02-03 17:05:19 DEBUG juju.worker.uniter.operation executor.go:85 running operation install cs:~containers/etcd-622 for etcd/0 2025-02-03 17:05:19 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "install cs:~containers/etcd-622" for etcd/0 2025-02-03 17:05:19 INFO juju.worker.uniter.charm bundles.go:81 downloading cs:~containers/etcd-622 from API server 2025-02-03 17:05:19 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "install cs:~containers/etcd-622" for etcd/0 2025-02-03 17:05:19 DEBUG juju.worker.uniter.charm manifest_deployer.go:143 preparing to deploy charm "cs:~containers/etcd-622" 2025-02-03 17:05:19 DEBUG juju.worker.uniter.charm manifest_deployer.go:132 deploying charm "cs:~containers/etcd-622" 2025-02-03 17:05:20 DEBUG juju.worker.uniter.charm manifest_deployer.go:164 finishing deploy of charm "cs:~containers/etcd-622" 2025-02-03 17:05:20 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "install cs:~containers/etcd-622" for etcd/0 2025-02-03 17:05:20 INFO juju.worker.uniter uniter.go:361 hooks are retried true 2025-02-03 17:05:20 DEBUG juju.worker.uniter.remotestate watcher.go:603 got relations change for etcd/0: ok=true 2025-02-03 17:05:20 DEBUG juju.worker.uniter.remotestate watcher.go:564 got upgrade series change 2025-02-03 17:05:20 DEBUG juju.worker.uniter.remotestate watcher.go:714 no upgrade series in progress, reinitializing local upgrade series state 2025-02-03 17:05:20 DEBUG juju.worker.uniter.remotestate watcher.go:542 got config change for etcd/0: ok=true, hashes=[51e9e2593d2d2d48099fb3c0fe9760058a9f2043cb2eddd9a7a27cc5b8850729] 2025-02-03 17:05:20 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for etcd/0: ok=true 2025-02-03 17:05:20 DEBUG juju.worker.uniter.remotestate watcher.go:613 got storage change for etcd/0: [] ok=true 2025-02-03 17:05:20 DEBUG juju.worker.uniter.remotestate watcher.go:489 got unit change for etcd/0 2025-02-03 17:05:20 DEBUG juju.worker.uniter.remotestate watcher.go:623 got update status interval change for etcd/0: ok=true 2025-02-03 17:05:20 DEBUG juju.worker.uniter.remotestate watcher.go:499 got application change for etcd/0 2025-02-03 17:05:20 DEBUG juju.worker.uniter.remotestate watcher.go:574 got address change for etcd/0: ok=true, hashes=[b5f9b9854c21dadf5fd5223c6e6980bcd53e5994b4bac9fb14bb5fa0cd773e33] 2025-02-03 17:05:20 DEBUG juju.worker.uniter.remotestate watcher.go:553 got trust config change for etcd/0: ok=true, hashes=[17f2acda51310eebc7ec5fc33ba3e24c9838f484cf50956f7b6066f1d8bba28f] 2025-02-03 17:05:20 DEBUG juju.worker.uniter.remotestate watcher.go:595 got action change for etcd/0: [] ok=true 2025-02-03 17:05:20 INFO juju.worker.uniter.storage resolver.go:126 initial storage attachments ready 2025-02-03 17:05:20 INFO juju.worker.uniter resolver.go:159 found queued "install" hook 2025-02-03 17:05:20 DEBUG juju.worker.uniter.operation executor.go:85 running operation run install hook for etcd/0 2025-02-03 17:05:20 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/0 uniter (run install hook) 2025-02-03 17:06:32 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/0 uniter (run install hook) 2025-02-03 17:06:32 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run install hook" for etcd/0 2025-02-03 17:06:32 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run install hook" for etcd/0 2025-02-03 17:06:32 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running install hook 2025-02-03 17:06:32 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-0/agent.socket } 2025-02-03 17:06:32 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for etcd/0 : {10 {map[easyrsa/0:{0}] map[] []}} 2025-02-03 17:06:32 DEBUG unit.etcd/0.install logger.go:60 Reading package lists... 2025-02-03 17:06:32 DEBUG unit.etcd/0.install logger.go:60 Building dependency tree... 2025-02-03 17:06:32 DEBUG unit.etcd/0.install logger.go:60 Reading state information... 2025-02-03 17:06:32 DEBUG unit.etcd/0.install logger.go:60 python3-dev is already the newest version (3.8.2-0ubuntu2). 2025-02-03 17:06:32 DEBUG unit.etcd/0.install logger.go:60 python3-setuptools is already the newest version (45.2.0-1ubuntu0.1). 2025-02-03 17:06:32 DEBUG unit.etcd/0.install logger.go:60 python3-yaml is already the newest version (5.3.1-1ubuntu0.1). 2025-02-03 17:06:32 DEBUG unit.etcd/0.install logger.go:60 python3-pip is already the newest version (20.0.2-5ubuntu1.10). 2025-02-03 17:06:32 DEBUG unit.etcd/0.install logger.go:60 python3-wheel is already the newest version (0.34.2-1ubuntu0.1). 2025-02-03 17:06:32 DEBUG unit.etcd/0.install logger.go:60 build-essential is already the newest version (12.8ubuntu1.1). 2025-02-03 17:06:32 DEBUG unit.etcd/0.install logger.go:60 0 upgraded, 0 newly installed, 0 to remove and 7 not upgraded. 2025-02-03 17:06:33 DEBUG unit.etcd/0.install logger.go:60 Reading package lists... 2025-02-03 17:06:33 DEBUG unit.etcd/0.install logger.go:60 Building dependency tree... 2025-02-03 17:06:33 DEBUG unit.etcd/0.install logger.go:60 Reading state information... 2025-02-03 17:06:33 DEBUG unit.etcd/0.install logger.go:60 rsync is already the newest version (3.1.3-8ubuntu0.7). 2025-02-03 17:06:33 DEBUG unit.etcd/0.install logger.go:60 rsync set to manually installed. 2025-02-03 17:06:33 DEBUG unit.etcd/0.install logger.go:60 0 upgraded, 0 newly installed, 0 to remove and 7 not upgraded. 2025-02-03 17:06:33 DEBUG unit.etcd/0.install logger.go:60 Reading package lists... 2025-02-03 17:06:33 DEBUG unit.etcd/0.install logger.go:60 Building dependency tree... 2025-02-03 17:06:33 DEBUG unit.etcd/0.install logger.go:60 Reading state information... 2025-02-03 17:06:34 DEBUG unit.etcd/0.install logger.go:60 virtualenv is already the newest version (20.0.17-1ubuntu0.4). 2025-02-03 17:06:34 DEBUG unit.etcd/0.install logger.go:60 0 upgraded, 0 newly installed, 0 to remove and 7 not upgraded. 2025-02-03 17:06:34 DEBUG unit.etcd/0.install logger.go:60 created virtual environment CPython3.8.10.final.0-64 in 161ms 2025-02-03 17:06:34 DEBUG unit.etcd/0.install logger.go:60 creator CPython3Posix(dest=/var/lib/juju/agents/unit-etcd-0/.venv, clear=False, global=False) 2025-02-03 17:06:34 DEBUG unit.etcd/0.install logger.go:60 seeder FromAppData(download=False, pip=latest, setuptools=latest, wheel=latest, pkg_resources=latest, via=copy, app_data_dir=/root/.local/share/virtualenv/seed-app-data/v1.0.1.debian.1) 2025-02-03 17:06:34 DEBUG unit.etcd/0.install logger.go:60 activators BashActivator,CShellActivator,FishActivator,PowerShellActivator,PythonActivator,XonshActivator 2025-02-03 17:06:36 DEBUG unit.etcd/0.install logger.go:60 Looking in links: wheelhouse 2025-02-03 17:06:36 DEBUG unit.etcd/0.install logger.go:60 Requirement already up-to-date: pip in /var/lib/juju/agents/unit-etcd-0/.venv/lib/python3.8/site-packages (20.0.2) 2025-02-03 17:06:37 DEBUG unit.etcd/0.install logger.go:60 Looking in links: wheelhouse 2025-02-03 17:06:37 DEBUG unit.etcd/0.install logger.go:60 Requirement already up-to-date: setuptools in /var/lib/juju/agents/unit-etcd-0/.venv/lib/python3.8/site-packages (44.0.0) 2025-02-03 17:06:38 DEBUG unit.etcd/0.install logger.go:60 Looking in links: wheelhouse 2025-02-03 17:06:38 DEBUG unit.etcd/0.install logger.go:60 Processing ./wheelhouse/setuptools_scm-1.17.0.tar.gz 2025-02-03 17:06:39 DEBUG unit.etcd/0.install logger.go:60 Building wheels for collected packages: setuptools-scm 2025-02-03 17:06:39 DEBUG unit.etcd/0.install logger.go:60 Building wheel for setuptools-scm (setup.py): started 2025-02-03 17:06:39 DEBUG unit.etcd/0.install logger.go:60 Building wheel for setuptools-scm (setup.py): finished with status 'done' 2025-02-03 17:06:39 DEBUG unit.etcd/0.install logger.go:60 Created wheel for setuptools-scm: filename=setuptools_scm-1.17.0-py2.py3-none-any.whl size=17696 sha256=f98443487d40b2aa60776891804914d1be283e7505fc5da4131b5b3aca0b8ea9 2025-02-03 17:06:39 DEBUG unit.etcd/0.install logger.go:60 Stored in directory: /root/.cache/pip/wheels/92/a8/73/8e32ec012bf8ff3e2eb554c25cdd28255afd956b18a4801e6c 2025-02-03 17:06:39 DEBUG unit.etcd/0.install logger.go:60 Successfully built setuptools-scm 2025-02-03 17:06:39 DEBUG unit.etcd/0.install logger.go:60 Installing collected packages: setuptools-scm 2025-02-03 17:06:39 DEBUG unit.etcd/0.install logger.go:60 Successfully installed setuptools-scm-1.17.0 2025-02-03 17:06:40 DEBUG unit.etcd/0.install logger.go:60 Looking in links: wheelhouse 2025-02-03 17:06:40 DEBUG unit.etcd/0.install logger.go:60 Processing ./wheelhouse/pbr-5.6.0.tar.gz 2025-02-03 17:06:41 DEBUG unit.etcd/0.install logger.go:60 Processing ./wheelhouse/charms.templating.jinja2-1.0.2.tar.gz 2025-02-03 17:06:41 DEBUG unit.etcd/0.install logger.go:60 Processing ./wheelhouse/wheel-0.33.6.tar.gz 2025-02-03 17:06:41 DEBUG unit.etcd/0.install logger.go:60 Processing ./wheelhouse/netaddr-0.7.19.tar.gz 2025-02-03 17:06:41 DEBUG unit.etcd/0.install logger.go:60 Processing ./wheelhouse/Jinja2-2.10.1.tar.gz 2025-02-03 17:06:42 DEBUG unit.etcd/0.install logger.go:60 Processing ./wheelhouse/charms.reactive-1.4.1.tar.gz 2025-02-03 17:06:42 DEBUG unit.etcd/0.install logger.go:60 Processing ./wheelhouse/six-1.16.0.tar.gz 2025-02-03 17:06:42 DEBUG unit.etcd/0.install logger.go:60 Processing ./wheelhouse/pyaml-21.8.3.tar.gz 2025-02-03 17:06:42 DEBUG unit.etcd/0.install logger.go:60 Processing ./wheelhouse/tenacity-5.0.3.tar.gz 2025-02-03 17:06:44 DEBUG unit.etcd/0.install logger.go:60 Processing ./wheelhouse/charmhelpers-0.20.22.tar.gz 2025-02-03 17:06:46 DEBUG unit.etcd/0.install logger.go:60 Processing ./wheelhouse/PyYAML-5.2.tar.gz 2025-02-03 17:06:46 DEBUG unit.etcd/0.install logger.go:60 Processing ./wheelhouse/Tempita-0.5.2.tar.gz 2025-02-03 17:06:47 DEBUG unit.etcd/0.install logger.go:60 Processing ./wheelhouse/MarkupSafe-1.1.1.tar.gz 2025-02-03 17:06:47 DEBUG unit.etcd/0.install logger.go:60 Building wheels for collected packages: pbr, charms.templating.jinja2, wheel, netaddr, Jinja2, charms.reactive, six, pyaml, tenacity, charmhelpers, PyYAML, Tempita, MarkupSafe 2025-02-03 17:06:47 DEBUG unit.etcd/0.install logger.go:60 Building wheel for pbr (setup.py): started 2025-02-03 17:06:47 DEBUG unit.etcd/0.install logger.go:60 Building wheel for pbr (setup.py): finished with status 'done' 2025-02-03 17:06:47 DEBUG unit.etcd/0.install logger.go:60 Created wheel for pbr: filename=pbr-5.6.0-py2.py3-none-any.whl size=111309 sha256=630e399e241252460a88e43d3c3c22aefa5625d8017692062e39d445f24957fb 2025-02-03 17:06:47 DEBUG unit.etcd/0.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-1j5yp2h5/wheels/94/f2/f8/c9683ffd836c2914c93cb3dd7c3ef9ce463c797687a29e5a07 2025-02-03 17:06:47 DEBUG unit.etcd/0.install logger.go:60 Building wheel for charms.templating.jinja2 (setup.py): started 2025-02-03 17:06:48 DEBUG unit.etcd/0.install logger.go:60 Building wheel for charms.templating.jinja2 (setup.py): finished with status 'done' 2025-02-03 17:06:48 DEBUG unit.etcd/0.install logger.go:60 Created wheel for charms.templating.jinja2: filename=charms.templating.jinja2-1.0.2-py3-none-any.whl size=4020 sha256=f1e3b92bd56490594581323c3d5c65347b24ee1e2f2ba67b89f7960b6e5b8e07 2025-02-03 17:06:48 DEBUG unit.etcd/0.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-1j5yp2h5/wheels/19/c2/52/30dc260d6e19434717b7a2ddb0a47d560afda140fe32f54227 2025-02-03 17:06:48 DEBUG unit.etcd/0.install logger.go:60 Building wheel for wheel (setup.py): started 2025-02-03 17:06:48 DEBUG unit.etcd/0.install logger.go:60 Building wheel for wheel (setup.py): finished with status 'done' 2025-02-03 17:06:48 DEBUG unit.etcd/0.install logger.go:60 Created wheel for wheel: filename=wheel-0.33.6-py2.py3-none-any.whl size=21555 sha256=28868e780e9bd6449532444e9fa87525a8f1090fb711d18073879f950c16d30e 2025-02-03 17:06:48 DEBUG unit.etcd/0.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-1j5yp2h5/wheels/6b/1f/00/bf7f8f88871a75815eed7684abb8dc4ccfaefcb58fb45ef1f2 2025-02-03 17:06:48 DEBUG unit.etcd/0.install logger.go:60 Building wheel for netaddr (setup.py): started 2025-02-03 17:06:48 DEBUG unit.etcd/0.install logger.go:60 Building wheel for netaddr (setup.py): finished with status 'done' 2025-02-03 17:06:48 DEBUG unit.etcd/0.install logger.go:60 Created wheel for netaddr: filename=netaddr-0.7.19-py3-none-any.whl size=1627892 sha256=3b1a2d42a18b4d7cbe9e8cadf838bd479f457a02ef3eeb9033cd26635d6e9e9e 2025-02-03 17:06:48 DEBUG unit.etcd/0.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-1j5yp2h5/wheels/19/33/fe/60c729bbaaf8dd94871039905175c9055300f8cbaf24938597 2025-02-03 17:06:48 DEBUG unit.etcd/0.install logger.go:60 Building wheel for Jinja2 (setup.py): started 2025-02-03 17:06:49 DEBUG unit.etcd/0.install logger.go:60 Building wheel for Jinja2 (setup.py): finished with status 'done' 2025-02-03 17:06:49 DEBUG unit.etcd/0.install logger.go:60 Created wheel for Jinja2: filename=Jinja2-2.10.1-py2.py3-none-any.whl size=124884 sha256=026809a12c0c971a955d6ef4404d7728fd10b164c4aa76c41b3ee69565eb2d91 2025-02-03 17:06:49 DEBUG unit.etcd/0.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-1j5yp2h5/wheels/44/89/35/c880c8f974760590fe2d3da20a1aaf5bbdb9b468fb3a61a86f 2025-02-03 17:06:49 DEBUG unit.etcd/0.install logger.go:60 Building wheel for charms.reactive (setup.py): started 2025-02-03 17:06:49 DEBUG unit.etcd/0.install logger.go:60 Building wheel for charms.reactive (setup.py): finished with status 'done' 2025-02-03 17:06:49 DEBUG unit.etcd/0.install logger.go:60 Created wheel for charms.reactive: filename=charms.reactive-1.4.1-py3-none-any.whl size=43697 sha256=ac91b5ba7f66e474198e2a97e04deaea369709428af038520e86ea04c919e5e4 2025-02-03 17:06:49 DEBUG unit.etcd/0.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-1j5yp2h5/wheels/f7/44/90/770e954a28d1902e839c57a48de5a9bfb8a1bb6050f789e7db 2025-02-03 17:06:49 DEBUG unit.etcd/0.install logger.go:60 Building wheel for six (setup.py): started 2025-02-03 17:06:49 DEBUG unit.etcd/0.install logger.go:60 Building wheel for six (setup.py): finished with status 'done' 2025-02-03 17:06:49 DEBUG unit.etcd/0.install logger.go:60 Created wheel for six: filename=six-1.16.0-py2.py3-none-any.whl size=11053 sha256=6b5ecfdb977656ab5c1b8d360555a8ee402d2aa92eb59ffdda27487a3cf9b658 2025-02-03 17:06:49 DEBUG unit.etcd/0.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-1j5yp2h5/wheels/76/e4/ad/673d64ce4f9a0589804db4a11fe54debed1e75f32b2e49bdfe 2025-02-03 17:06:49 DEBUG unit.etcd/0.install logger.go:60 Building wheel for pyaml (setup.py): started 2025-02-03 17:06:49 DEBUG unit.etcd/0.install logger.go:60 Building wheel for pyaml (setup.py): finished with status 'done' 2025-02-03 17:06:49 DEBUG unit.etcd/0.install logger.go:60 Created wheel for pyaml: filename=pyaml-21.8.3-py2.py3-none-any.whl size=17425 sha256=55293af004e45903bef566e6bfb5cb7d9ab5b52df9dd5e4b9d0b9fc1a77e2f96 2025-02-03 17:06:49 DEBUG unit.etcd/0.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-1j5yp2h5/wheels/e7/2f/06/ca820bc54c7acffe635ca916b063267b55881692b7ea7bf7ca 2025-02-03 17:06:49 DEBUG unit.etcd/0.install logger.go:60 Building wheel for tenacity (setup.py): started 2025-02-03 17:06:50 DEBUG unit.etcd/0.install logger.go:60 Building wheel for tenacity (setup.py): finished with status 'done' 2025-02-03 17:06:50 DEBUG unit.etcd/0.install logger.go:60 Created wheel for tenacity: filename=tenacity-5.0.3-py2.py3-none-any.whl size=38871 sha256=a6c68b6f0807ac5e522891b51e3e8a9f0a145535ba4d578458192569f1c75ddc 2025-02-03 17:06:50 DEBUG unit.etcd/0.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-1j5yp2h5/wheels/d1/1e/cc/334f97d27a162039bf8e70e17c8773541db0665c4ec7ec5f3c 2025-02-03 17:06:50 DEBUG unit.etcd/0.install logger.go:60 Building wheel for charmhelpers (setup.py): started 2025-02-03 17:06:50 DEBUG unit.etcd/0.install logger.go:60 Building wheel for charmhelpers (setup.py): finished with status 'done' 2025-02-03 17:06:50 DEBUG unit.etcd/0.install logger.go:60 Created wheel for charmhelpers: filename=charmhelpers-0.20.22-py3-none-any.whl size=432838 sha256=db114c0ef4843c3a928801c840b09d97f98c795ba6398b6a7e384531e6c52bae 2025-02-03 17:06:50 DEBUG unit.etcd/0.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-1j5yp2h5/wheels/0e/09/f5/1b140bdcd0f0777a7bbafb2e023d61128dd4adba302d23fffd 2025-02-03 17:06:50 DEBUG unit.etcd/0.install logger.go:60 Building wheel for PyYAML (setup.py): started 2025-02-03 17:06:50 DEBUG unit.etcd/0.install logger.go:60 Building wheel for PyYAML (setup.py): finished with status 'done' 2025-02-03 17:06:50 DEBUG unit.etcd/0.install logger.go:60 Created wheel for PyYAML: filename=PyYAML-5.2-cp38-cp38-linux_x86_64.whl size=44208 sha256=abc31f5d82428593299622f0d0b99d80b87db39e3680782144d2127745029825 2025-02-03 17:06:50 DEBUG unit.etcd/0.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-1j5yp2h5/wheels/eb/3b/b3/223119a22cad2fa77301a6fff89796ad60f9a55831df45ce63 2025-02-03 17:06:50 DEBUG unit.etcd/0.install logger.go:60 Building wheel for Tempita (setup.py): started 2025-02-03 17:06:51 DEBUG unit.etcd/0.install logger.go:60 Building wheel for Tempita (setup.py): finished with status 'done' 2025-02-03 17:06:51 DEBUG unit.etcd/0.install logger.go:60 Created wheel for Tempita: filename=Tempita-0.5.2-py3-none-any.whl size=12880 sha256=342fa054868a43316ce8891d5b54b40231f155128ffdf759ab8d898f62b932fa 2025-02-03 17:06:51 DEBUG unit.etcd/0.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-1j5yp2h5/wheels/0b/1e/40/9569398a67176617f0f32a24ca90d4010ab7b97d450c929874 2025-02-03 17:06:51 DEBUG unit.etcd/0.install logger.go:60 Building wheel for MarkupSafe (setup.py): started 2025-02-03 17:06:52 DEBUG unit.etcd/0.install logger.go:60 Building wheel for MarkupSafe (setup.py): finished with status 'done' 2025-02-03 17:06:52 DEBUG unit.etcd/0.install logger.go:60 Created wheel for MarkupSafe: filename=MarkupSafe-1.1.1-cp38-cp38-linux_x86_64.whl size=32944 sha256=fd06471ebca9859314f40b706d7a6d6bfe48a6c45d30a794177fc7380d11ba3c 2025-02-03 17:06:52 DEBUG unit.etcd/0.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-1j5yp2h5/wheels/8b/e4/63/05e66ac8b6c177372bae37f0c3ab76a8ceb6e732014bcdfb2b 2025-02-03 17:06:52 DEBUG unit.etcd/0.install logger.go:60 Successfully built pbr charms.templating.jinja2 wheel netaddr Jinja2 charms.reactive six pyaml tenacity charmhelpers PyYAML Tempita MarkupSafe 2025-02-03 17:06:52 DEBUG unit.etcd/0.install logger.go:60 Installing collected packages: pbr, MarkupSafe, Jinja2, PyYAML, Tempita, netaddr, six, charmhelpers, charms.templating.jinja2, wheel, pyaml, charms.reactive, tenacity 2025-02-03 17:06:52 DEBUG unit.etcd/0.install logger.go:60 Attempting uninstall: wheel 2025-02-03 17:06:52 DEBUG unit.etcd/0.install logger.go:60 Found existing installation: wheel 0.34.2 2025-02-03 17:06:52 DEBUG unit.etcd/0.install logger.go:60 Uninstalling wheel-0.34.2: 2025-02-03 17:06:52 DEBUG unit.etcd/0.install logger.go:60 Successfully uninstalled wheel-0.34.2 2025-02-03 17:06:52 DEBUG unit.etcd/0.install logger.go:60 Successfully installed Jinja2-2.10.1 MarkupSafe-1.1.1 PyYAML-5.2 Tempita-0.5.2 charmhelpers-0.20.22 charms.reactive-1.4.1 charms.templating.jinja2-1.0.2 netaddr-0.7.19 pbr-5.6.0 pyaml-21.8.3 six-1.16.0 tenacity-5.0.3 wheel-0.33.6 2025-02-03 17:06:53 INFO unit.etcd/0.juju-log server.go:316 Reactive main running for hook install 2025-02-03 17:06:53 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.changed 2025-02-03 17:06:53 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.changed.nagios_context 2025-02-03 17:06:53 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.nagios_context 2025-02-03 17:06:53 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.nagios_context 2025-02-03 17:06:53 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.changed.nagios_servicegroups 2025-02-03 17:06:53 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2025-02-03 17:06:53 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.changed.snapd_refresh 2025-02-03 17:06:53 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.snapd_refresh 2025-02-03 17:06:53 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.snapd_refresh 2025-02-03 17:06:53 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.changed.port 2025-02-03 17:06:53 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.port 2025-02-03 17:06:53 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.port 2025-02-03 17:06:53 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.changed.management_port 2025-02-03 17:06:53 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.management_port 2025-02-03 17:06:53 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.management_port 2025-02-03 17:06:53 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.changed.channel 2025-02-03 17:06:53 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.channel 2025-02-03 17:06:53 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.channel 2025-02-03 17:06:53 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.changed.bind_to_all_interfaces 2025-02-03 17:06:53 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.bind_to_all_interfaces 2025-02-03 17:06:53 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.bind_to_all_interfaces 2025-02-03 17:06:53 INFO unit.etcd/0.juju-log server.go:316 Initializing Leadership Layer (is leader) 2025-02-03 17:06:53 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag leadership.is_leader 2025-02-03 17:06:53 INFO unit.etcd/0.juju-log server.go:316 Initializing Snap Layer 2025-02-03 17:06:53 DEBUG unit.etcd/0.install logger.go:60 none 2025-02-03 17:06:53 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: starting handler dispatch, 22 flags set tracer: set flag config.changed tracer: set flag config.changed.bind_to_all_interfaces tracer: set flag config.changed.channel tracer: set flag config.changed.management_port tracer: set flag config.changed.nagios_context tracer: set flag config.changed.nagios_servicegroups tracer: set flag config.changed.port tracer: set flag config.changed.snapd_refresh tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag leadership.is_leader 2025-02-03 17:06:53 DEBUG unit.etcd/0.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2025-02-03 17:06:53 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: main dispatch loop, 6 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/cdk_service_kicker.py:13:install_cdk_service_kicker tracer: ++ queue handler reactive/etcd.py:131:missing_relation_notice tracer: ++ queue handler reactive/etcd.py:332:channel_changed tracer: ++ queue handler reactive/etcd.py:338:snap_install tracer: ++ queue handler reactive/etcd.py:748:force_update_nrpe_config 2025-02-03 17:06:53 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/cdk_service_kicker.py:13:install_cdk_service_kicker 2025-02-03 17:06:53 DEBUG unit.etcd/0.juju-log server.go:316 Writing file /usr/bin/cdk-service-kicker root:root 444 2025-02-03 17:06:53 DEBUG unit.etcd/0.juju-log server.go:316 Writing file /etc/systemd/system/cdk-service-kicker.service root:root 444 2025-02-03 17:06:53 WARNING unit.etcd/0.install logger.go:60 Created symlink /etc/systemd/system/multi-user.target.wants/cdk-service-kicker.service → /etc/systemd/system/cdk-service-kicker.service. 2025-02-03 17:06:54 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: set flag cdk-service-kicker.installed tracer: -- dequeue handler reactive/cdk_service_kicker.py:13:install_cdk_service_kicker 2025-02-03 17:06:54 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:131:missing_relation_notice 2025-02-03 17:06:54 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:332:channel_changed 2025-02-03 17:06:54 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: set flag etcd.rerender-config tracer: ++ queue handler reactive/etcd.py:235:rerender_config 2025-02-03 17:06:54 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:338:snap_install 2025-02-03 17:06:56 INFO unit.etcd/0.juju-log server.go:316 Installing core from store 2025-02-03 17:08:33 DEBUG unit.etcd/0.juju-log server.go:316 Installation successful cmd="['snap', 'install', '--channel=stable', 'core']" output="b'core 16-2.61.4-20240607 from Canonical** installed\n'" 2025-02-03 17:08:33 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: set flag snap.installed.core tracer: ++ queue handler reactive/snap.py:329:change_snapd_refresh 2025-02-03 17:08:35 INFO unit.etcd/0.juju-log server.go:316 Installing etcd from store 2025-02-03 17:08:49 DEBUG unit.etcd/0.juju-log server.go:316 Installation successful cmd="['snap', 'install', '--channel=3.4/stable', 'etcd']" output="b'etcd (3.4/stable) 3.4.22 from Canonical** installed\n'" 2025-02-03 17:08:49 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: set flag snap.installed.etcd tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:180:leader_config_changed tracer: ++ queue handler reactive/etcd.py:228:bind_to_all_interfaces_changed tracer: ++ queue handler reactive/etcd.py:367:add_systemd_restart_always tracer: ++ queue handler reactive/etcd.py:570:render_default_user_ssl_exports 2025-02-03 17:08:49 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:748:force_update_nrpe_config 2025-02-03 17:08:49 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2025-02-03 17:08:49 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:122:set_app_version 2025-02-03 17:08:49 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:180:leader_config_changed 2025-02-03 17:08:49 INFO unit.etcd/0.juju-log server.go:316 Previous port: None 2025-02-03 17:08:49 INFO unit.etcd/0.juju-log server.go:316 Previous management port: None 2025-02-03 17:08:49 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:228:bind_to_all_interfaces_changed 2025-02-03 17:08:49 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:235:rerender_config 2025-02-03 17:08:50 INFO unit.etcd/0.juju-log server.go:316 Rendering config file for etcd0 2025-02-03 17:08:50 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for etcd/0: ok=true 2025-02-03 17:08:50 DEBUG unit.etcd/0.juju-log server.go:316 Writing file /var/snap/etcd/common/etcd.conf.yml root:root 444 2025-02-03 17:08:50 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: cleared flag etcd.rerender-config tracer: -- dequeue handler reactive/etcd.py:235:rerender_config 2025-02-03 17:08:50 DEBUG unit.etcd/0.install logger.go:60 inactive 2025-02-03 17:08:50 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:367:add_systemd_restart_always 2025-02-03 17:08:50 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: set flag etcd.service-restart.configured tracer: -- dequeue handler reactive/etcd.py:367:add_systemd_restart_always 2025-02-03 17:08:50 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:570:render_default_user_ssl_exports 2025-02-03 17:08:51 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: set flag etcd.ssl.exported tracer: -- dequeue handler reactive/etcd.py:570:render_default_user_ssl_exports 2025-02-03 17:08:51 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/snap.py:329:change_snapd_refresh 2025-02-03 17:08:51 INFO unit.etcd/0.juju-log server.go:316 Set config refresh.timer=sun1 for snap core 2025-02-03 17:10:19 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for etcd/0 2025-02-03 17:10:21 WARNING unit.etcd/0.install logger.go:60 Job for snapd.service canceled. 2025-02-03 17:10:21 ERROR unit.etcd/0.juju-log server.go:316 Hook error: Traceback (most recent call last): File "/var/lib/juju/agents/unit-etcd-0/.venv/lib/python3.8/site-packages/charms/reactive/__init__.py", line 74, in main bus.dispatch(restricted=restricted_mode) File "/var/lib/juju/agents/unit-etcd-0/.venv/lib/python3.8/site-packages/charms/reactive/bus.py", line 390, in dispatch _invoke(other_handlers) File "/var/lib/juju/agents/unit-etcd-0/.venv/lib/python3.8/site-packages/charms/reactive/bus.py", line 359, in _invoke handler.invoke() File "/var/lib/juju/agents/unit-etcd-0/.venv/lib/python3.8/site-packages/charms/reactive/bus.py", line 181, in invoke self._action(*args) File "/var/lib/juju/agents/unit-etcd-0/charm/reactive/snap.py", line 337, in change_snapd_refresh snap.set_refresh_timer(timer) File "/var/lib/juju/agents/unit-etcd-0/charm/lib/charms/layer/snap.py", line 256, in set_refresh_timer subprocess.check_call(["systemctl", "restart", "snapd.service"]) File "/usr/lib/python3.8/subprocess.py", line 364, in check_call raise CalledProcessError(retcode, cmd) subprocess.CalledProcessError: Command '['systemctl', 'restart', 'snapd.service']' returned non-zero exit status 1. 2025-02-03 17:10:21 WARNING unit.etcd/0.install logger.go:60 Traceback (most recent call last): 2025-02-03 17:10:21 WARNING unit.etcd/0.install logger.go:60 File "/var/lib/juju/agents/unit-etcd-0/charm/hooks/install", line 22, in 2025-02-03 17:10:21 WARNING unit.etcd/0.install logger.go:60 main() 2025-02-03 17:10:21 WARNING unit.etcd/0.install logger.go:60 File "/var/lib/juju/agents/unit-etcd-0/.venv/lib/python3.8/site-packages/charms/reactive/__init__.py", line 74, in main 2025-02-03 17:10:21 WARNING unit.etcd/0.install logger.go:60 bus.dispatch(restricted=restricted_mode) 2025-02-03 17:10:21 WARNING unit.etcd/0.install logger.go:60 File "/var/lib/juju/agents/unit-etcd-0/.venv/lib/python3.8/site-packages/charms/reactive/bus.py", line 390, in dispatch 2025-02-03 17:10:21 WARNING unit.etcd/0.install logger.go:60 _invoke(other_handlers) 2025-02-03 17:10:21 WARNING unit.etcd/0.install logger.go:60 File "/var/lib/juju/agents/unit-etcd-0/.venv/lib/python3.8/site-packages/charms/reactive/bus.py", line 359, in _invoke 2025-02-03 17:10:21 WARNING unit.etcd/0.install logger.go:60 handler.invoke() 2025-02-03 17:10:21 WARNING unit.etcd/0.install logger.go:60 File "/var/lib/juju/agents/unit-etcd-0/.venv/lib/python3.8/site-packages/charms/reactive/bus.py", line 181, in invoke 2025-02-03 17:10:21 WARNING unit.etcd/0.install logger.go:60 self._action(*args) 2025-02-03 17:10:21 WARNING unit.etcd/0.install logger.go:60 File "/var/lib/juju/agents/unit-etcd-0/charm/reactive/snap.py", line 337, in change_snapd_refresh 2025-02-03 17:10:21 WARNING unit.etcd/0.install logger.go:60 snap.set_refresh_timer(timer) 2025-02-03 17:10:21 WARNING unit.etcd/0.install logger.go:60 File "/var/lib/juju/agents/unit-etcd-0/charm/lib/charms/layer/snap.py", line 256, in set_refresh_timer 2025-02-03 17:10:21 WARNING unit.etcd/0.install logger.go:60 subprocess.check_call(["systemctl", "restart", "snapd.service"]) 2025-02-03 17:10:21 WARNING unit.etcd/0.install logger.go:60 File "/usr/lib/python3.8/subprocess.py", line 364, in check_call 2025-02-03 17:10:21 WARNING unit.etcd/0.install logger.go:60 raise CalledProcessError(retcode, cmd) 2025-02-03 17:10:21 WARNING unit.etcd/0.install logger.go:60 subprocess.CalledProcessError: Command '['systemctl', 'restart', 'snapd.service']' returned non-zero exit status 1. 2025-02-03 17:10:21 ERROR juju.worker.uniter.operation runhook.go:153 hook "install" (via explicit, bespoke hook script) failed: exit status 1 2025-02-03 17:10:21 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2025-02-03 17:10:21 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/0 uniter (run install hook) 2025-02-03 17:10:21 DEBUG juju.worker.uniter.operation executor.go:115 lock released for etcd/0 2025-02-03 17:10:21 INFO juju.worker.uniter resolver.go:155 awaiting error resolution for "install" hook 2025-02-03 17:10:21 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] error: hook failed: "install" 2025-02-03 17:10:26 DEBUG juju.worker.uniter.remotestate watcher.go:688 retry hook timer triggered for etcd/0 2025-02-03 17:10:26 INFO juju.worker.uniter resolver.go:155 awaiting error resolution for "install" hook 2025-02-03 17:10:26 DEBUG juju.worker.uniter.operation executor.go:85 running operation run install hook for etcd/0 2025-02-03 17:10:26 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/0 uniter (run install hook) 2025-02-03 17:14:12 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/0 uniter (run install hook) 2025-02-03 17:14:12 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run install hook" for etcd/0 2025-02-03 17:14:12 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run install hook" for etcd/0 2025-02-03 17:14:12 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running install hook 2025-02-03 17:14:12 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-0/agent.socket } 2025-02-03 17:14:13 INFO unit.etcd/0.juju-log server.go:316 Reactive main running for hook install 2025-02-03 17:14:13 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.changed 2025-02-03 17:14:13 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.changed.nagios_context 2025-02-03 17:14:13 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.nagios_context 2025-02-03 17:14:13 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.nagios_context 2025-02-03 17:14:13 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.changed.nagios_servicegroups 2025-02-03 17:14:13 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2025-02-03 17:14:13 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.changed.snapd_refresh 2025-02-03 17:14:13 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.snapd_refresh 2025-02-03 17:14:13 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.snapd_refresh 2025-02-03 17:14:13 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.changed.port 2025-02-03 17:14:13 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.port 2025-02-03 17:14:13 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.port 2025-02-03 17:14:13 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.changed.management_port 2025-02-03 17:14:13 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.management_port 2025-02-03 17:14:13 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.management_port 2025-02-03 17:14:13 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.changed.channel 2025-02-03 17:14:13 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.channel 2025-02-03 17:14:13 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.channel 2025-02-03 17:14:13 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.changed.bind_to_all_interfaces 2025-02-03 17:14:13 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.bind_to_all_interfaces 2025-02-03 17:14:13 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.bind_to_all_interfaces 2025-02-03 17:14:13 INFO unit.etcd/0.juju-log server.go:316 Initializing Leadership Layer (is leader) 2025-02-03 17:14:13 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag leadership.is_leader 2025-02-03 17:14:13 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag leadership.changed.token 2025-02-03 17:14:13 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag leadership.set.token 2025-02-03 17:14:13 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag leadership.changed 2025-02-03 17:14:13 INFO unit.etcd/0.juju-log server.go:316 Initializing Snap Layer 2025-02-03 17:14:13 DEBUG unit.etcd/0.install logger.go:60 none 2025-02-03 17:14:13 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: starting handler dispatch, 25 flags set tracer: set flag config.changed tracer: set flag config.changed.bind_to_all_interfaces tracer: set flag config.changed.channel tracer: set flag config.changed.management_port tracer: set flag config.changed.nagios_context tracer: set flag config.changed.nagios_servicegroups tracer: set flag config.changed.port tracer: set flag config.changed.snapd_refresh tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag leadership.changed tracer: set flag leadership.changed.token tracer: set flag leadership.is_leader tracer: set flag leadership.set.token 2025-02-03 17:14:13 DEBUG unit.etcd/0.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2025-02-03 17:14:13 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: main dispatch loop, 6 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/cdk_service_kicker.py:13:install_cdk_service_kicker tracer: ++ queue handler reactive/etcd.py:131:missing_relation_notice tracer: ++ queue handler reactive/etcd.py:332:channel_changed tracer: ++ queue handler reactive/etcd.py:338:snap_install tracer: ++ queue handler reactive/etcd.py:748:force_update_nrpe_config 2025-02-03 17:14:13 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/cdk_service_kicker.py:13:install_cdk_service_kicker 2025-02-03 17:14:13 DEBUG unit.etcd/0.juju-log server.go:316 Writing file /usr/bin/cdk-service-kicker root:root 444 2025-02-03 17:14:13 DEBUG unit.etcd/0.juju-log server.go:316 Changing permissions on existing content: 33060 -> 292 2025-02-03 17:14:13 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: set flag cdk-service-kicker.installed tracer: -- dequeue handler reactive/cdk_service_kicker.py:13:install_cdk_service_kicker 2025-02-03 17:14:13 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:131:missing_relation_notice 2025-02-03 17:14:13 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:332:channel_changed 2025-02-03 17:14:13 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: set flag etcd.rerender-config tracer: ++ queue handler reactive/etcd.py:235:rerender_config 2025-02-03 17:14:13 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:338:snap_install 2025-02-03 17:14:14 INFO unit.etcd/0.juju-log server.go:316 Installing core from store 2025-02-03 17:14:14 DEBUG unit.etcd/0.juju-log server.go:316 Installation successful cmd="['snap', 'install', '--channel=stable', 'core']" output="b'snap "core" is already installed, see \'snap help refresh\'\n'" 2025-02-03 17:14:14 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: set flag snap.installed.core tracer: ++ queue handler reactive/snap.py:329:change_snapd_refresh 2025-02-03 17:14:14 INFO unit.etcd/0.juju-log server.go:316 Installing etcd from store 2025-02-03 17:14:14 DEBUG unit.etcd/0.juju-log server.go:316 Installation successful cmd="['snap', 'install', '--channel=3.4/stable', 'etcd']" output="b'snap "etcd" is already installed, see \'snap help refresh\'\n'" 2025-02-03 17:14:14 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: set flag snap.installed.etcd tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:180:leader_config_changed tracer: ++ queue handler reactive/etcd.py:228:bind_to_all_interfaces_changed tracer: ++ queue handler reactive/etcd.py:367:add_systemd_restart_always tracer: ++ queue handler reactive/etcd.py:570:render_default_user_ssl_exports 2025-02-03 17:14:14 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:748:force_update_nrpe_config 2025-02-03 17:14:14 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2025-02-03 17:14:14 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:122:set_app_version 2025-02-03 17:14:14 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:180:leader_config_changed 2025-02-03 17:14:14 INFO unit.etcd/0.juju-log server.go:316 Previous port: None 2025-02-03 17:14:14 INFO unit.etcd/0.juju-log server.go:316 Previous management port: None 2025-02-03 17:14:14 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:228:bind_to_all_interfaces_changed 2025-02-03 17:14:14 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:235:rerender_config 2025-02-03 17:14:14 INFO unit.etcd/0.juju-log server.go:316 Rendering config file for etcd0 2025-02-03 17:14:15 DEBUG unit.etcd/0.juju-log server.go:316 Changing permissions on existing content: 33060 -> 292 2025-02-03 17:14:15 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: cleared flag etcd.rerender-config tracer: -- dequeue handler reactive/etcd.py:235:rerender_config 2025-02-03 17:14:15 DEBUG unit.etcd/0.install logger.go:60 activating 2025-02-03 17:14:15 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:367:add_systemd_restart_always 2025-02-03 17:14:15 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: set flag etcd.service-restart.configured tracer: -- dequeue handler reactive/etcd.py:367:add_systemd_restart_always 2025-02-03 17:14:15 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:570:render_default_user_ssl_exports 2025-02-03 17:14:15 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: set flag etcd.ssl.exported tracer: -- dequeue handler reactive/etcd.py:570:render_default_user_ssl_exports 2025-02-03 17:14:15 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/snap.py:329:change_snapd_refresh 2025-02-03 17:14:15 INFO unit.etcd/0.juju-log server.go:316 Set config refresh.timer=sun1 for snap core 2025-02-03 17:14:33 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for etcd/0 2025-02-03 17:14:54 DEBUG juju.worker.meterstatus connected.go:93 got meter status change signal from watcher 2025-02-03 17:15:16 WARNING unit.etcd/0.install logger.go:60 Job for snapd.service failed because the control process exited with error code. 2025-02-03 17:15:16 WARNING unit.etcd/0.install logger.go:60 See "systemctl status snapd.service" and "journalctl -xe" for details. 2025-02-03 17:15:16 ERROR unit.etcd/0.juju-log server.go:316 Hook error: Traceback (most recent call last): File "/var/lib/juju/agents/unit-etcd-0/.venv/lib/python3.8/site-packages/charms/reactive/__init__.py", line 74, in main bus.dispatch(restricted=restricted_mode) File "/var/lib/juju/agents/unit-etcd-0/.venv/lib/python3.8/site-packages/charms/reactive/bus.py", line 390, in dispatch _invoke(other_handlers) File "/var/lib/juju/agents/unit-etcd-0/.venv/lib/python3.8/site-packages/charms/reactive/bus.py", line 359, in _invoke handler.invoke() File "/var/lib/juju/agents/unit-etcd-0/.venv/lib/python3.8/site-packages/charms/reactive/bus.py", line 181, in invoke self._action(*args) File "/var/lib/juju/agents/unit-etcd-0/charm/reactive/snap.py", line 337, in change_snapd_refresh snap.set_refresh_timer(timer) File "/var/lib/juju/agents/unit-etcd-0/charm/lib/charms/layer/snap.py", line 256, in set_refresh_timer subprocess.check_call(["systemctl", "restart", "snapd.service"]) File "/usr/lib/python3.8/subprocess.py", line 364, in check_call raise CalledProcessError(retcode, cmd) subprocess.CalledProcessError: Command '['systemctl', 'restart', 'snapd.service']' returned non-zero exit status 1. 2025-02-03 17:15:16 WARNING unit.etcd/0.install logger.go:60 Traceback (most recent call last): 2025-02-03 17:15:16 WARNING unit.etcd/0.install logger.go:60 File "/var/lib/juju/agents/unit-etcd-0/charm/hooks/install", line 22, in 2025-02-03 17:15:16 WARNING unit.etcd/0.install logger.go:60 main() 2025-02-03 17:15:16 WARNING unit.etcd/0.install logger.go:60 File "/var/lib/juju/agents/unit-etcd-0/.venv/lib/python3.8/site-packages/charms/reactive/__init__.py", line 74, in main 2025-02-03 17:15:16 WARNING unit.etcd/0.install logger.go:60 bus.dispatch(restricted=restricted_mode) 2025-02-03 17:15:16 WARNING unit.etcd/0.install logger.go:60 File "/var/lib/juju/agents/unit-etcd-0/.venv/lib/python3.8/site-packages/charms/reactive/bus.py", line 390, in dispatch 2025-02-03 17:15:16 WARNING unit.etcd/0.install logger.go:60 _invoke(other_handlers) 2025-02-03 17:15:16 WARNING unit.etcd/0.install logger.go:60 File "/var/lib/juju/agents/unit-etcd-0/.venv/lib/python3.8/site-packages/charms/reactive/bus.py", line 359, in _invoke 2025-02-03 17:15:16 WARNING unit.etcd/0.install logger.go:60 handler.invoke() 2025-02-03 17:15:16 WARNING unit.etcd/0.install logger.go:60 File "/var/lib/juju/agents/unit-etcd-0/.venv/lib/python3.8/site-packages/charms/reactive/bus.py", line 181, in invoke 2025-02-03 17:15:16 WARNING unit.etcd/0.install logger.go:60 self._action(*args) 2025-02-03 17:15:16 WARNING unit.etcd/0.install logger.go:60 File "/var/lib/juju/agents/unit-etcd-0/charm/reactive/snap.py", line 337, in change_snapd_refresh 2025-02-03 17:15:16 WARNING unit.etcd/0.install logger.go:60 snap.set_refresh_timer(timer) 2025-02-03 17:15:16 WARNING unit.etcd/0.install logger.go:60 File "/var/lib/juju/agents/unit-etcd-0/charm/lib/charms/layer/snap.py", line 256, in set_refresh_timer 2025-02-03 17:15:16 WARNING unit.etcd/0.install logger.go:60 subprocess.check_call(["systemctl", "restart", "snapd.service"]) 2025-02-03 17:15:16 WARNING unit.etcd/0.install logger.go:60 File "/usr/lib/python3.8/subprocess.py", line 364, in check_call 2025-02-03 17:15:16 WARNING unit.etcd/0.install logger.go:60 raise CalledProcessError(retcode, cmd) 2025-02-03 17:15:16 WARNING unit.etcd/0.install logger.go:60 subprocess.CalledProcessError: Command '['systemctl', 'restart', 'snapd.service']' returned non-zero exit status 1. 2025-02-03 17:15:16 ERROR juju.worker.uniter.operation runhook.go:153 hook "install" (via explicit, bespoke hook script) failed: exit status 1 2025-02-03 17:15:16 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2025-02-03 17:15:16 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/0 uniter (run install hook) 2025-02-03 17:15:16 DEBUG juju.worker.uniter.operation executor.go:115 lock released for etcd/0 2025-02-03 17:15:16 INFO juju.worker.uniter resolver.go:155 awaiting error resolution for "install" hook 2025-02-03 17:15:16 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] error: hook failed: "install" 2025-02-03 17:15:26 DEBUG juju.worker.uniter.remotestate watcher.go:688 retry hook timer triggered for etcd/0 2025-02-03 17:15:26 INFO juju.worker.uniter resolver.go:155 awaiting error resolution for "install" hook 2025-02-03 17:15:26 DEBUG juju.worker.uniter.operation executor.go:85 running operation run install hook for etcd/0 2025-02-03 17:15:26 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/0 uniter (run install hook) 2025-02-03 17:19:39 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for etcd/0 2025-02-03 17:22:29 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/0 uniter (run install hook) 2025-02-03 17:22:29 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run install hook" for etcd/0 2025-02-03 17:22:29 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run install hook" for etcd/0 2025-02-03 17:22:29 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running install hook 2025-02-03 17:22:29 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-0/agent.socket } 2025-02-03 17:22:29 INFO unit.etcd/0.juju-log server.go:316 Reactive main running for hook install 2025-02-03 17:22:29 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.changed 2025-02-03 17:22:29 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.changed.nagios_context 2025-02-03 17:22:29 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.nagios_context 2025-02-03 17:22:29 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.nagios_context 2025-02-03 17:22:29 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.changed.nagios_servicegroups 2025-02-03 17:22:29 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2025-02-03 17:22:29 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.changed.snapd_refresh 2025-02-03 17:22:29 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.snapd_refresh 2025-02-03 17:22:29 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.snapd_refresh 2025-02-03 17:22:29 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.changed.port 2025-02-03 17:22:29 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.port 2025-02-03 17:22:29 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.port 2025-02-03 17:22:29 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.changed.management_port 2025-02-03 17:22:30 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.management_port 2025-02-03 17:22:30 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.management_port 2025-02-03 17:22:30 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.changed.channel 2025-02-03 17:22:30 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.channel 2025-02-03 17:22:30 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.channel 2025-02-03 17:22:30 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.changed.bind_to_all_interfaces 2025-02-03 17:22:30 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.bind_to_all_interfaces 2025-02-03 17:22:30 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.bind_to_all_interfaces 2025-02-03 17:22:30 INFO unit.etcd/0.juju-log server.go:316 Initializing Leadership Layer (is leader) 2025-02-03 17:22:30 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag leadership.is_leader 2025-02-03 17:22:30 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag leadership.changed.token 2025-02-03 17:22:30 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag leadership.set.token 2025-02-03 17:22:30 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag leadership.changed 2025-02-03 17:22:30 INFO unit.etcd/0.juju-log server.go:316 Initializing Snap Layer 2025-02-03 17:22:30 DEBUG unit.etcd/0.install logger.go:60 none 2025-02-03 17:22:30 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: starting handler dispatch, 25 flags set tracer: set flag config.changed tracer: set flag config.changed.bind_to_all_interfaces tracer: set flag config.changed.channel tracer: set flag config.changed.management_port tracer: set flag config.changed.nagios_context tracer: set flag config.changed.nagios_servicegroups tracer: set flag config.changed.port tracer: set flag config.changed.snapd_refresh tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag leadership.changed tracer: set flag leadership.changed.token tracer: set flag leadership.is_leader tracer: set flag leadership.set.token 2025-02-03 17:22:30 DEBUG unit.etcd/0.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2025-02-03 17:22:30 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: main dispatch loop, 6 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/cdk_service_kicker.py:13:install_cdk_service_kicker tracer: ++ queue handler reactive/etcd.py:131:missing_relation_notice tracer: ++ queue handler reactive/etcd.py:332:channel_changed tracer: ++ queue handler reactive/etcd.py:338:snap_install tracer: ++ queue handler reactive/etcd.py:748:force_update_nrpe_config 2025-02-03 17:22:30 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/cdk_service_kicker.py:13:install_cdk_service_kicker 2025-02-03 17:22:30 DEBUG unit.etcd/0.juju-log server.go:316 Writing file /usr/bin/cdk-service-kicker root:root 444 2025-02-03 17:22:30 DEBUG unit.etcd/0.juju-log server.go:316 Changing permissions on existing content: 33060 -> 292 2025-02-03 17:22:30 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: set flag cdk-service-kicker.installed tracer: -- dequeue handler reactive/cdk_service_kicker.py:13:install_cdk_service_kicker 2025-02-03 17:22:30 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:131:missing_relation_notice 2025-02-03 17:22:30 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:332:channel_changed 2025-02-03 17:22:30 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: set flag etcd.rerender-config tracer: ++ queue handler reactive/etcd.py:235:rerender_config 2025-02-03 17:22:30 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:338:snap_install 2025-02-03 17:22:30 INFO unit.etcd/0.juju-log server.go:316 Installing core from store 2025-02-03 17:24:30 ERROR unit.etcd/0.juju-log server.go:316 Installation failed cmd="['snap', 'install', '--channel=stable', 'core']" returncode=1 output="b'error: cannot communicate with server: timeout exceeded while waiting for response\n'" 2025-02-03 17:25:32 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for etcd/0 2025-02-03 17:26:40 ERROR unit.etcd/0.juju-log server.go:316 Installation failed cmd="['snap', 'install', '--channel=stable', 'core']" returncode=1 output="b'error: cannot communicate with server: timeout exceeded while waiting for response\n'" 2025-02-03 17:28:51 ERROR unit.etcd/0.juju-log server.go:316 Installation failed cmd="['snap', 'install', '--channel=stable', 'core']" returncode=1 output="b'error: cannot communicate with server: timeout exceeded while waiting for response\n'" 2025-02-03 17:28:51 ERROR unit.etcd/0.juju-log server.go:316 Hook error: Traceback (most recent call last): File "/var/lib/juju/agents/unit-etcd-0/.venv/lib/python3.8/site-packages/charms/reactive/__init__.py", line 74, in main bus.dispatch(restricted=restricted_mode) File "/var/lib/juju/agents/unit-etcd-0/.venv/lib/python3.8/site-packages/charms/reactive/bus.py", line 390, in dispatch _invoke(other_handlers) File "/var/lib/juju/agents/unit-etcd-0/.venv/lib/python3.8/site-packages/charms/reactive/bus.py", line 359, in _invoke handler.invoke() File "/var/lib/juju/agents/unit-etcd-0/.venv/lib/python3.8/site-packages/charms/reactive/bus.py", line 181, in invoke self._action(*args) File "/var/lib/juju/agents/unit-etcd-0/charm/reactive/etcd.py", line 342, in snap_install snap.install('core') File "/var/lib/juju/agents/unit-etcd-0/charm/lib/charms/layer/snap.py", line 65, in install _install_store(snapname, **kw) File "/var/lib/juju/agents/unit-etcd-0/charm/lib/charms/layer/snap.py", line 375, in _install_store _run_install() File "/var/lib/juju/agents/unit-etcd-0/.venv/lib/python3.8/site-packages/tenacity/__init__.py", line 292, in wrapped_f return self.call(f, *args, **kw) File "/var/lib/juju/agents/unit-etcd-0/.venv/lib/python3.8/site-packages/tenacity/__init__.py", line 358, in call do = self.iter(retry_state=retry_state) File "/var/lib/juju/agents/unit-etcd-0/.venv/lib/python3.8/site-packages/tenacity/__init__.py", line 331, in iter raise retry_exc.reraise() File "/var/lib/juju/agents/unit-etcd-0/.venv/lib/python3.8/site-packages/tenacity/__init__.py", line 167, in reraise raise self.last_attempt.result() File "/usr/lib/python3.8/concurrent/futures/_base.py", line 437, in result return self.__get_result() File "/usr/lib/python3.8/concurrent/futures/_base.py", line 389, in __get_result raise self._exception File "/var/lib/juju/agents/unit-etcd-0/.venv/lib/python3.8/site-packages/tenacity/__init__.py", line 361, in call result = fn(*args, **kwargs) File "/var/lib/juju/agents/unit-etcd-0/charm/lib/charms/layer/snap.py", line 362, in _run_install out = subprocess.check_output(cmd, stderr=subprocess.STDOUT) File "/usr/lib/python3.8/subprocess.py", line 415, in check_output return run(*popenargs, stdout=PIPE, timeout=timeout, check=True, File "/usr/lib/python3.8/subprocess.py", line 516, in run raise CalledProcessError(retcode, process.args, subprocess.CalledProcessError: Command '['snap', 'install', '--channel=stable', 'core']' returned non-zero exit status 1. 2025-02-03 17:28:51 WARNING unit.etcd/0.install logger.go:60 Traceback (most recent call last): 2025-02-03 17:28:51 WARNING unit.etcd/0.install logger.go:60 File "/var/lib/juju/agents/unit-etcd-0/charm/hooks/install", line 22, in 2025-02-03 17:28:51 WARNING unit.etcd/0.install logger.go:60 main() 2025-02-03 17:28:51 WARNING unit.etcd/0.install logger.go:60 File "/var/lib/juju/agents/unit-etcd-0/.venv/lib/python3.8/site-packages/charms/reactive/__init__.py", line 74, in main 2025-02-03 17:28:51 WARNING unit.etcd/0.install logger.go:60 bus.dispatch(restricted=restricted_mode) 2025-02-03 17:28:51 WARNING unit.etcd/0.install logger.go:60 File "/var/lib/juju/agents/unit-etcd-0/.venv/lib/python3.8/site-packages/charms/reactive/bus.py", line 390, in dispatch 2025-02-03 17:28:51 WARNING unit.etcd/0.install logger.go:60 _invoke(other_handlers) 2025-02-03 17:28:51 WARNING unit.etcd/0.install logger.go:60 File "/var/lib/juju/agents/unit-etcd-0/.venv/lib/python3.8/site-packages/charms/reactive/bus.py", line 359, in _invoke 2025-02-03 17:28:51 WARNING unit.etcd/0.install logger.go:60 handler.invoke() 2025-02-03 17:28:51 WARNING unit.etcd/0.install logger.go:60 File "/var/lib/juju/agents/unit-etcd-0/.venv/lib/python3.8/site-packages/charms/reactive/bus.py", line 181, in invoke 2025-02-03 17:28:51 WARNING unit.etcd/0.install logger.go:60 self._action(*args) 2025-02-03 17:28:51 WARNING unit.etcd/0.install logger.go:60 File "/var/lib/juju/agents/unit-etcd-0/charm/reactive/etcd.py", line 342, in snap_install 2025-02-03 17:28:51 WARNING unit.etcd/0.install logger.go:60 snap.install('core') 2025-02-03 17:28:51 WARNING unit.etcd/0.install logger.go:60 File "/var/lib/juju/agents/unit-etcd-0/charm/lib/charms/layer/snap.py", line 65, in install 2025-02-03 17:28:51 WARNING unit.etcd/0.install logger.go:60 _install_store(snapname, **kw) 2025-02-03 17:28:51 WARNING unit.etcd/0.install logger.go:60 File "/var/lib/juju/agents/unit-etcd-0/charm/lib/charms/layer/snap.py", line 375, in _install_store 2025-02-03 17:28:51 WARNING unit.etcd/0.install logger.go:60 _run_install() 2025-02-03 17:28:51 WARNING unit.etcd/0.install logger.go:60 File "/var/lib/juju/agents/unit-etcd-0/.venv/lib/python3.8/site-packages/tenacity/__init__.py", line 292, in wrapped_f 2025-02-03 17:28:51 WARNING unit.etcd/0.install logger.go:60 return self.call(f, *args, **kw) 2025-02-03 17:28:51 WARNING unit.etcd/0.install logger.go:60 File "/var/lib/juju/agents/unit-etcd-0/.venv/lib/python3.8/site-packages/tenacity/__init__.py", line 358, in call 2025-02-03 17:28:51 WARNING unit.etcd/0.install logger.go:60 do = self.iter(retry_state=retry_state) 2025-02-03 17:28:51 WARNING unit.etcd/0.install logger.go:60 File "/var/lib/juju/agents/unit-etcd-0/.venv/lib/python3.8/site-packages/tenacity/__init__.py", line 331, in iter 2025-02-03 17:28:51 WARNING unit.etcd/0.install logger.go:60 raise retry_exc.reraise() 2025-02-03 17:28:51 WARNING unit.etcd/0.install logger.go:60 File "/var/lib/juju/agents/unit-etcd-0/.venv/lib/python3.8/site-packages/tenacity/__init__.py", line 167, in reraise 2025-02-03 17:28:51 WARNING unit.etcd/0.install logger.go:60 raise self.last_attempt.result() 2025-02-03 17:28:51 WARNING unit.etcd/0.install logger.go:60 File "/usr/lib/python3.8/concurrent/futures/_base.py", line 437, in result 2025-02-03 17:28:51 WARNING unit.etcd/0.install logger.go:60 return self.__get_result() 2025-02-03 17:28:51 WARNING unit.etcd/0.install logger.go:60 File "/usr/lib/python3.8/concurrent/futures/_base.py", line 389, in __get_result 2025-02-03 17:28:51 WARNING unit.etcd/0.install logger.go:60 raise self._exception 2025-02-03 17:28:51 WARNING unit.etcd/0.install logger.go:60 File "/var/lib/juju/agents/unit-etcd-0/.venv/lib/python3.8/site-packages/tenacity/__init__.py", line 361, in call 2025-02-03 17:28:51 WARNING unit.etcd/0.install logger.go:60 result = fn(*args, **kwargs) 2025-02-03 17:28:51 WARNING unit.etcd/0.install logger.go:60 File "/var/lib/juju/agents/unit-etcd-0/charm/lib/charms/layer/snap.py", line 362, in _run_install 2025-02-03 17:28:51 WARNING unit.etcd/0.install logger.go:60 out = subprocess.check_output(cmd, stderr=subprocess.STDOUT) 2025-02-03 17:28:51 WARNING unit.etcd/0.install logger.go:60 File "/usr/lib/python3.8/subprocess.py", line 415, in check_output 2025-02-03 17:28:51 WARNING unit.etcd/0.install logger.go:60 return run(*popenargs, stdout=PIPE, timeout=timeout, check=True, 2025-02-03 17:28:51 WARNING unit.etcd/0.install logger.go:60 File "/usr/lib/python3.8/subprocess.py", line 516, in run 2025-02-03 17:28:51 WARNING unit.etcd/0.install logger.go:60 raise CalledProcessError(retcode, process.args, 2025-02-03 17:28:51 WARNING unit.etcd/0.install logger.go:60 subprocess.CalledProcessError: Command '['snap', 'install', '--channel=stable', 'core']' returned non-zero exit status 1. 2025-02-03 17:28:51 ERROR juju.worker.uniter.operation runhook.go:153 hook "install" (via explicit, bespoke hook script) failed: exit status 1 2025-02-03 17:28:51 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2025-02-03 17:28:51 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/0 uniter (run install hook) 2025-02-03 17:28:51 DEBUG juju.worker.uniter.operation executor.go:115 lock released for etcd/0 2025-02-03 17:28:51 INFO juju.worker.uniter resolver.go:155 awaiting error resolution for "install" hook 2025-02-03 17:28:51 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] error: hook failed: "install" 2025-02-03 17:29:11 DEBUG juju.worker.uniter.remotestate watcher.go:688 retry hook timer triggered for etcd/0 2025-02-03 17:29:11 INFO juju.worker.uniter resolver.go:155 awaiting error resolution for "install" hook 2025-02-03 17:29:11 DEBUG juju.worker.uniter.operation executor.go:85 running operation run install hook for etcd/0 2025-02-03 17:29:11 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/0 uniter (run install hook) 2025-02-03 17:31:10 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for etcd/0 2025-02-03 17:35:24 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/0 uniter (run install hook) 2025-02-03 17:35:24 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run install hook" for etcd/0 2025-02-03 17:35:24 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run install hook" for etcd/0 2025-02-03 17:35:24 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running install hook 2025-02-03 17:35:24 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-0/agent.socket } 2025-02-03 17:35:24 INFO unit.etcd/0.juju-log server.go:316 Reactive main running for hook install 2025-02-03 17:35:24 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.changed 2025-02-03 17:35:24 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.changed.nagios_context 2025-02-03 17:35:24 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.nagios_context 2025-02-03 17:35:24 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.nagios_context 2025-02-03 17:35:24 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.changed.nagios_servicegroups 2025-02-03 17:35:24 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2025-02-03 17:35:24 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.changed.snapd_refresh 2025-02-03 17:35:24 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.snapd_refresh 2025-02-03 17:35:25 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.snapd_refresh 2025-02-03 17:35:25 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.changed.port 2025-02-03 17:35:25 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.port 2025-02-03 17:35:25 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.port 2025-02-03 17:35:25 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.changed.management_port 2025-02-03 17:35:25 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.management_port 2025-02-03 17:35:25 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.management_port 2025-02-03 17:35:25 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.changed.channel 2025-02-03 17:35:25 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.channel 2025-02-03 17:35:25 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.channel 2025-02-03 17:35:25 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.changed.bind_to_all_interfaces 2025-02-03 17:35:25 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.bind_to_all_interfaces 2025-02-03 17:35:25 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.bind_to_all_interfaces 2025-02-03 17:35:25 INFO unit.etcd/0.juju-log server.go:316 Initializing Leadership Layer (is leader) 2025-02-03 17:35:25 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag leadership.is_leader 2025-02-03 17:35:25 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag leadership.changed.token 2025-02-03 17:35:25 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag leadership.set.token 2025-02-03 17:35:25 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag leadership.changed 2025-02-03 17:35:25 INFO unit.etcd/0.juju-log server.go:316 Initializing Snap Layer 2025-02-03 17:35:25 DEBUG unit.etcd/0.install logger.go:60 none 2025-02-03 17:35:25 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: starting handler dispatch, 25 flags set tracer: set flag config.changed tracer: set flag config.changed.bind_to_all_interfaces tracer: set flag config.changed.channel tracer: set flag config.changed.management_port tracer: set flag config.changed.nagios_context tracer: set flag config.changed.nagios_servicegroups tracer: set flag config.changed.port tracer: set flag config.changed.snapd_refresh tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag leadership.changed tracer: set flag leadership.changed.token tracer: set flag leadership.is_leader tracer: set flag leadership.set.token 2025-02-03 17:35:25 DEBUG unit.etcd/0.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2025-02-03 17:35:25 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: main dispatch loop, 6 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/cdk_service_kicker.py:13:install_cdk_service_kicker tracer: ++ queue handler reactive/etcd.py:131:missing_relation_notice tracer: ++ queue handler reactive/etcd.py:332:channel_changed tracer: ++ queue handler reactive/etcd.py:338:snap_install tracer: ++ queue handler reactive/etcd.py:748:force_update_nrpe_config 2025-02-03 17:35:25 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/cdk_service_kicker.py:13:install_cdk_service_kicker 2025-02-03 17:35:25 DEBUG unit.etcd/0.juju-log server.go:316 Writing file /usr/bin/cdk-service-kicker root:root 444 2025-02-03 17:35:25 DEBUG unit.etcd/0.juju-log server.go:316 Changing permissions on existing content: 33060 -> 292 2025-02-03 17:35:25 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: set flag cdk-service-kicker.installed tracer: -- dequeue handler reactive/cdk_service_kicker.py:13:install_cdk_service_kicker 2025-02-03 17:35:25 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:131:missing_relation_notice 2025-02-03 17:35:25 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:332:channel_changed 2025-02-03 17:35:25 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: set flag etcd.rerender-config tracer: ++ queue handler reactive/etcd.py:235:rerender_config 2025-02-03 17:35:25 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:338:snap_install 2025-02-03 17:35:25 INFO unit.etcd/0.juju-log server.go:316 Installing core from store 2025-02-03 17:35:49 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for etcd/0 2025-02-03 17:37:25 ERROR unit.etcd/0.juju-log server.go:316 Installation failed cmd="['snap', 'install', '--channel=stable', 'core']" returncode=1 output="b'error: cannot communicate with server: timeout exceeded while waiting for response\n'" 2025-02-03 17:39:35 ERROR unit.etcd/0.juju-log server.go:316 Installation failed cmd="['snap', 'install', '--channel=stable', 'core']" returncode=1 output="b'error: cannot communicate with server: timeout exceeded while waiting for response\n'" 2025-02-03 17:41:11 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for etcd/0 2025-02-03 17:41:45 ERROR unit.etcd/0.juju-log server.go:316 Installation failed cmd="['snap', 'install', '--channel=stable', 'core']" returncode=1 output="b'error: cannot communicate with server: timeout exceeded while waiting for response\n'" 2025-02-03 17:41:46 ERROR unit.etcd/0.juju-log server.go:316 Hook error: Traceback (most recent call last): File "/var/lib/juju/agents/unit-etcd-0/.venv/lib/python3.8/site-packages/charms/reactive/__init__.py", line 74, in main bus.dispatch(restricted=restricted_mode) File "/var/lib/juju/agents/unit-etcd-0/.venv/lib/python3.8/site-packages/charms/reactive/bus.py", line 390, in dispatch _invoke(other_handlers) File "/var/lib/juju/agents/unit-etcd-0/.venv/lib/python3.8/site-packages/charms/reactive/bus.py", line 359, in _invoke handler.invoke() File "/var/lib/juju/agents/unit-etcd-0/.venv/lib/python3.8/site-packages/charms/reactive/bus.py", line 181, in invoke self._action(*args) File "/var/lib/juju/agents/unit-etcd-0/charm/reactive/etcd.py", line 342, in snap_install snap.install('core') File "/var/lib/juju/agents/unit-etcd-0/charm/lib/charms/layer/snap.py", line 65, in install _install_store(snapname, **kw) File "/var/lib/juju/agents/unit-etcd-0/charm/lib/charms/layer/snap.py", line 375, in _install_store _run_install() File "/var/lib/juju/agents/unit-etcd-0/.venv/lib/python3.8/site-packages/tenacity/__init__.py", line 292, in wrapped_f return self.call(f, *args, **kw) File "/var/lib/juju/agents/unit-etcd-0/.venv/lib/python3.8/site-packages/tenacity/__init__.py", line 358, in call do = self.iter(retry_state=retry_state) File "/var/lib/juju/agents/unit-etcd-0/.venv/lib/python3.8/site-packages/tenacity/__init__.py", line 331, in iter raise retry_exc.reraise() File "/var/lib/juju/agents/unit-etcd-0/.venv/lib/python3.8/site-packages/tenacity/__init__.py", line 167, in reraise raise self.last_attempt.result() File "/usr/lib/python3.8/concurrent/futures/_base.py", line 437, in result return self.__get_result() File "/usr/lib/python3.8/concurrent/futures/_base.py", line 389, in __get_result raise self._exception File "/var/lib/juju/agents/unit-etcd-0/.venv/lib/python3.8/site-packages/tenacity/__init__.py", line 361, in call result = fn(*args, **kwargs) File "/var/lib/juju/agents/unit-etcd-0/charm/lib/charms/layer/snap.py", line 362, in _run_install out = subprocess.check_output(cmd, stderr=subprocess.STDOUT) File "/usr/lib/python3.8/subprocess.py", line 415, in check_output return run(*popenargs, stdout=PIPE, timeout=timeout, check=True, File "/usr/lib/python3.8/subprocess.py", line 516, in run raise CalledProcessError(retcode, process.args, subprocess.CalledProcessError: Command '['snap', 'install', '--channel=stable', 'core']' returned non-zero exit status 1. 2025-02-03 17:41:46 WARNING unit.etcd/0.install logger.go:60 Traceback (most recent call last): 2025-02-03 17:41:46 WARNING unit.etcd/0.install logger.go:60 File "/var/lib/juju/agents/unit-etcd-0/charm/hooks/install", line 22, in 2025-02-03 17:41:46 WARNING unit.etcd/0.install logger.go:60 main() 2025-02-03 17:41:46 WARNING unit.etcd/0.install logger.go:60 File "/var/lib/juju/agents/unit-etcd-0/.venv/lib/python3.8/site-packages/charms/reactive/__init__.py", line 74, in main 2025-02-03 17:41:46 WARNING unit.etcd/0.install logger.go:60 bus.dispatch(restricted=restricted_mode) 2025-02-03 17:41:46 WARNING unit.etcd/0.install logger.go:60 File "/var/lib/juju/agents/unit-etcd-0/.venv/lib/python3.8/site-packages/charms/reactive/bus.py", line 390, in dispatch 2025-02-03 17:41:46 WARNING unit.etcd/0.install logger.go:60 _invoke(other_handlers) 2025-02-03 17:41:46 WARNING unit.etcd/0.install logger.go:60 File "/var/lib/juju/agents/unit-etcd-0/.venv/lib/python3.8/site-packages/charms/reactive/bus.py", line 359, in _invoke 2025-02-03 17:41:46 WARNING unit.etcd/0.install logger.go:60 handler.invoke() 2025-02-03 17:41:46 WARNING unit.etcd/0.install logger.go:60 File "/var/lib/juju/agents/unit-etcd-0/.venv/lib/python3.8/site-packages/charms/reactive/bus.py", line 181, in invoke 2025-02-03 17:41:46 WARNING unit.etcd/0.install logger.go:60 self._action(*args) 2025-02-03 17:41:46 WARNING unit.etcd/0.install logger.go:60 File "/var/lib/juju/agents/unit-etcd-0/charm/reactive/etcd.py", line 342, in snap_install 2025-02-03 17:41:46 WARNING unit.etcd/0.install logger.go:60 snap.install('core') 2025-02-03 17:41:46 WARNING unit.etcd/0.install logger.go:60 File "/var/lib/juju/agents/unit-etcd-0/charm/lib/charms/layer/snap.py", line 65, in install 2025-02-03 17:41:46 WARNING unit.etcd/0.install logger.go:60 _install_store(snapname, **kw) 2025-02-03 17:41:46 WARNING unit.etcd/0.install logger.go:60 File "/var/lib/juju/agents/unit-etcd-0/charm/lib/charms/layer/snap.py", line 375, in _install_store 2025-02-03 17:41:46 WARNING unit.etcd/0.install logger.go:60 _run_install() 2025-02-03 17:41:46 WARNING unit.etcd/0.install logger.go:60 File "/var/lib/juju/agents/unit-etcd-0/.venv/lib/python3.8/site-packages/tenacity/__init__.py", line 292, in wrapped_f 2025-02-03 17:41:46 WARNING unit.etcd/0.install logger.go:60 return self.call(f, *args, **kw) 2025-02-03 17:41:46 WARNING unit.etcd/0.install logger.go:60 File "/var/lib/juju/agents/unit-etcd-0/.venv/lib/python3.8/site-packages/tenacity/__init__.py", line 358, in call 2025-02-03 17:41:46 WARNING unit.etcd/0.install logger.go:60 do = self.iter(retry_state=retry_state) 2025-02-03 17:41:46 WARNING unit.etcd/0.install logger.go:60 File "/var/lib/juju/agents/unit-etcd-0/.venv/lib/python3.8/site-packages/tenacity/__init__.py", line 331, in iter 2025-02-03 17:41:46 WARNING unit.etcd/0.install logger.go:60 raise retry_exc.reraise() 2025-02-03 17:41:46 WARNING unit.etcd/0.install logger.go:60 File "/var/lib/juju/agents/unit-etcd-0/.venv/lib/python3.8/site-packages/tenacity/__init__.py", line 167, in reraise 2025-02-03 17:41:46 WARNING unit.etcd/0.install logger.go:60 raise self.last_attempt.result() 2025-02-03 17:41:46 WARNING unit.etcd/0.install logger.go:60 File "/usr/lib/python3.8/concurrent/futures/_base.py", line 437, in result 2025-02-03 17:41:46 WARNING unit.etcd/0.install logger.go:60 return self.__get_result() 2025-02-03 17:41:46 WARNING unit.etcd/0.install logger.go:60 File "/usr/lib/python3.8/concurrent/futures/_base.py", line 389, in __get_result 2025-02-03 17:41:46 WARNING unit.etcd/0.install logger.go:60 raise self._exception 2025-02-03 17:41:46 WARNING unit.etcd/0.install logger.go:60 File "/var/lib/juju/agents/unit-etcd-0/.venv/lib/python3.8/site-packages/tenacity/__init__.py", line 361, in call 2025-02-03 17:41:46 WARNING unit.etcd/0.install logger.go:60 result = fn(*args, **kwargs) 2025-02-03 17:41:46 WARNING unit.etcd/0.install logger.go:60 File "/var/lib/juju/agents/unit-etcd-0/charm/lib/charms/layer/snap.py", line 362, in _run_install 2025-02-03 17:41:46 WARNING unit.etcd/0.install logger.go:60 out = subprocess.check_output(cmd, stderr=subprocess.STDOUT) 2025-02-03 17:41:46 WARNING unit.etcd/0.install logger.go:60 File "/usr/lib/python3.8/subprocess.py", line 415, in check_output 2025-02-03 17:41:46 WARNING unit.etcd/0.install logger.go:60 return run(*popenargs, stdout=PIPE, timeout=timeout, check=True, 2025-02-03 17:41:46 WARNING unit.etcd/0.install logger.go:60 File "/usr/lib/python3.8/subprocess.py", line 516, in run 2025-02-03 17:41:46 WARNING unit.etcd/0.install logger.go:60 raise CalledProcessError(retcode, process.args, 2025-02-03 17:41:46 WARNING unit.etcd/0.install logger.go:60 subprocess.CalledProcessError: Command '['snap', 'install', '--channel=stable', 'core']' returned non-zero exit status 1. 2025-02-03 17:41:46 ERROR juju.worker.uniter.operation runhook.go:153 hook "install" (via explicit, bespoke hook script) failed: exit status 1 2025-02-03 17:41:46 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2025-02-03 17:41:46 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/0 uniter (run install hook) 2025-02-03 17:41:46 DEBUG juju.worker.uniter.operation executor.go:115 lock released for etcd/0 2025-02-03 17:41:46 INFO juju.worker.uniter resolver.go:155 awaiting error resolution for "install" hook 2025-02-03 17:41:46 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] error: hook failed: "install" 2025-02-03 17:42:24 DEBUG juju.worker.uniter.remotestate watcher.go:688 retry hook timer triggered for etcd/0 2025-02-03 17:42:24 INFO juju.worker.uniter resolver.go:155 awaiting error resolution for "install" hook 2025-02-03 17:42:24 DEBUG juju.worker.uniter.operation executor.go:85 running operation run install hook for etcd/0 2025-02-03 17:42:24 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/0 uniter (run install hook) 2025-02-03 17:46:15 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for etcd/0 2025-02-03 17:48:21 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/0 uniter (run install hook) 2025-02-03 17:48:21 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run install hook" for etcd/0 2025-02-03 17:48:21 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run install hook" for etcd/0 2025-02-03 17:48:21 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running install hook 2025-02-03 17:48:21 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-0/agent.socket } 2025-02-03 17:48:21 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for etcd/0 : {10 {map[easyrsa/0:{1}] map[] []}} 2025-02-03 17:48:21 INFO unit.etcd/0.juju-log server.go:316 Reactive main running for hook install 2025-02-03 17:48:21 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.changed 2025-02-03 17:48:21 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.changed.nagios_context 2025-02-03 17:48:21 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.nagios_context 2025-02-03 17:48:21 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.nagios_context 2025-02-03 17:48:21 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.changed.nagios_servicegroups 2025-02-03 17:48:21 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2025-02-03 17:48:21 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.changed.snapd_refresh 2025-02-03 17:48:21 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.snapd_refresh 2025-02-03 17:48:21 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.snapd_refresh 2025-02-03 17:48:21 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.changed.port 2025-02-03 17:48:21 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.port 2025-02-03 17:48:21 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.port 2025-02-03 17:48:21 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.changed.management_port 2025-02-03 17:48:21 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.management_port 2025-02-03 17:48:21 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.management_port 2025-02-03 17:48:21 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.changed.channel 2025-02-03 17:48:21 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.channel 2025-02-03 17:48:21 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.channel 2025-02-03 17:48:21 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.changed.bind_to_all_interfaces 2025-02-03 17:48:21 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.bind_to_all_interfaces 2025-02-03 17:48:22 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.bind_to_all_interfaces 2025-02-03 17:48:22 INFO unit.etcd/0.juju-log server.go:316 Initializing Leadership Layer (is leader) 2025-02-03 17:48:22 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag leadership.is_leader 2025-02-03 17:48:22 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag leadership.changed.token 2025-02-03 17:48:22 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag leadership.set.token 2025-02-03 17:48:22 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag leadership.changed 2025-02-03 17:48:22 INFO unit.etcd/0.juju-log server.go:316 Initializing Snap Layer 2025-02-03 17:48:22 DEBUG unit.etcd/0.install logger.go:60 none 2025-02-03 17:48:22 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: starting handler dispatch, 25 flags set tracer: set flag config.changed tracer: set flag config.changed.bind_to_all_interfaces tracer: set flag config.changed.channel tracer: set flag config.changed.management_port tracer: set flag config.changed.nagios_context tracer: set flag config.changed.nagios_servicegroups tracer: set flag config.changed.port tracer: set flag config.changed.snapd_refresh tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag leadership.changed tracer: set flag leadership.changed.token tracer: set flag leadership.is_leader tracer: set flag leadership.set.token 2025-02-03 17:48:22 DEBUG unit.etcd/0.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2025-02-03 17:48:22 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: main dispatch loop, 6 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/cdk_service_kicker.py:13:install_cdk_service_kicker tracer: ++ queue handler reactive/etcd.py:131:missing_relation_notice tracer: ++ queue handler reactive/etcd.py:332:channel_changed tracer: ++ queue handler reactive/etcd.py:338:snap_install tracer: ++ queue handler reactive/etcd.py:748:force_update_nrpe_config 2025-02-03 17:48:22 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/cdk_service_kicker.py:13:install_cdk_service_kicker 2025-02-03 17:48:22 DEBUG unit.etcd/0.juju-log server.go:316 Writing file /usr/bin/cdk-service-kicker root:root 444 2025-02-03 17:48:22 DEBUG unit.etcd/0.juju-log server.go:316 Changing permissions on existing content: 33060 -> 292 2025-02-03 17:48:22 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: set flag cdk-service-kicker.installed tracer: -- dequeue handler reactive/cdk_service_kicker.py:13:install_cdk_service_kicker 2025-02-03 17:48:22 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:131:missing_relation_notice 2025-02-03 17:48:22 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:332:channel_changed 2025-02-03 17:48:22 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: set flag etcd.rerender-config tracer: ++ queue handler reactive/etcd.py:235:rerender_config 2025-02-03 17:48:22 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:338:snap_install 2025-02-03 17:48:22 INFO unit.etcd/0.juju-log server.go:316 Installing core from store 2025-02-03 17:50:22 ERROR unit.etcd/0.juju-log server.go:316 Installation failed cmd="['snap', 'install', '--channel=stable', 'core']" returncode=1 output="b'error: cannot communicate with server: timeout exceeded while waiting for response\n'" 2025-02-03 17:52:10 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for etcd/0 2025-02-03 17:52:32 ERROR unit.etcd/0.juju-log server.go:316 Installation failed cmd="['snap', 'install', '--channel=stable', 'core']" returncode=1 output="b'error: cannot communicate with server: timeout exceeded while waiting for response\n'" 2025-02-03 17:54:42 ERROR unit.etcd/0.juju-log server.go:316 Installation failed cmd="['snap', 'install', '--channel=stable', 'core']" returncode=1 output="b'error: cannot communicate with server: timeout exceeded while waiting for response\n'" 2025-02-03 17:54:42 ERROR unit.etcd/0.juju-log server.go:316 Hook error: Traceback (most recent call last): File "/var/lib/juju/agents/unit-etcd-0/.venv/lib/python3.8/site-packages/charms/reactive/__init__.py", line 74, in main bus.dispatch(restricted=restricted_mode) File "/var/lib/juju/agents/unit-etcd-0/.venv/lib/python3.8/site-packages/charms/reactive/bus.py", line 390, in dispatch _invoke(other_handlers) File "/var/lib/juju/agents/unit-etcd-0/.venv/lib/python3.8/site-packages/charms/reactive/bus.py", line 359, in _invoke handler.invoke() File "/var/lib/juju/agents/unit-etcd-0/.venv/lib/python3.8/site-packages/charms/reactive/bus.py", line 181, in invoke self._action(*args) File "/var/lib/juju/agents/unit-etcd-0/charm/reactive/etcd.py", line 342, in snap_install snap.install('core') File "/var/lib/juju/agents/unit-etcd-0/charm/lib/charms/layer/snap.py", line 65, in install _install_store(snapname, **kw) File "/var/lib/juju/agents/unit-etcd-0/charm/lib/charms/layer/snap.py", line 375, in _install_store _run_install() File "/var/lib/juju/agents/unit-etcd-0/.venv/lib/python3.8/site-packages/tenacity/__init__.py", line 292, in wrapped_f return self.call(f, *args, **kw) File "/var/lib/juju/agents/unit-etcd-0/.venv/lib/python3.8/site-packages/tenacity/__init__.py", line 358, in call do = self.iter(retry_state=retry_state) File "/var/lib/juju/agents/unit-etcd-0/.venv/lib/python3.8/site-packages/tenacity/__init__.py", line 331, in iter raise retry_exc.reraise() File "/var/lib/juju/agents/unit-etcd-0/.venv/lib/python3.8/site-packages/tenacity/__init__.py", line 167, in reraise raise self.last_attempt.result() File "/usr/lib/python3.8/concurrent/futures/_base.py", line 437, in result return self.__get_result() File "/usr/lib/python3.8/concurrent/futures/_base.py", line 389, in __get_result raise self._exception File "/var/lib/juju/agents/unit-etcd-0/.venv/lib/python3.8/site-packages/tenacity/__init__.py", line 361, in call result = fn(*args, **kwargs) File "/var/lib/juju/agents/unit-etcd-0/charm/lib/charms/layer/snap.py", line 362, in _run_install out = subprocess.check_output(cmd, stderr=subprocess.STDOUT) File "/usr/lib/python3.8/subprocess.py", line 415, in check_output return run(*popenargs, stdout=PIPE, timeout=timeout, check=True, File "/usr/lib/python3.8/subprocess.py", line 516, in run raise CalledProcessError(retcode, process.args, subprocess.CalledProcessError: Command '['snap', 'install', '--channel=stable', 'core']' returned non-zero exit status 1. 2025-02-03 17:54:42 WARNING unit.etcd/0.install logger.go:60 Traceback (most recent call last): 2025-02-03 17:54:42 WARNING unit.etcd/0.install logger.go:60 File "/var/lib/juju/agents/unit-etcd-0/charm/hooks/install", line 22, in 2025-02-03 17:54:42 WARNING unit.etcd/0.install logger.go:60 main() 2025-02-03 17:54:42 WARNING unit.etcd/0.install logger.go:60 File "/var/lib/juju/agents/unit-etcd-0/.venv/lib/python3.8/site-packages/charms/reactive/__init__.py", line 74, in main 2025-02-03 17:54:42 WARNING unit.etcd/0.install logger.go:60 bus.dispatch(restricted=restricted_mode) 2025-02-03 17:54:42 WARNING unit.etcd/0.install logger.go:60 File "/var/lib/juju/agents/unit-etcd-0/.venv/lib/python3.8/site-packages/charms/reactive/bus.py", line 390, in dispatch 2025-02-03 17:54:42 WARNING unit.etcd/0.install logger.go:60 _invoke(other_handlers) 2025-02-03 17:54:42 WARNING unit.etcd/0.install logger.go:60 File "/var/lib/juju/agents/unit-etcd-0/.venv/lib/python3.8/site-packages/charms/reactive/bus.py", line 359, in _invoke 2025-02-03 17:54:42 WARNING unit.etcd/0.install logger.go:60 handler.invoke() 2025-02-03 17:54:42 WARNING unit.etcd/0.install logger.go:60 File "/var/lib/juju/agents/unit-etcd-0/.venv/lib/python3.8/site-packages/charms/reactive/bus.py", line 181, in invoke 2025-02-03 17:54:42 WARNING unit.etcd/0.install logger.go:60 self._action(*args) 2025-02-03 17:54:42 WARNING unit.etcd/0.install logger.go:60 File "/var/lib/juju/agents/unit-etcd-0/charm/reactive/etcd.py", line 342, in snap_install 2025-02-03 17:54:42 WARNING unit.etcd/0.install logger.go:60 snap.install('core') 2025-02-03 17:54:42 WARNING unit.etcd/0.install logger.go:60 File "/var/lib/juju/agents/unit-etcd-0/charm/lib/charms/layer/snap.py", line 65, in install 2025-02-03 17:54:42 WARNING unit.etcd/0.install logger.go:60 _install_store(snapname, **kw) 2025-02-03 17:54:42 WARNING unit.etcd/0.install logger.go:60 File "/var/lib/juju/agents/unit-etcd-0/charm/lib/charms/layer/snap.py", line 375, in _install_store 2025-02-03 17:54:42 WARNING unit.etcd/0.install logger.go:60 _run_install() 2025-02-03 17:54:42 WARNING unit.etcd/0.install logger.go:60 File "/var/lib/juju/agents/unit-etcd-0/.venv/lib/python3.8/site-packages/tenacity/__init__.py", line 292, in wrapped_f 2025-02-03 17:54:42 WARNING unit.etcd/0.install logger.go:60 return self.call(f, *args, **kw) 2025-02-03 17:54:42 WARNING unit.etcd/0.install logger.go:60 File "/var/lib/juju/agents/unit-etcd-0/.venv/lib/python3.8/site-packages/tenacity/__init__.py", line 358, in call 2025-02-03 17:54:42 WARNING unit.etcd/0.install logger.go:60 do = self.iter(retry_state=retry_state) 2025-02-03 17:54:42 WARNING unit.etcd/0.install logger.go:60 File "/var/lib/juju/agents/unit-etcd-0/.venv/lib/python3.8/site-packages/tenacity/__init__.py", line 331, in iter 2025-02-03 17:54:42 WARNING unit.etcd/0.install logger.go:60 raise retry_exc.reraise() 2025-02-03 17:54:42 WARNING unit.etcd/0.install logger.go:60 File "/var/lib/juju/agents/unit-etcd-0/.venv/lib/python3.8/site-packages/tenacity/__init__.py", line 167, in reraise 2025-02-03 17:54:42 WARNING unit.etcd/0.install logger.go:60 raise self.last_attempt.result() 2025-02-03 17:54:42 WARNING unit.etcd/0.install logger.go:60 File "/usr/lib/python3.8/concurrent/futures/_base.py", line 437, in result 2025-02-03 17:54:42 WARNING unit.etcd/0.install logger.go:60 return self.__get_result() 2025-02-03 17:54:42 WARNING unit.etcd/0.install logger.go:60 File "/usr/lib/python3.8/concurrent/futures/_base.py", line 389, in __get_result 2025-02-03 17:54:42 WARNING unit.etcd/0.install logger.go:60 raise self._exception 2025-02-03 17:54:42 WARNING unit.etcd/0.install logger.go:60 File "/var/lib/juju/agents/unit-etcd-0/.venv/lib/python3.8/site-packages/tenacity/__init__.py", line 361, in call 2025-02-03 17:54:42 WARNING unit.etcd/0.install logger.go:60 result = fn(*args, **kwargs) 2025-02-03 17:54:42 WARNING unit.etcd/0.install logger.go:60 File "/var/lib/juju/agents/unit-etcd-0/charm/lib/charms/layer/snap.py", line 362, in _run_install 2025-02-03 17:54:42 WARNING unit.etcd/0.install logger.go:60 out = subprocess.check_output(cmd, stderr=subprocess.STDOUT) 2025-02-03 17:54:42 WARNING unit.etcd/0.install logger.go:60 File "/usr/lib/python3.8/subprocess.py", line 415, in check_output 2025-02-03 17:54:42 WARNING unit.etcd/0.install logger.go:60 return run(*popenargs, stdout=PIPE, timeout=timeout, check=True, 2025-02-03 17:54:42 WARNING unit.etcd/0.install logger.go:60 File "/usr/lib/python3.8/subprocess.py", line 516, in run 2025-02-03 17:54:42 WARNING unit.etcd/0.install logger.go:60 raise CalledProcessError(retcode, process.args, 2025-02-03 17:54:42 WARNING unit.etcd/0.install logger.go:60 subprocess.CalledProcessError: Command '['snap', 'install', '--channel=stable', 'core']' returned non-zero exit status 1. 2025-02-03 17:54:43 ERROR juju.worker.uniter.operation runhook.go:153 hook "install" (via explicit, bespoke hook script) failed: exit status 1 2025-02-03 17:54:43 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2025-02-03 17:54:43 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/0 uniter (run install hook) 2025-02-03 17:54:43 DEBUG juju.worker.uniter.operation executor.go:115 lock released for etcd/0 2025-02-03 17:54:43 INFO juju.worker.uniter resolver.go:155 awaiting error resolution for "install" hook 2025-02-03 17:54:43 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] error: hook failed: "install" 2025-02-03 17:55:57 DEBUG juju.worker.uniter.remotestate watcher.go:688 retry hook timer triggered for etcd/0 2025-02-03 17:55:57 INFO juju.worker.uniter resolver.go:155 awaiting error resolution for "install" hook 2025-02-03 17:55:57 DEBUG juju.worker.uniter.operation executor.go:85 running operation run install hook for etcd/0 2025-02-03 17:55:57 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/0 uniter (run install hook) 2025-02-03 17:57:58 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for etcd/0