2025-04-18 07:46:08 INFO juju unit_agent.go:289 Starting unit workers for "etcd/0" 2025-04-18 07:46:08 INFO juju.worker.apicaller connect.go:163 [fbce74] "unit-etcd-0" successfully connected to "252.57.0.1:17070" 2025-04-18 07:46:08 INFO juju.worker.apicaller connect.go:260 [fbce74] password changed for "unit-etcd-0" 2025-04-18 07:46:08 INFO juju.worker.apicaller connect.go:163 [fbce74] "unit-etcd-0" successfully connected to "252.57.0.1:17070" 2025-04-18 07:46:08 INFO juju.worker.migrationminion worker.go:142 migration phase is now: NONE 2025-04-18 07:46:08 INFO juju.worker.logger logger.go:120 logger worker started 2025-04-18 07:46:08 DEBUG juju.worker.dependency engine.go:580 "metric-sender" manifold worker started at 2025-04-18 07:46:08.875296718 +0000 UTC 2025-04-18 07:46:08 DEBUG juju.worker.dependency engine.go:580 "uniter" manifold worker started at 2025-04-18 07:46:08.876582516 +0000 UTC 2025-04-18 07:46:08 INFO juju.worker.upgrader upgrader.go:216 no waiter, upgrader is done 2025-04-18 07:46:08 DEBUG juju.worker.dependency engine.go:603 "upgrader" manifold worker completed successfully 2025-04-18 07:46:08 DEBUG juju.worker.meterstatus connected.go:93 got meter status change signal from watcher 2025-04-18 07:46:08 DEBUG juju.worker.apiaddressupdater apiaddressupdater.go:98 updating API hostPorts to [[10.0.0.57:17070 252.57.0.1:17070 127.0.0.1:17070 [::1]:17070]] 2025-04-18 07:46:08 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for meterstatus (meter-status-changed) 2025-04-18 07:46:08 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for meterstatus (meter-status-changed) 2025-04-18 07:46:08 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-0/agent.socket } 2025-04-18 07:46:08 ERROR juju.worker.meterstatus runner.go:93 error running "meter-status-changed": charm missing from disk 2025-04-18 07:46:08 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2025-04-18 07:46:08 DEBUG juju.machinelock machinelock.go:186 machine lock released for meterstatus (meter-status-changed) 2025-04-18 07:46:08 DEBUG juju.worker.uniter uniter.go:883 starting local juju-run listener on {unix /var/lib/juju/agents/unit-etcd-0/run.socket } 2025-04-18 07:46:08 INFO juju.worker.uniter uniter.go:335 unit "etcd/0" started 2025-04-18 07:46:08 DEBUG juju.worker.uniter runlistener.go:117 juju-run listener running 2025-04-18 07:46:08 INFO juju.worker.uniter uniter.go:651 resuming charm install 2025-04-18 07:46:08 DEBUG juju.worker.uniter.operation executor.go:85 running operation install ch:amd64/focal/etcd-701 for etcd/0 2025-04-18 07:46:08 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "install ch:amd64/focal/etcd-701" for etcd/0 2025-04-18 07:46:08 INFO juju.worker.uniter.charm bundles.go:81 downloading ch:amd64/focal/etcd-701 from API server 2025-04-18 07:46:09 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "install ch:amd64/focal/etcd-701" for etcd/0 2025-04-18 07:46:09 DEBUG juju.worker.uniter.charm manifest_deployer.go:143 preparing to deploy charm "ch:amd64/focal/etcd-701" 2025-04-18 07:46:09 DEBUG juju.worker.uniter.charm manifest_deployer.go:132 deploying charm "ch:amd64/focal/etcd-701" 2025-04-18 07:46:10 DEBUG juju.worker.uniter.charm manifest_deployer.go:164 finishing deploy of charm "ch:amd64/focal/etcd-701" 2025-04-18 07:46:10 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "install ch:amd64/focal/etcd-701" for etcd/0 2025-04-18 07:46:10 INFO juju.worker.uniter uniter.go:361 hooks are retried true 2025-04-18 07:46:10 DEBUG juju.worker.uniter.remotestate watcher.go:542 got config change for etcd/0: ok=true, hashes=[28624016bd32dd0ca16f2ca26922ce370835c29dcd2cedaf5db7c8a89ec3e9fc] 2025-04-18 07:46:10 DEBUG juju.worker.uniter.remotestate watcher.go:595 got action change for etcd/0: [] ok=true 2025-04-18 07:46:10 DEBUG juju.worker.uniter.remotestate watcher.go:574 got address change for etcd/0: ok=true, hashes=[0ea6febdb53af3968189cae2e299465cdff1ab6b9a65969c6c60f7d3f88a5c2a] 2025-04-18 07:46:10 DEBUG juju.worker.uniter.remotestate watcher.go:499 got application change for etcd/0 2025-04-18 07:46:10 DEBUG juju.worker.uniter.remotestate watcher.go:623 got update status interval change for etcd/0: ok=true 2025-04-18 07:46:10 DEBUG juju.worker.uniter.remotestate watcher.go:564 got upgrade series change 2025-04-18 07:46:10 DEBUG juju.worker.uniter.remotestate watcher.go:714 no upgrade series in progress, reinitializing local upgrade series state 2025-04-18 07:46:10 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for etcd/0: ok=true 2025-04-18 07:46:10 DEBUG juju.worker.uniter.remotestate watcher.go:603 got relations change for etcd/0: ok=true 2025-04-18 07:46:10 DEBUG juju.worker.uniter.remotestate watcher.go:489 got unit change for etcd/0 2025-04-18 07:46:10 DEBUG juju.worker.uniter.remotestate watcher.go:613 got storage change for etcd/0: [] ok=true 2025-04-18 07:46:10 DEBUG juju.worker.uniter.remotestate watcher.go:553 got trust config change for etcd/0: ok=true, hashes=[17f2acda51310eebc7ec5fc33ba3e24c9838f484cf50956f7b6066f1d8bba28f] 2025-04-18 07:46:10 INFO juju.worker.uniter.storage resolver.go:126 initial storage attachments ready 2025-04-18 07:46:10 INFO juju.worker.uniter resolver.go:159 found queued "install" hook 2025-04-18 07:46:10 DEBUG juju.worker.uniter.operation executor.go:85 running operation run install hook for etcd/0 2025-04-18 07:46:10 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/0 uniter (run install hook) 2025-04-18 07:46:58 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/0 uniter (run install hook) 2025-04-18 07:46:58 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run install hook" for etcd/0 2025-04-18 07:46:58 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run install hook" for etcd/0 2025-04-18 07:46:58 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running install hook 2025-04-18 07:46:58 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-0/agent.socket } 2025-04-18 07:46:59 DEBUG unit.etcd/0.install logger.go:60 Reading package lists... 2025-04-18 07:46:59 DEBUG unit.etcd/0.install logger.go:60 Building dependency tree... 2025-04-18 07:46:59 DEBUG unit.etcd/0.install logger.go:60 Reading state information... 2025-04-18 07:46:59 DEBUG unit.etcd/0.install logger.go:60 python3-dev is already the newest version (3.8.2-0ubuntu2). 2025-04-18 07:46:59 DEBUG unit.etcd/0.install logger.go:60 python3-setuptools is already the newest version (45.2.0-1ubuntu0.2). 2025-04-18 07:46:59 DEBUG unit.etcd/0.install logger.go:60 python3-yaml is already the newest version (5.3.1-1ubuntu0.1). 2025-04-18 07:46:59 DEBUG unit.etcd/0.install logger.go:60 python3-pip is already the newest version (20.0.2-5ubuntu1.11). 2025-04-18 07:46:59 DEBUG unit.etcd/0.install logger.go:60 python3-wheel is already the newest version (0.34.2-1ubuntu0.1). 2025-04-18 07:46:59 DEBUG unit.etcd/0.install logger.go:60 build-essential is already the newest version (12.8ubuntu1.1). 2025-04-18 07:46:59 DEBUG unit.etcd/0.install logger.go:60 0 upgraded, 0 newly installed, 0 to remove and 10 not upgraded. 2025-04-18 07:46:59 DEBUG unit.etcd/0.install logger.go:60 Reading package lists... 2025-04-18 07:46:59 DEBUG unit.etcd/0.install logger.go:60 Building dependency tree... 2025-04-18 07:46:59 DEBUG unit.etcd/0.install logger.go:60 Reading state information... 2025-04-18 07:47:00 DEBUG unit.etcd/0.install logger.go:60 rsync is already the newest version (3.1.3-8ubuntu0.9). 2025-04-18 07:47:00 DEBUG unit.etcd/0.install logger.go:60 rsync set to manually installed. 2025-04-18 07:47:00 DEBUG unit.etcd/0.install logger.go:60 0 upgraded, 0 newly installed, 0 to remove and 10 not upgraded. 2025-04-18 07:47:00 DEBUG unit.etcd/0.install logger.go:60 Reading package lists... 2025-04-18 07:47:00 DEBUG unit.etcd/0.install logger.go:60 Building dependency tree... 2025-04-18 07:47:00 DEBUG unit.etcd/0.install logger.go:60 Reading state information... 2025-04-18 07:47:00 DEBUG unit.etcd/0.install logger.go:60 virtualenv is already the newest version (20.0.17-1ubuntu0.4). 2025-04-18 07:47:00 DEBUG unit.etcd/0.install logger.go:60 0 upgraded, 0 newly installed, 0 to remove and 10 not upgraded. 2025-04-18 07:47:00 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for etcd/0 : {7 {map[easyrsa/0:{0}] map[] []}} 2025-04-18 07:47:00 DEBUG unit.etcd/0.install logger.go:60 created virtual environment CPython3.8.10.final.0-64 in 119ms 2025-04-18 07:47:00 DEBUG unit.etcd/0.install logger.go:60 creator CPython3Posix(dest=/var/lib/juju/agents/unit-etcd-0/.venv, clear=False, global=False) 2025-04-18 07:47:00 DEBUG unit.etcd/0.install logger.go:60 seeder FromAppData(download=False, pip=latest, setuptools=latest, wheel=latest, pkg_resources=latest, via=copy, app_data_dir=/root/.local/share/virtualenv/seed-app-data/v1.0.1.debian.1) 2025-04-18 07:47:00 DEBUG unit.etcd/0.install logger.go:60 activators BashActivator,CShellActivator,FishActivator,PowerShellActivator,PythonActivator,XonshActivator 2025-04-18 07:47:02 DEBUG unit.etcd/0.install logger.go:60 Looking in links: wheelhouse 2025-04-18 07:47:02 DEBUG unit.etcd/0.install logger.go:60 Requirement already up-to-date: pip in /var/lib/juju/agents/unit-etcd-0/.venv/lib/python3.8/site-packages (20.0.2) 2025-04-18 07:47:03 DEBUG unit.etcd/0.install logger.go:60 Looking in links: wheelhouse 2025-04-18 07:47:03 DEBUG unit.etcd/0.install logger.go:60 Requirement already up-to-date: setuptools in /var/lib/juju/agents/unit-etcd-0/.venv/lib/python3.8/site-packages (44.0.0) 2025-04-18 07:47:05 DEBUG unit.etcd/0.install logger.go:60 Looking in links: wheelhouse 2025-04-18 07:47:05 DEBUG unit.etcd/0.install logger.go:60 Processing ./wheelhouse/setuptools_scm-1.17.0.tar.gz 2025-04-18 07:47:05 DEBUG unit.etcd/0.install logger.go:60 Building wheels for collected packages: setuptools-scm 2025-04-18 07:47:05 DEBUG unit.etcd/0.install logger.go:60 Building wheel for setuptools-scm (setup.py): started 2025-04-18 07:47:05 DEBUG unit.etcd/0.install logger.go:60 Building wheel for setuptools-scm (setup.py): finished with status 'done' 2025-04-18 07:47:05 DEBUG unit.etcd/0.install logger.go:60 Created wheel for setuptools-scm: filename=setuptools_scm-1.17.0-py2.py3-none-any.whl size=17696 sha256=20d1466852c189bae65bba3a615407dd695d2cdf407c03c1e7fe6aabd2f3a7bd 2025-04-18 07:47:05 DEBUG unit.etcd/0.install logger.go:60 Stored in directory: /root/.cache/pip/wheels/92/a8/73/8e32ec012bf8ff3e2eb554c25cdd28255afd956b18a4801e6c 2025-04-18 07:47:05 DEBUG unit.etcd/0.install logger.go:60 Successfully built setuptools-scm 2025-04-18 07:47:05 DEBUG unit.etcd/0.install logger.go:60 Installing collected packages: setuptools-scm 2025-04-18 07:47:05 DEBUG unit.etcd/0.install logger.go:60 Successfully installed setuptools-scm-1.17.0 2025-04-18 07:47:06 DEBUG unit.etcd/0.install logger.go:60 Looking in links: wheelhouse 2025-04-18 07:47:06 DEBUG unit.etcd/0.install logger.go:60 Processing ./wheelhouse/MarkupSafe-2.0.1.tar.gz 2025-04-18 07:47:06 DEBUG unit.etcd/0.install logger.go:60 Processing ./wheelhouse/wheel-0.33.6.tar.gz 2025-04-18 07:47:07 DEBUG unit.etcd/0.install logger.go:60 Building wheels for collected packages: MarkupSafe, wheel 2025-04-18 07:47:07 DEBUG unit.etcd/0.install logger.go:60 Building wheel for MarkupSafe (setup.py): started 2025-04-18 07:47:07 DEBUG unit.etcd/0.install logger.go:60 Building wheel for MarkupSafe (setup.py): finished with status 'done' 2025-04-18 07:47:07 DEBUG unit.etcd/0.install logger.go:60 Created wheel for MarkupSafe: filename=MarkupSafe-2.0.1-cp38-cp38-linux_x86_64.whl size=30798 sha256=cd2c2a52f49ee27a90eefdc520a87b0ff338d57625f01f4e3ca866405e268177 2025-04-18 07:47:07 DEBUG unit.etcd/0.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-ja0nkfkf/wheels/0b/b1/46/ec0a0db6eccb32c999da96595a16d47da238fc6528a817d2eb 2025-04-18 07:47:07 DEBUG unit.etcd/0.install logger.go:60 Building wheel for wheel (setup.py): started 2025-04-18 07:47:07 DEBUG unit.etcd/0.install logger.go:60 Building wheel for wheel (setup.py): finished with status 'done' 2025-04-18 07:47:07 DEBUG unit.etcd/0.install logger.go:60 Created wheel for wheel: filename=wheel-0.33.6-py2.py3-none-any.whl size=21555 sha256=652550f8a025f0008684f385ad04d96607a955403a3b923f93dd7875f92254f6 2025-04-18 07:47:07 DEBUG unit.etcd/0.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-ja0nkfkf/wheels/6b/1f/00/bf7f8f88871a75815eed7684abb8dc4ccfaefcb58fb45ef1f2 2025-04-18 07:47:07 DEBUG unit.etcd/0.install logger.go:60 Successfully built MarkupSafe wheel 2025-04-18 07:47:07 DEBUG unit.etcd/0.install logger.go:60 Installing collected packages: MarkupSafe, wheel 2025-04-18 07:47:07 DEBUG unit.etcd/0.install logger.go:60 Attempting uninstall: wheel 2025-04-18 07:47:07 DEBUG unit.etcd/0.install logger.go:60 Found existing installation: wheel 0.34.2 2025-04-18 07:47:07 DEBUG unit.etcd/0.install logger.go:60 Uninstalling wheel-0.34.2: 2025-04-18 07:47:07 DEBUG unit.etcd/0.install logger.go:60 Successfully uninstalled wheel-0.34.2 2025-04-18 07:47:07 DEBUG unit.etcd/0.install logger.go:60 Successfully installed MarkupSafe-2.0.1 wheel-0.33.6 2025-04-18 07:47:09 DEBUG unit.etcd/0.install logger.go:60 Looking in links: wheelhouse 2025-04-18 07:47:09 DEBUG unit.etcd/0.install logger.go:60 Processing ./wheelhouse/pbr-5.9.0.tar.gz 2025-04-18 07:47:09 DEBUG unit.etcd/0.install logger.go:60 Processing ./wheelhouse/pyaml-21.10.1.tar.gz 2025-04-18 07:47:09 DEBUG unit.etcd/0.install logger.go:60 Processing ./wheelhouse/tenacity-5.0.3.tar.gz 2025-04-18 07:47:11 DEBUG unit.etcd/0.install logger.go:60 Processing ./wheelhouse/netaddr-0.7.19.tar.gz 2025-04-18 07:47:11 DEBUG unit.etcd/0.install logger.go:60 Processing ./wheelhouse/PyYAML-5.3.1.tar.gz 2025-04-18 07:47:12 DEBUG unit.etcd/0.install logger.go:60 Processing ./wheelhouse/charmhelpers-1.2.1.tar.gz 2025-04-18 07:47:13 DEBUG unit.etcd/0.install logger.go:60 Processing ./wheelhouse/Jinja2-3.0.3.tar.gz 2025-04-18 07:47:13 DEBUG unit.etcd/0.install logger.go:60 Processing ./wheelhouse/charms.reactive-1.5.0.tar.gz 2025-04-18 07:47:14 DEBUG unit.etcd/0.install logger.go:60 Processing ./wheelhouse/six-1.16.0.tar.gz 2025-04-18 07:47:14 DEBUG unit.etcd/0.install logger.go:60 Processing ./wheelhouse/MarkupSafe-2.0.1.tar.gz 2025-04-18 07:47:14 DEBUG unit.etcd/0.install logger.go:60 Building wheels for collected packages: pbr, pyaml, tenacity, netaddr, PyYAML, charmhelpers, Jinja2, charms.reactive, six, MarkupSafe 2025-04-18 07:47:14 DEBUG unit.etcd/0.install logger.go:60 Building wheel for pbr (setup.py): started 2025-04-18 07:47:14 DEBUG unit.etcd/0.install logger.go:60 Building wheel for pbr (setup.py): finished with status 'done' 2025-04-18 07:47:14 DEBUG unit.etcd/0.install logger.go:60 Created wheel for pbr: filename=pbr-5.9.0-py2.py3-none-any.whl size=112339 sha256=d10b7de04df2ff3d50ef3b3e9b3dddd027e507cfb75154387b97c8f878e109b9 2025-04-18 07:47:14 DEBUG unit.etcd/0.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-8i7ry216/wheels/51/32/f3/dbe9c7c8d0f673162d9dcbfbdf54112915eb364c65350304e7 2025-04-18 07:47:14 DEBUG unit.etcd/0.install logger.go:60 Building wheel for pyaml (setup.py): started 2025-04-18 07:47:15 DEBUG unit.etcd/0.install logger.go:60 Building wheel for pyaml (setup.py): finished with status 'done' 2025-04-18 07:47:15 DEBUG unit.etcd/0.install logger.go:60 Created wheel for pyaml: filename=pyaml-21.10.1-py2.py3-none-any.whl size=17626 sha256=196de9153189cc4dce903e26e2a042e3f1fa127364275838684a5521c5652409 2025-04-18 07:47:15 DEBUG unit.etcd/0.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-8i7ry216/wheels/d8/8c/03/7982db7959ddf7ce68887bec4fef2d3ce85877356f41ca1ef7 2025-04-18 07:47:15 DEBUG unit.etcd/0.install logger.go:60 Building wheel for tenacity (setup.py): started 2025-04-18 07:47:15 DEBUG unit.etcd/0.install logger.go:60 Building wheel for tenacity (setup.py): finished with status 'done' 2025-04-18 07:47:15 DEBUG unit.etcd/0.install logger.go:60 Created wheel for tenacity: filename=tenacity-5.0.3-py2.py3-none-any.whl size=38872 sha256=505cdc136ab18fc8544e234354ffe20b84bf98ed99129b3c7f829e77bec45682 2025-04-18 07:47:15 DEBUG unit.etcd/0.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-8i7ry216/wheels/d1/1e/cc/334f97d27a162039bf8e70e17c8773541db0665c4ec7ec5f3c 2025-04-18 07:47:15 DEBUG unit.etcd/0.install logger.go:60 Building wheel for netaddr (setup.py): started 2025-04-18 07:47:15 DEBUG unit.etcd/0.install logger.go:60 Building wheel for netaddr (setup.py): finished with status 'done' 2025-04-18 07:47:15 DEBUG unit.etcd/0.install logger.go:60 Created wheel for netaddr: filename=netaddr-0.7.19-py3-none-any.whl size=1627892 sha256=b5deb520e0efb01c14779552f826c62b8d164e6877455de7247624742c35d0d2 2025-04-18 07:47:15 DEBUG unit.etcd/0.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-8i7ry216/wheels/19/33/fe/60c729bbaaf8dd94871039905175c9055300f8cbaf24938597 2025-04-18 07:47:15 DEBUG unit.etcd/0.install logger.go:60 Building wheel for PyYAML (setup.py): started 2025-04-18 07:47:16 DEBUG unit.etcd/0.install logger.go:60 Building wheel for PyYAML (setup.py): finished with status 'done' 2025-04-18 07:47:16 DEBUG unit.etcd/0.install logger.go:60 Created wheel for PyYAML: filename=PyYAML-5.3.1-cp38-cp38-linux_x86_64.whl size=44617 sha256=f9774fea3aef1f142317e1465e717a9ff11c8e4adaf0dae2d5d90b9a517c5bdb 2025-04-18 07:47:16 DEBUG unit.etcd/0.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-8i7ry216/wheels/1d/3b/70/48e31e524076449e05c936b7f6b6894619a2882a659fe3eaef 2025-04-18 07:47:16 DEBUG unit.etcd/0.install logger.go:60 Building wheel for charmhelpers (setup.py): started 2025-04-18 07:47:16 DEBUG unit.etcd/0.install logger.go:60 Building wheel for charmhelpers (setup.py): finished with status 'done' 2025-04-18 07:47:16 DEBUG unit.etcd/0.install logger.go:60 Created wheel for charmhelpers: filename=charmhelpers-1.2.1-py3-none-any.whl size=411703 sha256=eb889728a5cd362e3a03507366d70c1e94a4be05f30d9c69632cede25a199d61 2025-04-18 07:47:16 DEBUG unit.etcd/0.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-8i7ry216/wheels/4c/e3/fd/468cfc2d250c5b4e382f8ce14f06e17e5ad23ee2d0ff8f452d 2025-04-18 07:47:16 DEBUG unit.etcd/0.install logger.go:60 Building wheel for Jinja2 (setup.py): started 2025-04-18 07:47:16 DEBUG unit.etcd/0.install logger.go:60 Building wheel for Jinja2 (setup.py): finished with status 'done' 2025-04-18 07:47:16 DEBUG unit.etcd/0.install logger.go:60 Created wheel for Jinja2: filename=Jinja2-3.0.3-py3-none-any.whl size=133612 sha256=95372aea6de28848b9f31e225c5150ab8855085d613c0915fbb6aa73610ca812 2025-04-18 07:47:16 DEBUG unit.etcd/0.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-8i7ry216/wheels/4b/e2/55/b191843253c282484d12a547d494b5453dba557ccf232dedf1 2025-04-18 07:47:16 DEBUG unit.etcd/0.install logger.go:60 Building wheel for charms.reactive (setup.py): started 2025-04-18 07:47:17 DEBUG unit.etcd/0.install logger.go:60 Building wheel for charms.reactive (setup.py): finished with status 'done' 2025-04-18 07:47:17 DEBUG unit.etcd/0.install logger.go:60 Created wheel for charms.reactive: filename=charms.reactive-1.5.0-py3-none-any.whl size=48097 sha256=c22fa728ed20d31a338221dac96476df1d081d16ed2f02bba146e91689aca26a 2025-04-18 07:47:17 DEBUG unit.etcd/0.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-8i7ry216/wheels/0a/0c/06/f39d74acc8692f6c2ff29a7f24435edb04297d2a35dc2254bb 2025-04-18 07:47:17 DEBUG unit.etcd/0.install logger.go:60 Building wheel for six (setup.py): started 2025-04-18 07:47:17 DEBUG unit.etcd/0.install logger.go:60 Building wheel for six (setup.py): finished with status 'done' 2025-04-18 07:47:17 DEBUG unit.etcd/0.install logger.go:60 Created wheel for six: filename=six-1.16.0-py2.py3-none-any.whl size=11053 sha256=8e79d1442ee2346ae29854e775c1801619957edc890f19fb62de35be91281b00 2025-04-18 07:47:17 DEBUG unit.etcd/0.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-8i7ry216/wheels/76/e4/ad/673d64ce4f9a0589804db4a11fe54debed1e75f32b2e49bdfe 2025-04-18 07:47:17 DEBUG unit.etcd/0.install logger.go:60 Building wheel for MarkupSafe (setup.py): started 2025-04-18 07:47:17 DEBUG unit.etcd/0.install logger.go:60 Building wheel for MarkupSafe (setup.py): finished with status 'done' 2025-04-18 07:47:17 DEBUG unit.etcd/0.install logger.go:60 Created wheel for MarkupSafe: filename=MarkupSafe-2.0.1-cp38-cp38-linux_x86_64.whl size=30800 sha256=6fa222d813a724a2e566304be9c0264d510f0e633c748fdae8e1c045210532f4 2025-04-18 07:47:17 DEBUG unit.etcd/0.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-8i7ry216/wheels/0b/b1/46/ec0a0db6eccb32c999da96595a16d47da238fc6528a817d2eb 2025-04-18 07:47:17 DEBUG unit.etcd/0.install logger.go:60 Successfully built pbr pyaml tenacity netaddr PyYAML charmhelpers Jinja2 charms.reactive six MarkupSafe 2025-04-18 07:47:17 DEBUG unit.etcd/0.install logger.go:60 Installing collected packages: pbr, PyYAML, pyaml, six, tenacity, netaddr, MarkupSafe, Jinja2, charmhelpers, charms.reactive 2025-04-18 07:47:18 DEBUG unit.etcd/0.install logger.go:60 Attempting uninstall: MarkupSafe 2025-04-18 07:47:18 DEBUG unit.etcd/0.install logger.go:60 Found existing installation: MarkupSafe 2.0.1 2025-04-18 07:47:18 DEBUG unit.etcd/0.install logger.go:60 Uninstalling MarkupSafe-2.0.1: 2025-04-18 07:47:18 DEBUG unit.etcd/0.install logger.go:60 Successfully uninstalled MarkupSafe-2.0.1 2025-04-18 07:47:18 DEBUG unit.etcd/0.install logger.go:60 Successfully installed Jinja2-3.0.3 MarkupSafe-2.0.1 PyYAML-5.3.1 charmhelpers-1.2.1 charms.reactive-1.5.0 netaddr-0.7.19 pbr-5.9.0 pyaml-21.10.1 six-1.16.0 tenacity-5.0.3 2025-04-18 07:47:18 INFO unit.etcd/0.juju-log server.go:316 Reactive main running for hook install 2025-04-18 07:47:18 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag endpoint.grafana.all_responses 2025-04-18 07:47:19 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag endpoint.prometheus.all_responses 2025-04-18 07:47:19 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.changed 2025-04-18 07:47:19 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.changed.nagios_context 2025-04-18 07:47:19 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.nagios_context 2025-04-18 07:47:19 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.nagios_context 2025-04-18 07:47:19 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.changed.nagios_servicegroups 2025-04-18 07:47:19 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2025-04-18 07:47:19 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.changed.snapd_refresh 2025-04-18 07:47:19 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.snapd_refresh 2025-04-18 07:47:19 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.snapd_refresh 2025-04-18 07:47:19 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.changed.port 2025-04-18 07:47:19 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.port 2025-04-18 07:47:19 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.port 2025-04-18 07:47:19 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.changed.management_port 2025-04-18 07:47:19 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.management_port 2025-04-18 07:47:19 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.management_port 2025-04-18 07:47:19 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.changed.channel 2025-04-18 07:47:19 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.channel 2025-04-18 07:47:19 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.changed.bind_to_all_interfaces 2025-04-18 07:47:19 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.bind_to_all_interfaces 2025-04-18 07:47:19 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.bind_to_all_interfaces 2025-04-18 07:47:19 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.changed.tls_cipher_suites 2025-04-18 07:47:19 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.tls_cipher_suites 2025-04-18 07:47:19 INFO unit.etcd/0.juju-log server.go:316 Initializing Leadership Layer (is leader) 2025-04-18 07:47:19 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag leadership.is_leader 2025-04-18 07:47:19 INFO unit.etcd/0.juju-log server.go:316 Initializing Snap Layer 2025-04-18 07:47:19 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: starting handler dispatch, 25 flags set tracer: set flag config.changed tracer: set flag config.changed.bind_to_all_interfaces tracer: set flag config.changed.channel tracer: set flag config.changed.management_port tracer: set flag config.changed.nagios_context tracer: set flag config.changed.nagios_servicegroups tracer: set flag config.changed.port tracer: set flag config.changed.snapd_refresh tracer: set flag config.changed.tls_cipher_suites tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.default.tls_cipher_suites tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag endpoint.grafana.all_responses tracer: set flag endpoint.prometheus.all_responses tracer: set flag leadership.is_leader 2025-04-18 07:47:19 DEBUG unit.etcd/0.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2025-04-18 07:47:19 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: main dispatch loop, 6 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/cdk_service_kicker.py:13:install_cdk_service_kicker tracer: ++ queue handler reactive/etcd.py:152:missing_relation_notice tracer: ++ queue handler reactive/etcd.py:367:channel_changed tracer: ++ queue handler reactive/etcd.py:373:snap_install tracer: ++ queue handler reactive/etcd.py:819:force_update_nrpe_config 2025-04-18 07:47:19 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/cdk_service_kicker.py:13:install_cdk_service_kicker 2025-04-18 07:47:19 DEBUG unit.etcd/0.juju-log server.go:316 Writing file /usr/bin/cdk-service-kicker root:root 444 2025-04-18 07:47:19 DEBUG unit.etcd/0.juju-log server.go:316 Writing file /etc/systemd/system/cdk-service-kicker.service root:root 444 2025-04-18 07:47:19 WARNING unit.etcd/0.install logger.go:60 Created symlink /etc/systemd/system/multi-user.target.wants/cdk-service-kicker.service → /etc/systemd/system/cdk-service-kicker.service. 2025-04-18 07:47:19 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: set flag cdk-service-kicker.installed tracer: -- dequeue handler reactive/cdk_service_kicker.py:13:install_cdk_service_kicker 2025-04-18 07:47:19 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:152:missing_relation_notice 2025-04-18 07:47:19 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:367:channel_changed 2025-04-18 07:47:19 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: set flag etcd.rerender-config tracer: ++ queue handler reactive/etcd.py:270:rerender_config 2025-04-18 07:47:19 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:373:snap_install 2025-04-18 07:47:20 INFO unit.etcd/0.juju-log server.go:316 Installing core from store 2025-04-18 07:47:25 DEBUG unit.etcd/0.juju-log server.go:316 Installation successful cmd="['snap', 'install', '--channel=stable', 'core']" output="b'core 16-2.61.4-20240607 from Canonical** installed\n'" 2025-04-18 07:47:25 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: set flag snap.installed.core tracer: ++ queue handler reactive/snap.py:321:change_snapd_refresh 2025-04-18 07:47:26 INFO unit.etcd/0.juju-log server.go:316 Installing etcd from store 2025-04-18 07:47:37 DEBUG unit.etcd/0.juju-log server.go:316 Installation successful cmd="['snap', 'install', '--channel=3.4/stable', 'etcd']" output="b'etcd (3.4/stable) 3.4.36 from Canonical** installed\n'" 2025-04-18 07:47:37 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: set flag snap.installed.etcd tracer: ++ queue handler reactive/etcd.py:143:set_app_version tracer: ++ queue handler reactive/etcd.py:208:leader_config_changed tracer: ++ queue handler reactive/etcd.py:256:bind_to_all_interfaces_changed tracer: ++ queue handler reactive/etcd.py:263:tls_cipher_suites_changed tracer: ++ queue handler reactive/etcd.py:402:add_systemd_restart_always tracer: ++ queue handler reactive/etcd.py:608:render_default_user_ssl_exports 2025-04-18 07:47:37 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:819:force_update_nrpe_config 2025-04-18 07:47:37 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2025-04-18 07:47:37 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:143:set_app_version 2025-04-18 07:47:37 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:208:leader_config_changed 2025-04-18 07:47:37 INFO unit.etcd/0.juju-log server.go:316 Previous port: None 2025-04-18 07:47:37 INFO unit.etcd/0.juju-log server.go:316 Previous management port: None 2025-04-18 07:47:37 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:256:bind_to_all_interfaces_changed 2025-04-18 07:47:37 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:263:tls_cipher_suites_changed 2025-04-18 07:47:37 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:270:rerender_config 2025-04-18 07:47:38 INFO unit.etcd/0.juju-log server.go:316 Rendering config file for etcd0 2025-04-18 07:47:38 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for etcd/0: ok=true 2025-04-18 07:47:38 DEBUG unit.etcd/0.juju-log server.go:316 Writing file /var/snap/etcd/common/etcd.conf.yml root:root 444 2025-04-18 07:47:38 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: cleared flag etcd.rerender-config tracer: -- dequeue handler reactive/etcd.py:270:rerender_config 2025-04-18 07:47:38 DEBUG unit.etcd/0.install logger.go:60 inactive 2025-04-18 07:47:38 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:402:add_systemd_restart_always 2025-04-18 07:47:38 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: set flag etcd.service-restart.configured tracer: -- dequeue handler reactive/etcd.py:402:add_systemd_restart_always 2025-04-18 07:47:38 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:608:render_default_user_ssl_exports 2025-04-18 07:47:38 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: set flag etcd.ssl.exported tracer: -- dequeue handler reactive/etcd.py:608:render_default_user_ssl_exports 2025-04-18 07:47:38 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/snap.py:321:change_snapd_refresh 2025-04-18 07:47:38 INFO unit.etcd/0.juju-log server.go:316 Set config refresh.timer=thu3 for snap core 2025-04-18 07:47:42 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag snap.refresh.was-set 2025-04-18 07:47:42 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: set flag snap.refresh.set tracer: ++ queue handler reactive/etcd.py:521:process_snapd_timer tracer: -- dequeue handler reactive/snap.py:321:change_snapd_refresh 2025-04-18 07:47:42 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:521:process_snapd_timer 2025-04-18 07:47:42 INFO unit.etcd/0.juju-log server.go:316 Get config refresh.timer for snap core 2025-04-18 07:47:42 INFO unit.etcd/0.juju-log server.go:316 setting snapd_refresh timer to: thu3 2025-04-18 07:47:42 INFO unit.etcd/0.juju-log server.go:316 status-set: blocked: Missing relation to certificate authority. 2025-04-18 07:47:42 INFO juju.worker.uniter.operation runhook.go:159 ran "install" hook (via explicit, bespoke hook script) 2025-04-18 07:47:42 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run install hook" for etcd/0 2025-04-18 07:47:42 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2025-04-18 07:47:42 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/0 uniter (run install hook) 2025-04-18 07:47:42 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/0 2025-04-18 07:47:42 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "etcd/0" (leader=true) entered scope for relation "etcd:cluster" 2025-04-18 07:47:42 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "etcd/0" (leader=true) entered scope for relation "kubernetes-control-plane:etcd etcd:db" 2025-04-18 07:47:42 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "etcd/0" (leader=true) entered scope for relation "etcd:certificates easyrsa:client" 2025-04-18 07:47:42 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-created (0; app: etcd) hook for etcd/0 2025-04-18 07:47:42 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/0 uniter (run relation-created (0; app: etcd) hook) 2025-04-18 07:47:43 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for etcd/0: ok=true 2025-04-18 07:50:24 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/0 uniter (run relation-created (0; app: etcd) hook) 2025-04-18 07:50:24 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-created (0; app: etcd) hook" for etcd/0 2025-04-18 07:50:24 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-created (0; app: etcd) hook" for etcd/0 2025-04-18 07:50:24 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running cluster-relation-created hook 2025-04-18 07:50:24 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-0/agent.socket } 2025-04-18 07:50:24 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for etcd/0 : {8 {map[kubernetes-control-plane/0:{0}] map[] []}} 2025-04-18 07:50:25 INFO unit.etcd/0.juju-log server.go:316 cluster:0: Reactive main running for hook cluster-relation-created 2025-04-18 07:50:25 DEBUG unit.etcd/0.juju-log server.go:316 cluster:0: tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/etcd.py:143:set_app_version tracer: ++ queue handler reactive/etcd.py:152:missing_relation_notice tracer: ++ queue handler reactive/etcd.py:521:process_snapd_timer 2025-04-18 07:50:25 DEBUG unit.etcd/0.juju-log server.go:316 cluster:0: tracer: set flag config.default.nagios_context 2025-04-18 07:50:25 DEBUG unit.etcd/0.juju-log server.go:316 cluster:0: tracer: set flag config.default.nagios_servicegroups 2025-04-18 07:50:25 DEBUG unit.etcd/0.juju-log server.go:316 cluster:0: tracer: set flag config.set.snapd_refresh 2025-04-18 07:50:25 DEBUG unit.etcd/0.juju-log server.go:316 cluster:0: tracer: set flag config.default.snapd_refresh 2025-04-18 07:50:25 DEBUG unit.etcd/0.juju-log server.go:316 cluster:0: tracer: set flag config.set.port 2025-04-18 07:50:25 DEBUG unit.etcd/0.juju-log server.go:316 cluster:0: tracer: set flag config.default.port 2025-04-18 07:50:25 DEBUG unit.etcd/0.juju-log server.go:316 cluster:0: tracer: set flag config.set.management_port 2025-04-18 07:50:25 DEBUG unit.etcd/0.juju-log server.go:316 cluster:0: tracer: set flag config.default.management_port 2025-04-18 07:50:25 DEBUG unit.etcd/0.juju-log server.go:316 cluster:0: tracer: set flag config.set.channel 2025-04-18 07:50:25 DEBUG unit.etcd/0.juju-log server.go:316 cluster:0: tracer: set flag config.set.bind_to_all_interfaces 2025-04-18 07:50:25 DEBUG unit.etcd/0.juju-log server.go:316 cluster:0: tracer: set flag config.default.bind_to_all_interfaces 2025-04-18 07:50:25 DEBUG unit.etcd/0.juju-log server.go:316 cluster:0: tracer: set flag config.default.tls_cipher_suites 2025-04-18 07:50:25 INFO unit.etcd/0.juju-log server.go:316 cluster:0: Initializing Leadership Layer (is leader) 2025-04-18 07:50:25 DEBUG unit.etcd/0.juju-log server.go:316 cluster:0: tracer: set flag leadership.changed.snapd_refresh 2025-04-18 07:50:25 DEBUG unit.etcd/0.juju-log server.go:316 cluster:0: tracer: set flag leadership.set.snapd_refresh 2025-04-18 07:50:25 DEBUG unit.etcd/0.juju-log server.go:316 cluster:0: tracer: set flag leadership.changed.token 2025-04-18 07:50:25 DEBUG unit.etcd/0.juju-log server.go:316 cluster:0: tracer: set flag leadership.set.token 2025-04-18 07:50:25 DEBUG unit.etcd/0.juju-log server.go:316 cluster:0: tracer: set flag leadership.changed 2025-04-18 07:50:25 INFO unit.etcd/0.juju-log server.go:316 cluster:0: Initializing Snap Layer 2025-04-18 07:50:25 DEBUG unit.etcd/0.juju-log server.go:316 cluster:0: tracer> tracer: starting handler dispatch, 28 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.default.tls_cipher_suites tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag endpoint.grafana.all_responses tracer: set flag endpoint.prometheus.all_responses tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag leadership.changed tracer: set flag leadership.changed.snapd_refresh tracer: set flag leadership.changed.token tracer: set flag leadership.is_leader tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set 2025-04-18 07:50:25 DEBUG unit.etcd/0.juju-log server.go:316 cluster:0: tracer: hooks phase, 0 handlers queued 2025-04-18 07:50:25 DEBUG unit.etcd/0.juju-log server.go:316 cluster:0: tracer> tracer: main dispatch loop, 4 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/etcd.py:143:set_app_version tracer: ++ queue handler reactive/etcd.py:152:missing_relation_notice tracer: ++ queue handler reactive/etcd.py:521:process_snapd_timer 2025-04-18 07:50:25 INFO unit.etcd/0.juju-log server.go:316 cluster:0: Invoking reactive handler: reactive/etcd.py:143:set_app_version 2025-04-18 07:50:25 INFO unit.etcd/0.juju-log server.go:316 cluster:0: Invoking reactive handler: reactive/etcd.py:152:missing_relation_notice 2025-04-18 07:50:25 INFO unit.etcd/0.juju-log server.go:316 cluster:0: Invoking reactive handler: reactive/etcd.py:521:process_snapd_timer 2025-04-18 07:50:25 INFO unit.etcd/0.juju-log server.go:316 cluster:0: Get config refresh.timer for snap core 2025-04-18 07:50:25 INFO unit.etcd/0.juju-log server.go:316 cluster:0: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2025-04-18 07:50:25 INFO unit.etcd/0.juju-log server.go:316 cluster:0: status-set: blocked: Missing relation to certificate authority. 2025-04-18 07:50:25 INFO juju.worker.uniter.operation runhook.go:159 ran "cluster-relation-created" hook (via explicit, bespoke hook script) 2025-04-18 07:50:25 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-created (0; app: etcd) hook" for etcd/0 2025-04-18 07:50:26 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2025-04-18 07:50:26 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/0 uniter (run relation-created (0; app: etcd) hook) 2025-04-18 07:50:26 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/0 2025-04-18 07:50:26 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-created (7; app: easyrsa) hook for etcd/0 2025-04-18 07:50:26 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/0 uniter (run relation-created (7; app: easyrsa) hook) 2025-04-18 07:51:41 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/0 uniter (run relation-created (7; app: easyrsa) hook) 2025-04-18 07:51:41 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-created (7; app: easyrsa) hook" for etcd/0 2025-04-18 07:51:41 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-created (7; app: easyrsa) hook" for etcd/0 2025-04-18 07:51:41 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running certificates-relation-created hook 2025-04-18 07:51:41 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-0/agent.socket } 2025-04-18 07:51:41 INFO unit.etcd/0.juju-log server.go:316 certificates:7: Reactive main running for hook certificates-relation-created 2025-04-18 07:51:41 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/etcd.py:143:set_app_version tracer: ++ queue handler reactive/etcd.py:152:missing_relation_notice tracer: ++ queue handler reactive/etcd.py:521:process_snapd_timer 2025-04-18 07:51:41 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer: set flag config.default.nagios_context 2025-04-18 07:51:41 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer: set flag config.default.nagios_servicegroups 2025-04-18 07:51:41 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer: set flag config.set.snapd_refresh 2025-04-18 07:51:41 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer: set flag config.default.snapd_refresh 2025-04-18 07:51:41 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer: set flag config.set.port 2025-04-18 07:51:41 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer: set flag config.default.port 2025-04-18 07:51:41 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer: set flag config.set.management_port 2025-04-18 07:51:41 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer: set flag config.default.management_port 2025-04-18 07:51:41 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer: set flag config.set.channel 2025-04-18 07:51:41 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer: set flag config.set.bind_to_all_interfaces 2025-04-18 07:51:41 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer: set flag config.default.bind_to_all_interfaces 2025-04-18 07:51:41 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer: set flag config.default.tls_cipher_suites 2025-04-18 07:51:41 INFO unit.etcd/0.juju-log server.go:316 certificates:7: Initializing Leadership Layer (is leader) 2025-04-18 07:51:41 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer: cleared flag leadership.changed.snapd_refresh 2025-04-18 07:51:41 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer: cleared flag leadership.changed.token 2025-04-18 07:51:41 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer: cleared flag leadership.changed 2025-04-18 07:51:41 INFO unit.etcd/0.juju-log server.go:316 certificates:7: Initializing Snap Layer 2025-04-18 07:51:41 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer> tracer: starting handler dispatch, 25 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.default.tls_cipher_suites tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag endpoint.grafana.all_responses tracer: set flag endpoint.prometheus.all_responses tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag leadership.is_leader tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set 2025-04-18 07:51:41 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer: hooks phase, 0 handlers queued 2025-04-18 07:51:41 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer> tracer: main dispatch loop, 4 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/etcd.py:143:set_app_version tracer: ++ queue handler reactive/etcd.py:152:missing_relation_notice tracer: ++ queue handler reactive/etcd.py:521:process_snapd_timer 2025-04-18 07:51:41 INFO unit.etcd/0.juju-log server.go:316 certificates:7: Invoking reactive handler: reactive/etcd.py:143:set_app_version 2025-04-18 07:51:41 INFO unit.etcd/0.juju-log server.go:316 certificates:7: Invoking reactive handler: reactive/etcd.py:152:missing_relation_notice 2025-04-18 07:51:41 INFO unit.etcd/0.juju-log server.go:316 certificates:7: Invoking reactive handler: reactive/etcd.py:521:process_snapd_timer 2025-04-18 07:51:41 INFO unit.etcd/0.juju-log server.go:316 certificates:7: Get config refresh.timer for snap core 2025-04-18 07:51:41 INFO unit.etcd/0.juju-log server.go:316 certificates:7: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2025-04-18 07:51:41 INFO unit.etcd/0.juju-log server.go:316 certificates:7: status-set: blocked: Missing relation to certificate authority. 2025-04-18 07:51:42 INFO juju.worker.uniter.operation runhook.go:159 ran "certificates-relation-created" hook (via explicit, bespoke hook script) 2025-04-18 07:51:42 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-created (7; app: easyrsa) hook" for etcd/0 2025-04-18 07:51:42 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2025-04-18 07:51:42 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/0 uniter (run relation-created (7; app: easyrsa) hook) 2025-04-18 07:51:42 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/0 2025-04-18 07:51:42 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-created (8; app: kubernetes-control-plane) hook for etcd/0 2025-04-18 07:51:42 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/0 uniter (run relation-created (8; app: kubernetes-control-plane) hook) 2025-04-18 07:51:52 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/0 uniter (run relation-created (8; app: kubernetes-control-plane) hook) 2025-04-18 07:51:52 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-created (8; app: kubernetes-control-plane) hook" for etcd/0 2025-04-18 07:51:52 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-created (8; app: kubernetes-control-plane) hook" for etcd/0 2025-04-18 07:51:52 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running db-relation-created hook 2025-04-18 07:51:52 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-0/agent.socket } 2025-04-18 07:51:52 INFO unit.etcd/0.juju-log server.go:316 db:8: Reactive main running for hook db-relation-created 2025-04-18 07:51:52 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/etcd.py:143:set_app_version tracer: ++ queue handler reactive/etcd.py:152:missing_relation_notice tracer: ++ queue handler reactive/etcd.py:521:process_snapd_timer 2025-04-18 07:51:52 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer: set flag config.default.nagios_context 2025-04-18 07:51:52 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer: set flag config.default.nagios_servicegroups 2025-04-18 07:51:52 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer: set flag config.set.snapd_refresh 2025-04-18 07:51:52 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer: set flag config.default.snapd_refresh 2025-04-18 07:51:52 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer: set flag config.set.port 2025-04-18 07:51:52 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer: set flag config.default.port 2025-04-18 07:51:52 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer: set flag config.set.management_port 2025-04-18 07:51:52 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer: set flag config.default.management_port 2025-04-18 07:51:52 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer: set flag config.set.channel 2025-04-18 07:51:52 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer: set flag config.set.bind_to_all_interfaces 2025-04-18 07:51:52 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer: set flag config.default.bind_to_all_interfaces 2025-04-18 07:51:52 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer: set flag config.default.tls_cipher_suites 2025-04-18 07:51:52 INFO unit.etcd/0.juju-log server.go:316 db:8: Initializing Leadership Layer (is leader) 2025-04-18 07:51:52 INFO unit.etcd/0.juju-log server.go:316 db:8: Initializing Snap Layer 2025-04-18 07:51:52 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer> tracer: starting handler dispatch, 25 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.default.tls_cipher_suites tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag endpoint.grafana.all_responses tracer: set flag endpoint.prometheus.all_responses tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag leadership.is_leader tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set 2025-04-18 07:51:52 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer: hooks phase, 0 handlers queued 2025-04-18 07:51:52 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer> tracer: main dispatch loop, 4 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/etcd.py:143:set_app_version tracer: ++ queue handler reactive/etcd.py:152:missing_relation_notice tracer: ++ queue handler reactive/etcd.py:521:process_snapd_timer 2025-04-18 07:51:52 INFO unit.etcd/0.juju-log server.go:316 db:8: Invoking reactive handler: reactive/etcd.py:143:set_app_version 2025-04-18 07:51:52 INFO unit.etcd/0.juju-log server.go:316 db:8: Invoking reactive handler: reactive/etcd.py:152:missing_relation_notice 2025-04-18 07:51:52 INFO unit.etcd/0.juju-log server.go:316 db:8: Invoking reactive handler: reactive/etcd.py:521:process_snapd_timer 2025-04-18 07:51:52 INFO unit.etcd/0.juju-log server.go:316 db:8: Get config refresh.timer for snap core 2025-04-18 07:51:52 INFO unit.etcd/0.juju-log server.go:316 db:8: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2025-04-18 07:51:52 INFO unit.etcd/0.juju-log server.go:316 db:8: status-set: blocked: Missing relation to certificate authority. 2025-04-18 07:51:53 INFO juju.worker.uniter.operation runhook.go:159 ran "db-relation-created" hook (via explicit, bespoke hook script) 2025-04-18 07:51:53 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-created (8; app: kubernetes-control-plane) hook" for etcd/0 2025-04-18 07:51:53 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2025-04-18 07:51:53 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/0 uniter (run relation-created (8; app: kubernetes-control-plane) hook) 2025-04-18 07:51:53 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/0 2025-04-18 07:51:53 DEBUG juju.worker.uniter.operation executor.go:85 running operation accept leadership for etcd/0 2025-04-18 07:51:53 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "accept leadership" for etcd/0 2025-04-18 07:51:53 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "accept leadership" for etcd/0 2025-04-18 07:51:53 INFO juju.worker.uniter resolver.go:159 found queued "leader-elected" hook 2025-04-18 07:51:53 DEBUG juju.worker.uniter.operation executor.go:85 running operation run leader-elected hook for etcd/0 2025-04-18 07:51:53 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/0 uniter (run leader-elected hook) 2025-04-18 07:52:02 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/0 uniter (run leader-elected hook) 2025-04-18 07:52:02 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run leader-elected hook" for etcd/0 2025-04-18 07:52:02 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run leader-elected hook" for etcd/0 2025-04-18 07:52:02 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running leader-elected hook 2025-04-18 07:52:02 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-0/agent.socket } 2025-04-18 07:52:02 INFO unit.etcd/0.juju-log server.go:316 Reactive main running for hook leader-elected 2025-04-18 07:52:03 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/etcd.py:143:set_app_version tracer: ++ queue handler reactive/etcd.py:152:missing_relation_notice tracer: ++ queue handler reactive/etcd.py:521:process_snapd_timer 2025-04-18 07:52:03 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.nagios_context 2025-04-18 07:52:03 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2025-04-18 07:52:03 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.snapd_refresh 2025-04-18 07:52:03 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.snapd_refresh 2025-04-18 07:52:03 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.port 2025-04-18 07:52:03 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.port 2025-04-18 07:52:03 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.management_port 2025-04-18 07:52:03 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.management_port 2025-04-18 07:52:03 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.channel 2025-04-18 07:52:03 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.bind_to_all_interfaces 2025-04-18 07:52:03 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.bind_to_all_interfaces 2025-04-18 07:52:03 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.tls_cipher_suites 2025-04-18 07:52:03 INFO unit.etcd/0.juju-log server.go:316 Initializing Leadership Layer (is leader) 2025-04-18 07:52:03 INFO unit.etcd/0.juju-log server.go:316 Initializing Snap Layer 2025-04-18 07:52:03 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: starting handler dispatch, 25 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.default.tls_cipher_suites tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag endpoint.grafana.all_responses tracer: set flag endpoint.prometheus.all_responses tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag leadership.is_leader tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set 2025-04-18 07:52:03 DEBUG unit.etcd/0.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2025-04-18 07:52:03 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: main dispatch loop, 4 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/etcd.py:143:set_app_version tracer: ++ queue handler reactive/etcd.py:152:missing_relation_notice tracer: ++ queue handler reactive/etcd.py:521:process_snapd_timer 2025-04-18 07:52:03 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:143:set_app_version 2025-04-18 07:52:03 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:152:missing_relation_notice 2025-04-18 07:52:03 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:521:process_snapd_timer 2025-04-18 07:52:03 INFO unit.etcd/0.juju-log server.go:316 Get config refresh.timer for snap core 2025-04-18 07:52:03 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2025-04-18 07:52:03 INFO unit.etcd/0.juju-log server.go:316 status-set: blocked: Missing relation to certificate authority. 2025-04-18 07:52:03 INFO juju.worker.uniter.operation runhook.go:159 ran "leader-elected" hook (via explicit, bespoke hook script) 2025-04-18 07:52:03 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run leader-elected hook" for etcd/0 2025-04-18 07:52:03 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2025-04-18 07:52:03 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/0 uniter (run leader-elected hook) 2025-04-18 07:52:03 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/0 2025-04-18 07:52:03 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2025-04-18 07:52:03 DEBUG juju.worker.uniter.operation executor.go:85 running operation run config-changed hook for etcd/0 2025-04-18 07:52:03 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/0 uniter (run config-changed hook) 2025-04-18 07:52:03 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for etcd/0 2025-04-18 07:52:11 DEBUG juju.worker.meterstatus connected.go:93 got meter status change signal from watcher 2025-04-18 07:52:13 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/0 uniter (run config-changed hook) 2025-04-18 07:52:13 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run config-changed hook" for etcd/0 2025-04-18 07:52:13 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run config-changed hook" for etcd/0 2025-04-18 07:52:13 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running config-changed hook 2025-04-18 07:52:13 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-0/agent.socket } 2025-04-18 07:52:13 INFO unit.etcd/0.juju-log server.go:316 Reactive main running for hook config-changed 2025-04-18 07:52:14 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/etcd.py:143:set_app_version tracer: ++ queue handler reactive/etcd.py:152:missing_relation_notice tracer: ++ queue handler reactive/etcd.py:521:process_snapd_timer 2025-04-18 07:52:14 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.nagios_context 2025-04-18 07:52:14 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2025-04-18 07:52:14 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.snapd_refresh 2025-04-18 07:52:14 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.snapd_refresh 2025-04-18 07:52:14 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.port 2025-04-18 07:52:14 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.port 2025-04-18 07:52:14 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.management_port 2025-04-18 07:52:14 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.management_port 2025-04-18 07:52:14 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.channel 2025-04-18 07:52:14 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.bind_to_all_interfaces 2025-04-18 07:52:14 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.bind_to_all_interfaces 2025-04-18 07:52:14 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.tls_cipher_suites 2025-04-18 07:52:14 INFO unit.etcd/0.juju-log server.go:316 Initializing Leadership Layer (is leader) 2025-04-18 07:52:14 INFO unit.etcd/0.juju-log server.go:316 Initializing Snap Layer 2025-04-18 07:52:14 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: starting handler dispatch, 25 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.default.tls_cipher_suites tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag endpoint.grafana.all_responses tracer: set flag endpoint.prometheus.all_responses tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag leadership.is_leader tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set 2025-04-18 07:52:14 DEBUG unit.etcd/0.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2025-04-18 07:52:14 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: main dispatch loop, 4 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/etcd.py:143:set_app_version tracer: ++ queue handler reactive/etcd.py:152:missing_relation_notice tracer: ++ queue handler reactive/etcd.py:521:process_snapd_timer 2025-04-18 07:52:14 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:143:set_app_version 2025-04-18 07:52:14 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:152:missing_relation_notice 2025-04-18 07:52:14 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:521:process_snapd_timer 2025-04-18 07:52:14 INFO unit.etcd/0.juju-log server.go:316 Get config refresh.timer for snap core 2025-04-18 07:52:14 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2025-04-18 07:52:14 INFO unit.etcd/0.juju-log server.go:316 status-set: blocked: Missing relation to certificate authority. 2025-04-18 07:52:14 INFO juju.worker.uniter.operation runhook.go:159 ran "config-changed" hook (via explicit, bespoke hook script) 2025-04-18 07:52:14 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run config-changed hook" for etcd/0 2025-04-18 07:52:14 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2025-04-18 07:52:14 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/0 uniter (run config-changed hook) 2025-04-18 07:52:14 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/0 2025-04-18 07:52:14 INFO juju.worker.uniter resolver.go:159 found queued "start" hook 2025-04-18 07:52:14 DEBUG juju.worker.uniter.operation executor.go:85 running operation run start hook for etcd/0 2025-04-18 07:52:14 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/0 uniter (run start hook) 2025-04-18 07:52:24 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/0 uniter (run start hook) 2025-04-18 07:52:24 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run start hook" for etcd/0 2025-04-18 07:52:24 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run start hook" for etcd/0 2025-04-18 07:52:24 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running start hook 2025-04-18 07:52:24 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-0/agent.socket } 2025-04-18 07:52:24 INFO unit.etcd/0.juju-log server.go:316 Reactive main running for hook start 2025-04-18 07:52:24 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/etcd.py:143:set_app_version tracer: ++ queue handler reactive/etcd.py:152:missing_relation_notice tracer: ++ queue handler reactive/etcd.py:521:process_snapd_timer 2025-04-18 07:52:24 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.nagios_context 2025-04-18 07:52:24 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2025-04-18 07:52:24 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.snapd_refresh 2025-04-18 07:52:24 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.snapd_refresh 2025-04-18 07:52:24 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.port 2025-04-18 07:52:24 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.port 2025-04-18 07:52:24 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.management_port 2025-04-18 07:52:24 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.management_port 2025-04-18 07:52:24 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.channel 2025-04-18 07:52:24 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.bind_to_all_interfaces 2025-04-18 07:52:24 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.bind_to_all_interfaces 2025-04-18 07:52:24 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.tls_cipher_suites 2025-04-18 07:52:24 INFO unit.etcd/0.juju-log server.go:316 Initializing Leadership Layer (is leader) 2025-04-18 07:52:24 INFO unit.etcd/0.juju-log server.go:316 Initializing Snap Layer 2025-04-18 07:52:24 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: starting handler dispatch, 25 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.default.tls_cipher_suites tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag endpoint.grafana.all_responses tracer: set flag endpoint.prometheus.all_responses tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag leadership.is_leader tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set 2025-04-18 07:52:24 DEBUG unit.etcd/0.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2025-04-18 07:52:24 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: main dispatch loop, 4 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/etcd.py:143:set_app_version tracer: ++ queue handler reactive/etcd.py:152:missing_relation_notice tracer: ++ queue handler reactive/etcd.py:521:process_snapd_timer 2025-04-18 07:52:24 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:143:set_app_version 2025-04-18 07:52:24 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:152:missing_relation_notice 2025-04-18 07:52:24 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:521:process_snapd_timer 2025-04-18 07:52:24 INFO unit.etcd/0.juju-log server.go:316 Get config refresh.timer for snap core 2025-04-18 07:52:24 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2025-04-18 07:52:24 INFO unit.etcd/0.juju-log server.go:316 status-set: blocked: Missing relation to certificate authority. 2025-04-18 07:52:25 INFO juju.worker.uniter.operation runhook.go:159 ran "start" hook (via explicit, bespoke hook script) 2025-04-18 07:52:25 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run start hook" for etcd/0 2025-04-18 07:52:25 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2025-04-18 07:52:25 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/0 uniter (run start hook) 2025-04-18 07:52:25 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/0 2025-04-18 07:52:25 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2025-04-18 07:52:25 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-joined (8; unit: kubernetes-control-plane/0) hook for etcd/0 2025-04-18 07:52:25 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/0 uniter (run relation-joined (8; unit: kubernetes-control-plane/0) hook) 2025-04-18 07:52:25 DEBUG juju.worker.dependency engine.go:580 "metric-collect" manifold worker started at 2025-04-18 07:52:25.294650181 +0000 UTC 2025-04-18 07:52:34 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for etcd/0 : {7 {map[easyrsa/0:{1}] map[] []}} 2025-04-18 07:52:35 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/0 uniter (run relation-joined (8; unit: kubernetes-control-plane/0) hook) 2025-04-18 07:52:35 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-joined (8; unit: kubernetes-control-plane/0) hook" for etcd/0 2025-04-18 07:52:35 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-joined (8; unit: kubernetes-control-plane/0) hook" for etcd/0 2025-04-18 07:52:35 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running db-relation-joined hook for kubernetes-control-plane/0 2025-04-18 07:52:35 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-0/agent.socket } 2025-04-18 07:52:36 INFO unit.etcd/0.juju-log server.go:316 db:8: Reactive main running for hook db-relation-joined 2025-04-18 07:52:36 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/etcd.py:143:set_app_version tracer: ++ queue handler reactive/etcd.py:152:missing_relation_notice tracer: ++ queue handler reactive/etcd.py:521:process_snapd_timer 2025-04-18 07:52:36 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer: set flag config.default.nagios_context 2025-04-18 07:52:36 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer: set flag config.default.nagios_servicegroups 2025-04-18 07:52:36 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer: set flag config.set.snapd_refresh 2025-04-18 07:52:36 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer: set flag config.default.snapd_refresh 2025-04-18 07:52:36 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer: set flag config.set.port 2025-04-18 07:52:36 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer: set flag config.default.port 2025-04-18 07:52:36 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer: set flag config.set.management_port 2025-04-18 07:52:36 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer: set flag config.default.management_port 2025-04-18 07:52:36 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer: set flag config.set.channel 2025-04-18 07:52:36 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer: set flag config.set.bind_to_all_interfaces 2025-04-18 07:52:36 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer: set flag config.default.bind_to_all_interfaces 2025-04-18 07:52:36 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer: set flag config.default.tls_cipher_suites 2025-04-18 07:52:36 INFO unit.etcd/0.juju-log server.go:316 db:8: Initializing Leadership Layer (is leader) 2025-04-18 07:52:36 INFO unit.etcd/0.juju-log server.go:316 db:8: Initializing Snap Layer 2025-04-18 07:52:36 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer> tracer: starting handler dispatch, 25 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.default.tls_cipher_suites tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag endpoint.grafana.all_responses tracer: set flag endpoint.prometheus.all_responses tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag leadership.is_leader tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set 2025-04-18 07:52:36 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler hooks/relations/etcd/provides.py:22:joined_or_changed 2025-04-18 07:52:36 INFO unit.etcd/0.juju-log server.go:316 db:8: Invoking reactive handler: hooks/relations/etcd/provides.py:22:joined_or_changed 2025-04-18 07:52:36 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer: set flag db.connected 2025-04-18 07:52:36 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer> tracer: main dispatch loop, 4 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/etcd.py:143:set_app_version tracer: ++ queue handler reactive/etcd.py:152:missing_relation_notice tracer: ++ queue handler reactive/etcd.py:521:process_snapd_timer 2025-04-18 07:52:36 INFO unit.etcd/0.juju-log server.go:316 db:8: Invoking reactive handler: reactive/etcd.py:143:set_app_version 2025-04-18 07:52:36 INFO unit.etcd/0.juju-log server.go:316 db:8: Invoking reactive handler: reactive/etcd.py:152:missing_relation_notice 2025-04-18 07:52:36 INFO unit.etcd/0.juju-log server.go:316 db:8: Invoking reactive handler: reactive/etcd.py:521:process_snapd_timer 2025-04-18 07:52:36 INFO unit.etcd/0.juju-log server.go:316 db:8: Get config refresh.timer for snap core 2025-04-18 07:52:36 INFO unit.etcd/0.juju-log server.go:316 db:8: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2025-04-18 07:52:36 INFO unit.etcd/0.juju-log server.go:316 db:8: status-set: blocked: Missing relation to certificate authority. 2025-04-18 07:52:36 INFO juju.worker.uniter.operation runhook.go:159 ran "db-relation-joined" hook (via explicit, bespoke hook script) 2025-04-18 07:52:36 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-joined (8; unit: kubernetes-control-plane/0) hook" for etcd/0 2025-04-18 07:52:36 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2025-04-18 07:52:36 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/0 uniter (run relation-joined (8; unit: kubernetes-control-plane/0) hook) 2025-04-18 07:52:36 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/0 2025-04-18 07:52:36 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2025-04-18 07:52:36 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-joined (7; unit: easyrsa/0) hook for etcd/0 2025-04-18 07:52:36 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/0 uniter (run relation-joined (7; unit: easyrsa/0) hook) 2025-04-18 07:52:46 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/0 uniter (run relation-joined (7; unit: easyrsa/0) hook) 2025-04-18 07:52:46 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-joined (7; unit: easyrsa/0) hook" for etcd/0 2025-04-18 07:52:46 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-joined (7; unit: easyrsa/0) hook" for etcd/0 2025-04-18 07:52:46 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running certificates-relation-joined hook for easyrsa/0 2025-04-18 07:52:46 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-0/agent.socket } 2025-04-18 07:52:46 INFO unit.etcd/0.juju-log server.go:316 certificates:7: Reactive main running for hook certificates-relation-joined 2025-04-18 07:52:46 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer> tracer: set flag endpoint.certificates.joined tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:143:set_app_version tracer: ++ queue handler reactive/etcd.py:152:missing_relation_notice tracer: ++ queue handler reactive/etcd.py:521:process_snapd_timer 2025-04-18 07:52:46 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer: set flag endpoint.certificates.changed 2025-04-18 07:52:46 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer: set flag endpoint.certificates.changed.ca 2025-04-18 07:52:46 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer: set flag endpoint.certificates.changed.client.cert 2025-04-18 07:52:46 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer: set flag endpoint.certificates.changed.client.key 2025-04-18 07:52:46 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer: set flag endpoint.certificates.changed.egress-subnets 2025-04-18 07:52:46 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer: set flag endpoint.certificates.changed.ingress-address 2025-04-18 07:52:46 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer: set flag endpoint.certificates.changed.private-address 2025-04-18 07:52:46 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer: set flag config.set.nagios_context 2025-04-18 07:52:46 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer: set flag config.default.nagios_context 2025-04-18 07:52:46 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer: set flag config.default.nagios_servicegroups 2025-04-18 07:52:46 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer: set flag config.set.snapd_refresh 2025-04-18 07:52:46 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer: set flag config.default.snapd_refresh 2025-04-18 07:52:46 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer: set flag config.set.port 2025-04-18 07:52:46 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer: set flag config.default.port 2025-04-18 07:52:46 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer: set flag config.set.management_port 2025-04-18 07:52:46 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer: set flag config.default.management_port 2025-04-18 07:52:46 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer: set flag config.set.channel 2025-04-18 07:52:46 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer: set flag config.set.bind_to_all_interfaces 2025-04-18 07:52:46 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer: set flag config.default.bind_to_all_interfaces 2025-04-18 07:52:46 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer: set flag config.default.tls_cipher_suites 2025-04-18 07:52:46 INFO unit.etcd/0.juju-log server.go:316 certificates:7: Initializing Leadership Layer (is leader) 2025-04-18 07:52:46 INFO unit.etcd/0.juju-log server.go:316 certificates:7: Initializing Snap Layer 2025-04-18 07:52:46 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer> tracer: starting handler dispatch, 34 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.default.tls_cipher_suites tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag endpoint.grafana.all_responses tracer: set flag endpoint.prometheus.all_responses tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag leadership.is_leader tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set 2025-04-18 07:52:46 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer: hooks phase, 0 handlers queued 2025-04-18 07:52:46 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer> tracer: main dispatch loop, 4 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:143:set_app_version tracer: ++ queue handler reactive/etcd.py:152:missing_relation_notice tracer: ++ queue handler reactive/etcd.py:521:process_snapd_timer 2025-04-18 07:52:46 INFO unit.etcd/0.juju-log server.go:316 certificates:7: Invoking reactive handler: reactive/etcd.py:143:set_app_version 2025-04-18 07:52:46 INFO unit.etcd/0.juju-log server.go:316 certificates:7: Invoking reactive handler: reactive/etcd.py:152:missing_relation_notice 2025-04-18 07:52:46 INFO unit.etcd/0.juju-log server.go:316 certificates:7: Invoking reactive handler: reactive/etcd.py:521:process_snapd_timer 2025-04-18 07:52:46 INFO unit.etcd/0.juju-log server.go:316 certificates:7: Get config refresh.timer for snap core 2025-04-18 07:52:47 INFO unit.etcd/0.juju-log server.go:316 certificates:7: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2025-04-18 07:52:47 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer> tracer: set flag certificates.available tracer: ++ queue handler reactive/etcd.py:157:prepare_tls_certificates tracer: -- dequeue handler reactive/etcd.py:152:missing_relation_notice 2025-04-18 07:52:47 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer> tracer: set flag certificates.ca.available tracer: ++ queue handler reactive/tls_client.py:18:store_ca 2025-04-18 07:52:47 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer: set flag certificates.ca.changed 2025-04-18 07:52:47 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer> tracer: set flag certificates.client.cert.available tracer: ++ queue handler reactive/tls_client.py:71:store_client 2025-04-18 07:52:47 INFO unit.etcd/0.juju-log server.go:316 certificates:7: Invoking reactive handler: reactive/etcd.py:157:prepare_tls_certificates 2025-04-18 07:52:47 INFO unit.etcd/0.juju-log server.go:316 certificates:7: Invoking reactive handler: reactive/tls_client.py:18:store_ca 2025-04-18 07:52:47 INFO unit.etcd/0.juju-log server.go:316 certificates:7: Writing CA certificate to /var/snap/etcd/common/ca.crt 2025-04-18 07:52:47 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer: set flag tls_client.ca.written 2025-04-18 07:52:47 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer: set flag tls_client.ca.saved 2025-04-18 07:52:47 INFO unit.etcd/0.juju-log server.go:316 certificates:7: Writing CA certificate to /usr/local/share/ca-certificates/etcd.crt 2025-04-18 07:52:47 DEBUG unit.etcd/0.certificates-relation-joined logger.go:60 Updating certificates in /etc/ssl/certs... 2025-04-18 07:52:47 WARNING unit.etcd/0.certificates-relation-joined logger.go:60 rehash: warning: skipping ca-certificates.crt,it does not contain exactly one certificate or CRL 2025-04-18 07:52:47 WARNING unit.etcd/0.certificates-relation-joined logger.go:60 rehash: warning: skipping duplicate certificate in etcd.pem 2025-04-18 07:52:47 DEBUG unit.etcd/0.certificates-relation-joined logger.go:60 1 added, 0 removed; done. 2025-04-18 07:52:47 DEBUG unit.etcd/0.certificates-relation-joined logger.go:60 Running hooks in /etc/ca-certificates/update.d... 2025-04-18 07:52:47 DEBUG unit.etcd/0.certificates-relation-joined logger.go:60 done. 2025-04-18 07:52:47 INFO unit.etcd/0.juju-log server.go:316 certificates:7: Generated ca-certificates.crt for etcd 2025-04-18 07:52:47 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer: set flag tls_client.ca_installed 2025-04-18 07:52:47 INFO unit.etcd/0.juju-log server.go:316 certificates:7: Invoking reactive handler: reactive/tls_client.py:71:store_client 2025-04-18 07:52:47 INFO unit.etcd/0.juju-log server.go:316 certificates:7: Writing client certificate to /var/snap/etcd/common/client.crt 2025-04-18 07:52:48 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer: set flag tls_client.client.certificate.written 2025-04-18 07:52:48 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer: set flag tls_client.client.certificate.saved 2025-04-18 07:52:48 INFO unit.etcd/0.juju-log server.go:316 certificates:7: Writing client key to /var/snap/etcd/common/client.key 2025-04-18 07:52:48 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer: set flag tls_client.client.key.saved 2025-04-18 07:52:48 INFO unit.etcd/0.juju-log server.go:316 certificates:7: status-set: blocked: Missing relation to certificate authority. 2025-04-18 07:52:48 INFO juju.worker.uniter.operation runhook.go:159 ran "certificates-relation-joined" hook (via explicit, bespoke hook script) 2025-04-18 07:52:48 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-joined (7; unit: easyrsa/0) hook" for etcd/0 2025-04-18 07:52:48 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2025-04-18 07:52:48 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/0 uniter (run relation-joined (7; unit: easyrsa/0) hook) 2025-04-18 07:52:48 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/0 2025-04-18 07:52:48 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2025-04-18 07:52:48 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (7; unit: easyrsa/0) hook for etcd/0 2025-04-18 07:52:48 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/0 uniter (run relation-changed (7; unit: easyrsa/0) hook) 2025-04-18 07:52:57 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/0 uniter (run relation-changed (7; unit: easyrsa/0) hook) 2025-04-18 07:52:57 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (7; unit: easyrsa/0) hook" for etcd/0 2025-04-18 07:52:57 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (7; unit: easyrsa/0) hook" for etcd/0 2025-04-18 07:52:57 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running certificates-relation-changed hook for easyrsa/0 2025-04-18 07:52:57 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-0/agent.socket } 2025-04-18 07:52:57 INFO unit.etcd/0.juju-log server.go:316 certificates:7: Reactive main running for hook certificates-relation-changed 2025-04-18 07:52:58 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:143:set_app_version tracer: ++ queue handler reactive/etcd.py:157:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:521:process_snapd_timer tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:71:store_client 2025-04-18 07:52:58 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer: set flag config.default.nagios_context 2025-04-18 07:52:58 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer: set flag config.default.nagios_servicegroups 2025-04-18 07:52:58 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer: set flag config.set.snapd_refresh 2025-04-18 07:52:58 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer: set flag config.default.snapd_refresh 2025-04-18 07:52:58 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer: set flag config.set.port 2025-04-18 07:52:58 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer: set flag config.default.port 2025-04-18 07:52:58 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer: set flag config.set.management_port 2025-04-18 07:52:58 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer: set flag config.default.management_port 2025-04-18 07:52:58 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer: set flag config.set.channel 2025-04-18 07:52:58 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer: set flag config.set.bind_to_all_interfaces 2025-04-18 07:52:58 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer: set flag config.default.bind_to_all_interfaces 2025-04-18 07:52:58 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer: set flag config.default.tls_cipher_suites 2025-04-18 07:52:58 INFO unit.etcd/0.juju-log server.go:316 certificates:7: Initializing Leadership Layer (is leader) 2025-04-18 07:52:58 INFO unit.etcd/0.juju-log server.go:316 certificates:7: Initializing Snap Layer 2025-04-18 07:52:58 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer> tracer: starting handler dispatch, 44 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.ca.available tracer: set flag certificates.ca.changed tracer: set flag certificates.client.cert.available tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.default.tls_cipher_suites tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag endpoint.grafana.all_responses tracer: set flag endpoint.prometheus.all_responses tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag leadership.is_leader tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca.written tracer: set flag tls_client.ca_installed tracer: set flag tls_client.client.certificate.saved tracer: set flag tls_client.client.certificate.written tracer: set flag tls_client.client.key.saved 2025-04-18 07:52:58 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer: hooks phase, 0 handlers queued 2025-04-18 07:52:58 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer> tracer: main dispatch loop, 6 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:143:set_app_version tracer: ++ queue handler reactive/etcd.py:157:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:521:process_snapd_timer tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:71:store_client 2025-04-18 07:52:58 INFO unit.etcd/0.juju-log server.go:316 certificates:7: Invoking reactive handler: reactive/etcd.py:143:set_app_version 2025-04-18 07:52:58 INFO unit.etcd/0.juju-log server.go:316 certificates:7: Invoking reactive handler: reactive/etcd.py:157:prepare_tls_certificates 2025-04-18 07:52:58 INFO unit.etcd/0.juju-log server.go:316 certificates:7: Invoking reactive handler: reactive/etcd.py:521:process_snapd_timer 2025-04-18 07:52:58 INFO unit.etcd/0.juju-log server.go:316 certificates:7: Get config refresh.timer for snap core 2025-04-18 07:52:58 INFO unit.etcd/0.juju-log server.go:316 certificates:7: Invoking reactive handler: reactive/tls_client.py:18:store_ca 2025-04-18 07:52:58 INFO unit.etcd/0.juju-log server.go:316 certificates:7: Invoking reactive handler: reactive/tls_client.py:71:store_client 2025-04-18 07:52:58 INFO unit.etcd/0.juju-log server.go:316 certificates:7: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2025-04-18 07:52:58 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer: cleared flag certificates.ca.changed 2025-04-18 07:52:58 INFO juju.worker.uniter.operation runhook.go:159 ran "certificates-relation-changed" hook (via explicit, bespoke hook script) 2025-04-18 07:52:58 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (7; unit: easyrsa/0) hook" for etcd/0 2025-04-18 07:52:58 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2025-04-18 07:52:58 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/0 uniter (run relation-changed (7; unit: easyrsa/0) hook) 2025-04-18 07:52:58 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/0 2025-04-18 07:52:58 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2025-04-18 07:52:58 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (8; unit: kubernetes-control-plane/0) hook for etcd/0 2025-04-18 07:52:58 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/0 uniter (run relation-changed (8; unit: kubernetes-control-plane/0) hook) 2025-04-18 07:53:08 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/0 uniter (run relation-changed (8; unit: kubernetes-control-plane/0) hook) 2025-04-18 07:53:08 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (8; unit: kubernetes-control-plane/0) hook" for etcd/0 2025-04-18 07:53:08 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (8; unit: kubernetes-control-plane/0) hook" for etcd/0 2025-04-18 07:53:08 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running db-relation-changed hook for kubernetes-control-plane/0 2025-04-18 07:53:08 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-0/agent.socket } 2025-04-18 07:53:08 INFO unit.etcd/0.juju-log server.go:316 db:8: Reactive main running for hook db-relation-changed 2025-04-18 07:53:08 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:143:set_app_version tracer: ++ queue handler reactive/etcd.py:157:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:521:process_snapd_timer tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:71:store_client 2025-04-18 07:53:08 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer: set flag config.default.nagios_context 2025-04-18 07:53:08 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer: set flag config.default.nagios_servicegroups 2025-04-18 07:53:08 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer: set flag config.set.snapd_refresh 2025-04-18 07:53:08 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer: set flag config.default.snapd_refresh 2025-04-18 07:53:08 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer: set flag config.set.port 2025-04-18 07:53:08 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer: set flag config.default.port 2025-04-18 07:53:08 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer: set flag config.set.management_port 2025-04-18 07:53:08 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer: set flag config.default.management_port 2025-04-18 07:53:08 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer: set flag config.set.channel 2025-04-18 07:53:09 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer: set flag config.set.bind_to_all_interfaces 2025-04-18 07:53:09 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer: set flag config.default.bind_to_all_interfaces 2025-04-18 07:53:09 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer: set flag config.default.tls_cipher_suites 2025-04-18 07:53:09 INFO unit.etcd/0.juju-log server.go:316 db:8: Initializing Leadership Layer (is leader) 2025-04-18 07:53:09 INFO unit.etcd/0.juju-log server.go:316 db:8: Initializing Snap Layer 2025-04-18 07:53:09 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer> tracer: starting handler dispatch, 43 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.ca.available tracer: set flag certificates.client.cert.available tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.default.tls_cipher_suites tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag endpoint.grafana.all_responses tracer: set flag endpoint.prometheus.all_responses tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag leadership.is_leader tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca.written tracer: set flag tls_client.ca_installed tracer: set flag tls_client.client.certificate.saved tracer: set flag tls_client.client.certificate.written tracer: set flag tls_client.client.key.saved 2025-04-18 07:53:09 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler hooks/relations/etcd/provides.py:22:joined_or_changed 2025-04-18 07:53:09 INFO unit.etcd/0.juju-log server.go:316 db:8: Invoking reactive handler: hooks/relations/etcd/provides.py:22:joined_or_changed 2025-04-18 07:53:09 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer> tracer: main dispatch loop, 6 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:143:set_app_version tracer: ++ queue handler reactive/etcd.py:157:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:521:process_snapd_timer tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:71:store_client 2025-04-18 07:53:09 INFO unit.etcd/0.juju-log server.go:316 db:8: Invoking reactive handler: reactive/etcd.py:143:set_app_version 2025-04-18 07:53:09 INFO unit.etcd/0.juju-log server.go:316 db:8: Invoking reactive handler: reactive/etcd.py:157:prepare_tls_certificates 2025-04-18 07:53:09 INFO unit.etcd/0.juju-log server.go:316 db:8: Invoking reactive handler: reactive/etcd.py:521:process_snapd_timer 2025-04-18 07:53:09 INFO unit.etcd/0.juju-log server.go:316 db:8: Get config refresh.timer for snap core 2025-04-18 07:53:09 INFO unit.etcd/0.juju-log server.go:316 db:8: Invoking reactive handler: reactive/tls_client.py:18:store_ca 2025-04-18 07:53:09 INFO unit.etcd/0.juju-log server.go:316 db:8: Invoking reactive handler: reactive/tls_client.py:71:store_client 2025-04-18 07:53:09 INFO unit.etcd/0.juju-log server.go:316 db:8: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2025-04-18 07:53:09 INFO juju.worker.uniter.operation runhook.go:159 ran "db-relation-changed" hook (via explicit, bespoke hook script) 2025-04-18 07:53:09 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (8; unit: kubernetes-control-plane/0) hook" for etcd/0 2025-04-18 07:53:09 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2025-04-18 07:53:09 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/0 uniter (run relation-changed (8; unit: kubernetes-control-plane/0) hook) 2025-04-18 07:53:09 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/0 2025-04-18 07:53:09 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2025-04-18 07:53:09 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 7 2025-04-18 07:53:09 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-control-plane/0" already joined relation 8 2025-04-18 07:53:09 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 2025-04-18 07:53:09 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2025-04-18 07:53:09 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 7 2025-04-18 07:53:09 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-control-plane/0" already joined relation 8 2025-04-18 07:53:30 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for etcd/0 : {7 {map[easyrsa/0:{2}] map[] []}} 2025-04-18 07:53:30 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2025-04-18 07:53:30 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 7 2025-04-18 07:53:30 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (7; unit: easyrsa/0) hook for etcd/0 2025-04-18 07:53:30 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/0 uniter (run relation-changed (7; unit: easyrsa/0) hook) 2025-04-18 07:53:42 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/0 uniter (run relation-changed (7; unit: easyrsa/0) hook) 2025-04-18 07:53:42 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (7; unit: easyrsa/0) hook" for etcd/0 2025-04-18 07:53:42 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (7; unit: easyrsa/0) hook" for etcd/0 2025-04-18 07:53:42 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running certificates-relation-changed hook for easyrsa/0 2025-04-18 07:53:42 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-0/agent.socket } 2025-04-18 07:53:42 INFO unit.etcd/0.juju-log server.go:316 certificates:7: Reactive main running for hook certificates-relation-changed 2025-04-18 07:53:42 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer> tracer: set flag endpoint.certificates.changed.etcd_0.server.cert tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:143:set_app_version tracer: ++ queue handler reactive/etcd.py:157:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:521:process_snapd_timer tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:71:store_client 2025-04-18 07:53:42 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer: set flag endpoint.certificates.changed.etcd_0.server.key 2025-04-18 07:53:42 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer: set flag config.set.nagios_context 2025-04-18 07:53:42 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer: set flag config.default.nagios_context 2025-04-18 07:53:42 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer: set flag config.default.nagios_servicegroups 2025-04-18 07:53:43 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer: set flag config.set.snapd_refresh 2025-04-18 07:53:43 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer: set flag config.default.snapd_refresh 2025-04-18 07:53:43 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer: set flag config.set.port 2025-04-18 07:53:43 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer: set flag config.default.port 2025-04-18 07:53:43 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer: set flag config.set.management_port 2025-04-18 07:53:43 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer: set flag config.default.management_port 2025-04-18 07:53:43 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer: set flag config.set.channel 2025-04-18 07:53:43 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer: set flag config.set.bind_to_all_interfaces 2025-04-18 07:53:43 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer: set flag config.default.bind_to_all_interfaces 2025-04-18 07:53:43 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer: set flag config.default.tls_cipher_suites 2025-04-18 07:53:43 INFO unit.etcd/0.juju-log server.go:316 certificates:7: Initializing Leadership Layer (is leader) 2025-04-18 07:53:43 INFO unit.etcd/0.juju-log server.go:316 certificates:7: Initializing Snap Layer 2025-04-18 07:53:43 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer> tracer: starting handler dispatch, 45 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.ca.available tracer: set flag certificates.client.cert.available tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.default.tls_cipher_suites tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.etcd_0.server.cert tracer: set flag endpoint.certificates.changed.etcd_0.server.key tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag endpoint.grafana.all_responses tracer: set flag endpoint.prometheus.all_responses tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag leadership.is_leader tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca.written tracer: set flag tls_client.ca_installed tracer: set flag tls_client.client.certificate.saved tracer: set flag tls_client.client.certificate.written tracer: set flag tls_client.client.key.saved 2025-04-18 07:53:43 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer: hooks phase, 0 handlers queued 2025-04-18 07:53:43 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer> tracer: main dispatch loop, 6 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:143:set_app_version tracer: ++ queue handler reactive/etcd.py:157:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:521:process_snapd_timer tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:71:store_client 2025-04-18 07:53:43 INFO unit.etcd/0.juju-log server.go:316 certificates:7: Invoking reactive handler: reactive/etcd.py:143:set_app_version 2025-04-18 07:53:43 INFO unit.etcd/0.juju-log server.go:316 certificates:7: Invoking reactive handler: reactive/etcd.py:157:prepare_tls_certificates 2025-04-18 07:53:43 INFO unit.etcd/0.juju-log server.go:316 certificates:7: Invoking reactive handler: reactive/etcd.py:521:process_snapd_timer 2025-04-18 07:53:43 INFO unit.etcd/0.juju-log server.go:316 certificates:7: Get config refresh.timer for snap core 2025-04-18 07:53:43 INFO unit.etcd/0.juju-log server.go:316 certificates:7: Invoking reactive handler: reactive/tls_client.py:18:store_ca 2025-04-18 07:53:43 INFO unit.etcd/0.juju-log server.go:316 certificates:7: Invoking reactive handler: reactive/tls_client.py:71:store_client 2025-04-18 07:53:43 INFO unit.etcd/0.juju-log server.go:316 certificates:7: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2025-04-18 07:53:43 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer: set flag certificates.server.certs.available 2025-04-18 07:53:43 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer: set flag certificates.server.certs.changed 2025-04-18 07:53:43 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer: set flag certificates.certs.available 2025-04-18 07:53:43 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer> tracer: set flag certificates.certs.changed tracer: ++ queue handler reactive/tls_client.py:98:update_certs 2025-04-18 07:53:43 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer> tracer: set flag certificates.server.cert.available tracer: ++ queue handler reactive/tls_client.py:44:store_server 2025-04-18 07:53:43 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer: set flag certificates.batch.cert.available 2025-04-18 07:53:43 INFO unit.etcd/0.juju-log server.go:316 certificates:7: Invoking reactive handler: reactive/tls_client.py:44:store_server 2025-04-18 07:53:43 INFO unit.etcd/0.juju-log server.go:316 certificates:7: Writing server certificate to /var/snap/etcd/common/server.crt 2025-04-18 07:53:43 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer: set flag tls_client.server.certificate.written 2025-04-18 07:53:43 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer: set flag tls_client.server.certificate.saved 2025-04-18 07:53:43 INFO unit.etcd/0.juju-log server.go:316 certificates:7: Writing server key to /var/snap/etcd/common/server.key 2025-04-18 07:53:43 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer: set flag tls_client.server.key.saved 2025-04-18 07:53:43 INFO unit.etcd/0.juju-log server.go:316 certificates:7: Invoking reactive handler: reactive/tls_client.py:98:update_certs 2025-04-18 07:53:43 WARNING unit.etcd/0.juju-log server.go:316 certificates:7: No client certs found using maps. Checking for global client certificates. 2025-04-18 07:53:43 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer: set flag tls_client.certs.saved 2025-04-18 07:53:43 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer> tracer: cleared flag certificates.certs.changed tracer: -- dequeue handler reactive/tls_client.py:98:update_certs 2025-04-18 07:53:43 INFO unit.etcd/0.juju-log server.go:316 certificates:7: Invoking reactive handler: reactive/etcd.py:563:tls_state_control 2025-04-18 07:53:43 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer> tracer: set flag etcd.ssl.placed tracer: ++ queue handler reactive/etcd.py:585:tls_update tracer: -- dequeue handler reactive/etcd.py:563:tls_state_control 2025-04-18 07:53:43 INFO unit.etcd/0.juju-log server.go:316 certificates:7: Invoking reactive handler: reactive/etcd.py:317:send_single_connection_details 2025-04-18 07:53:43 INFO unit.etcd/0.juju-log server.go:316 certificates:7: Invoking reactive handler: reactive/etcd.py:481:initialize_new_leader 2025-04-18 07:53:43 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: Writing file /var/snap/etcd/common/etcd.conf.yml root:root 444 2025-04-18 07:53:46 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer: set flag etcd.registered 2025-04-18 07:53:46 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer> tracer: set flag etcd.leader.configured tracer: -- dequeue handler reactive/etcd.py:481:initialize_new_leader 2025-04-18 07:53:46 INFO unit.etcd/0.juju-log server.go:316 certificates:7: Invoking reactive handler: reactive/etcd.py:585:tls_update 2025-04-18 07:53:46 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: Changing permissions on existing content: 33060 -> 292 2025-04-18 07:53:46 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer> tracer: cleared flag etcd.ssl.placed tracer: ++ queue handler reactive/etcd.py:563:tls_state_control tracer: -- dequeue handler reactive/etcd.py:317:send_single_connection_details tracer: -- dequeue handler reactive/etcd.py:585:tls_update 2025-04-18 07:53:46 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer: cleared flag tls_client.ca.written 2025-04-18 07:53:46 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer: cleared flag tls_client.server.certificate.written 2025-04-18 07:53:46 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer: cleared flag tls_client.client.certificate.written 2025-04-18 07:53:46 INFO unit.etcd/0.juju-log server.go:316 certificates:7: Invoking reactive handler: reactive/etcd.py:113:check_cluster_health 2025-04-18 07:53:47 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for etcd/0: ok=true 2025-04-18 07:53:47 INFO unit.etcd/0.juju-log server.go:316 certificates:7: Invoking reactive handler: reactive/etcd.py:563:tls_state_control 2025-04-18 07:53:47 DEBUG unit.etcd/0.juju-log server.go:316 certificates:7: tracer> tracer: set flag etcd.ssl.placed tracer: ++ queue handler reactive/etcd.py:317:send_single_connection_details tracer: -- dequeue handler reactive/etcd.py:563:tls_state_control 2025-04-18 07:53:47 INFO unit.etcd/0.juju-log server.go:316 certificates:7: Invoking reactive handler: reactive/etcd.py:317:send_single_connection_details 2025-04-18 07:53:47 INFO unit.etcd/0.juju-log server.go:316 certificates:7: status-set: active: Healthy with 1 known peer 2025-04-18 07:53:48 INFO juju.worker.uniter.operation runhook.go:159 ran "certificates-relation-changed" hook (via explicit, bespoke hook script) 2025-04-18 07:53:48 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (7; unit: easyrsa/0) hook" for etcd/0 2025-04-18 07:53:48 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2025-04-18 07:53:48 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/0 uniter (run relation-changed (7; unit: easyrsa/0) hook) 2025-04-18 07:53:48 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/0 2025-04-18 07:53:48 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2025-04-18 07:53:48 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 7 2025-04-18 07:53:48 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-control-plane/0" already joined relation 8 2025-04-18 07:53:48 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 2025-04-18 07:53:48 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2025-04-18 07:53:48 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 7 2025-04-18 07:53:48 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-control-plane/0" already joined relation 8 2025-04-18 07:56:41 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for etcd/0 2025-04-18 07:56:41 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2025-04-18 07:56:41 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 7 2025-04-18 07:56:41 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-control-plane/0" already joined relation 8 2025-04-18 07:56:41 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for etcd/0 2025-04-18 07:56:41 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/0 uniter (run update-status hook) 2025-04-18 07:56:41 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/0 uniter (run update-status hook) 2025-04-18 07:56:41 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for etcd/0 2025-04-18 07:56:41 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for etcd/0 2025-04-18 07:56:41 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-0/agent.socket } 2025-04-18 07:56:41 INFO unit.etcd/0.juju-log server.go:316 Reactive main running for hook update-status 2025-04-18 07:56:41 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:113:check_cluster_health tracer: ++ queue handler reactive/etcd.py:143:set_app_version tracer: ++ queue handler reactive/etcd.py:157:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:317:send_single_connection_details tracer: ++ queue handler reactive/etcd.py:521:process_snapd_timer tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2025-04-18 07:56:41 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.nagios_context 2025-04-18 07:56:41 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2025-04-18 07:56:41 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.snapd_refresh 2025-04-18 07:56:41 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.snapd_refresh 2025-04-18 07:56:41 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.port 2025-04-18 07:56:41 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.port 2025-04-18 07:56:41 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.management_port 2025-04-18 07:56:41 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.management_port 2025-04-18 07:56:41 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.channel 2025-04-18 07:56:41 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.bind_to_all_interfaces 2025-04-18 07:56:41 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.bind_to_all_interfaces 2025-04-18 07:56:41 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.tls_cipher_suites 2025-04-18 07:56:41 INFO unit.etcd/0.juju-log server.go:316 Initializing Leadership Layer (is leader) 2025-04-18 07:56:41 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag leadership.changed.cluster 2025-04-18 07:56:41 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag leadership.set.cluster 2025-04-18 07:56:41 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag leadership.changed.leader_address 2025-04-18 07:56:42 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag leadership.set.leader_address 2025-04-18 07:56:42 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag leadership.changed 2025-04-18 07:56:42 INFO unit.etcd/0.juju-log server.go:316 Initializing Snap Layer 2025-04-18 07:56:42 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: starting handler dispatch, 59 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.batch.cert.available tracer: set flag certificates.ca.available tracer: set flag certificates.certs.available tracer: set flag certificates.client.cert.available tracer: set flag certificates.server.cert.available tracer: set flag certificates.server.certs.available tracer: set flag certificates.server.certs.changed tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.default.tls_cipher_suites tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.etcd_0.server.cert tracer: set flag endpoint.certificates.changed.etcd_0.server.key tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag endpoint.grafana.all_responses tracer: set flag endpoint.prometheus.all_responses tracer: set flag etcd.leader.configured tracer: set flag etcd.registered tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag etcd.ssl.placed tracer: set flag leadership.changed tracer: set flag leadership.changed.cluster tracer: set flag leadership.changed.leader_address tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster tracer: set flag leadership.set.leader_address tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca_installed tracer: set flag tls_client.certs.saved tracer: set flag tls_client.client.certificate.saved tracer: set flag tls_client.client.key.saved tracer: set flag tls_client.server.certificate.saved tracer: set flag tls_client.server.key.saved 2025-04-18 07:56:42 DEBUG unit.etcd/0.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2025-04-18 07:56:42 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: main dispatch loop, 9 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:113:check_cluster_health tracer: ++ queue handler reactive/etcd.py:143:set_app_version tracer: ++ queue handler reactive/etcd.py:157:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:317:send_single_connection_details tracer: ++ queue handler reactive/etcd.py:521:process_snapd_timer tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2025-04-18 07:56:42 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:113:check_cluster_health 2025-04-18 07:56:42 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:143:set_app_version 2025-04-18 07:56:42 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:157:prepare_tls_certificates 2025-04-18 07:56:42 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:317:send_single_connection_details 2025-04-18 07:56:42 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:521:process_snapd_timer 2025-04-18 07:56:42 INFO unit.etcd/0.juju-log server.go:316 Get config refresh.timer for snap core 2025-04-18 07:56:42 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:18:store_ca 2025-04-18 07:56:42 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:44:store_server 2025-04-18 07:56:42 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:71:store_client 2025-04-18 07:56:42 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2025-04-18 07:56:42 DEBUG unit.etcd/0.juju-log server.go:316 tracer: cleared flag certificates.server.certs.changed 2025-04-18 07:56:42 INFO unit.etcd/0.juju-log server.go:316 status-set: active: Healthy with 1 known peer 2025-04-18 07:56:42 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2025-04-18 07:56:42 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for etcd/0 2025-04-18 07:56:42 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2025-04-18 07:56:42 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/0 uniter (run update-status hook) 2025-04-18 07:56:42 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/0 2025-04-18 07:56:42 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2025-04-18 07:56:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-control-plane/0" already joined relation 8 2025-04-18 07:56:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 7 2025-04-18 08:01:44 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for etcd/0 2025-04-18 08:01:44 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2025-04-18 08:01:44 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 7 2025-04-18 08:01:44 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-control-plane/0" already joined relation 8 2025-04-18 08:01:44 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for etcd/0 2025-04-18 08:01:44 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/0 uniter (run update-status hook) 2025-04-18 08:01:44 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/0 uniter (run update-status hook) 2025-04-18 08:01:44 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for etcd/0 2025-04-18 08:01:44 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for etcd/0 2025-04-18 08:01:44 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-0/agent.socket } 2025-04-18 08:01:44 INFO unit.etcd/0.juju-log server.go:316 Reactive main running for hook update-status 2025-04-18 08:01:44 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:113:check_cluster_health tracer: ++ queue handler reactive/etcd.py:143:set_app_version tracer: ++ queue handler reactive/etcd.py:157:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:317:send_single_connection_details tracer: ++ queue handler reactive/etcd.py:521:process_snapd_timer tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2025-04-18 08:01:44 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.nagios_context 2025-04-18 08:01:44 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2025-04-18 08:01:44 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.snapd_refresh 2025-04-18 08:01:44 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.snapd_refresh 2025-04-18 08:01:44 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.port 2025-04-18 08:01:44 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.port 2025-04-18 08:01:44 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.management_port 2025-04-18 08:01:44 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.management_port 2025-04-18 08:01:44 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.channel 2025-04-18 08:01:45 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.bind_to_all_interfaces 2025-04-18 08:01:45 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.bind_to_all_interfaces 2025-04-18 08:01:45 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.tls_cipher_suites 2025-04-18 08:01:45 INFO unit.etcd/0.juju-log server.go:316 Initializing Leadership Layer (is leader) 2025-04-18 08:01:45 DEBUG unit.etcd/0.juju-log server.go:316 tracer: cleared flag leadership.changed.cluster 2025-04-18 08:01:45 DEBUG unit.etcd/0.juju-log server.go:316 tracer: cleared flag leadership.changed.leader_address 2025-04-18 08:01:45 DEBUG unit.etcd/0.juju-log server.go:316 tracer: cleared flag leadership.changed 2025-04-18 08:01:45 INFO unit.etcd/0.juju-log server.go:316 Initializing Snap Layer 2025-04-18 08:01:45 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: starting handler dispatch, 55 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.batch.cert.available tracer: set flag certificates.ca.available tracer: set flag certificates.certs.available tracer: set flag certificates.client.cert.available tracer: set flag certificates.server.cert.available tracer: set flag certificates.server.certs.available tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.default.tls_cipher_suites tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.etcd_0.server.cert tracer: set flag endpoint.certificates.changed.etcd_0.server.key tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag endpoint.grafana.all_responses tracer: set flag endpoint.prometheus.all_responses tracer: set flag etcd.leader.configured tracer: set flag etcd.registered tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag etcd.ssl.placed tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster tracer: set flag leadership.set.leader_address tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca_installed tracer: set flag tls_client.certs.saved tracer: set flag tls_client.client.certificate.saved tracer: set flag tls_client.client.key.saved tracer: set flag tls_client.server.certificate.saved tracer: set flag tls_client.server.key.saved 2025-04-18 08:01:45 DEBUG unit.etcd/0.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2025-04-18 08:01:45 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: main dispatch loop, 9 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:113:check_cluster_health tracer: ++ queue handler reactive/etcd.py:143:set_app_version tracer: ++ queue handler reactive/etcd.py:157:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:317:send_single_connection_details tracer: ++ queue handler reactive/etcd.py:521:process_snapd_timer tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2025-04-18 08:01:45 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:113:check_cluster_health 2025-04-18 08:01:45 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:143:set_app_version 2025-04-18 08:01:45 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:157:prepare_tls_certificates 2025-04-18 08:01:45 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:317:send_single_connection_details 2025-04-18 08:01:45 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:521:process_snapd_timer 2025-04-18 08:01:45 INFO unit.etcd/0.juju-log server.go:316 Get config refresh.timer for snap core 2025-04-18 08:01:45 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:18:store_ca 2025-04-18 08:01:45 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:44:store_server 2025-04-18 08:01:45 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:71:store_client 2025-04-18 08:01:45 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2025-04-18 08:01:45 INFO unit.etcd/0.juju-log server.go:316 status-set: active: Healthy with 1 known peer 2025-04-18 08:01:45 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2025-04-18 08:01:45 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for etcd/0 2025-04-18 08:01:45 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2025-04-18 08:01:45 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/0 uniter (run update-status hook) 2025-04-18 08:01:45 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/0 2025-04-18 08:01:45 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2025-04-18 08:01:45 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 7 2025-04-18 08:01:45 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-control-plane/0" already joined relation 8 2025-04-18 08:03:54 DEBUG juju.worker.uniter.remotestate watcher.go:623 got update status interval change for etcd/0: ok=true 2025-04-18 08:03:54 DEBUG juju.worker.retrystrategy worker.go:92 bouncing retrystrategy worker to get new values 2025-04-18 08:03:54 DEBUG juju.worker.dependency engine.go:621 "hook-retry-strategy" manifold worker stopped: restart immediately 2025-04-18 08:03:54 DEBUG juju.worker.uniter runlistener.go:130 juju-run listener stopping 2025-04-18 08:03:54 DEBUG juju.worker.uniter runlistener.go:149 juju-run listener stopped 2025-04-18 08:03:54 INFO juju.worker.uniter uniter.go:319 unit "etcd/0" shutting down: catacomb 0xc0031b5200 is dying 2025-04-18 08:03:54 DEBUG juju.worker.dependency engine.go:580 "hook-retry-strategy" manifold worker started at 2025-04-18 08:03:54.379639423 +0000 UTC 2025-04-18 08:03:54 DEBUG juju.worker.dependency engine.go:603 "uniter" manifold worker completed successfully 2025-04-18 08:03:54 DEBUG juju.worker.dependency engine.go:580 "uniter" manifold worker started at 2025-04-18 08:03:54.402160382 +0000 UTC 2025-04-18 08:03:54 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "etcd/0" (leader=true) entered scope for relation "etcd:cluster" 2025-04-18 08:03:54 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "etcd/0" (leader=true) entered scope for relation "etcd:certificates easyrsa:client" 2025-04-18 08:03:54 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "etcd/0" (leader=true) entered scope for relation "kubernetes-control-plane:etcd etcd:db" 2025-04-18 08:03:54 DEBUG juju.worker.uniter uniter.go:883 starting local juju-run listener on {unix /var/lib/juju/agents/unit-etcd-0/run.socket } 2025-04-18 08:03:54 INFO juju.worker.uniter uniter.go:335 unit "etcd/0" started 2025-04-18 08:03:54 DEBUG juju.worker.uniter runlistener.go:117 juju-run listener running 2025-04-18 08:03:54 INFO juju.worker.uniter uniter.go:361 hooks are retried false 2025-04-18 08:03:54 DEBUG juju.worker.uniter.remotestate watcher.go:542 got config change for etcd/0: ok=true, hashes=[28624016bd32dd0ca16f2ca26922ce370835c29dcd2cedaf5db7c8a89ec3e9fc] 2025-04-18 08:03:54 DEBUG juju.worker.uniter.remotestate watcher.go:564 got upgrade series change 2025-04-18 08:03:54 DEBUG juju.worker.uniter.remotestate watcher.go:714 no upgrade series in progress, reinitializing local upgrade series state 2025-04-18 08:03:54 DEBUG juju.worker.uniter.remotestate watcher.go:603 got relations change for etcd/0: ok=true 2025-04-18 08:03:54 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for etcd/0: ok=true 2025-04-18 08:03:54 DEBUG juju.worker.uniter.remotestate watcher.go:613 got storage change for etcd/0: [] ok=true 2025-04-18 08:03:54 DEBUG juju.worker.uniter.remotestate watcher.go:499 got application change for etcd/0 2025-04-18 08:03:54 DEBUG juju.worker.uniter.remotestate watcher.go:623 got update status interval change for etcd/0: ok=true 2025-04-18 08:03:54 DEBUG juju.worker.uniter.remotestate watcher.go:553 got trust config change for etcd/0: ok=true, hashes=[17f2acda51310eebc7ec5fc33ba3e24c9838f484cf50956f7b6066f1d8bba28f] 2025-04-18 08:03:54 DEBUG juju.worker.uniter.remotestate watcher.go:574 got address change for etcd/0: ok=true, hashes=[0ea6febdb53af3968189cae2e299465cdff1ab6b9a65969c6c60f7d3f88a5c2a] 2025-04-18 08:03:54 DEBUG juju.worker.uniter.remotestate watcher.go:489 got unit change for etcd/0 2025-04-18 08:03:54 DEBUG juju.worker.uniter.remotestate watcher.go:595 got action change for etcd/0: [] ok=true 2025-04-18 08:03:54 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2025-04-18 08:03:54 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-control-plane/0" already joined relation 8 2025-04-18 08:03:54 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 7 2025-04-18 08:03:54 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: