2024-09-02 10:58:50 INFO juju unit_agent.go:289 Starting unit workers for "etcd/0" 2024-09-02 10:58:50 INFO juju.worker.apicaller connect.go:163 [a46fc5] "unit-etcd-0" successfully connected to "10.0.0.24:17070" 2024-09-02 10:58:50 INFO juju.worker.apicaller connect.go:260 [a46fc5] password changed for "unit-etcd-0" 2024-09-02 10:58:50 INFO juju.worker.apicaller connect.go:163 [a46fc5] "unit-etcd-0" successfully connected to "10.0.0.24:17070" 2024-09-02 10:58:50 INFO juju.worker.migrationminion worker.go:142 migration phase is now: NONE 2024-09-02 10:58:50 INFO juju.worker.logger logger.go:120 logger worker started 2024-09-02 10:58:50 INFO juju.worker.upgrader upgrader.go:216 no waiter, upgrader is done 2024-09-02 10:58:50 DEBUG juju.worker.dependency engine.go:603 "upgrader" manifold worker completed successfully 2024-09-02 10:58:50 DEBUG juju.worker.dependency engine.go:580 "uniter" manifold worker started at 2024-09-02 10:58:50.791830656 +0000 UTC 2024-09-02 10:58:50 DEBUG juju.worker.dependency engine.go:580 "metric-sender" manifold worker started at 2024-09-02 10:58:50.7925203 +0000 UTC 2024-09-02 10:58:50 DEBUG juju.worker.apiaddressupdater apiaddressupdater.go:98 updating API hostPorts to [[10.0.0.24:17070 252.24.0.1:17070 127.0.0.1:17070 [::1]:17070]] 2024-09-02 10:58:50 DEBUG juju.worker.meterstatus connected.go:93 got meter status change signal from watcher 2024-09-02 10:58:50 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for meterstatus (meter-status-changed) 2024-09-02 10:58:50 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for meterstatus (meter-status-changed) 2024-09-02 10:58:50 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-0/agent.socket } 2024-09-02 10:58:50 ERROR juju.worker.meterstatus runner.go:93 error running "meter-status-changed": charm missing from disk 2024-09-02 10:58:50 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-02 10:58:50 DEBUG juju.machinelock machinelock.go:186 machine lock released for meterstatus (meter-status-changed) 2024-09-02 10:58:50 DEBUG juju.worker.uniter uniter.go:883 starting local juju-run listener on {unix /var/lib/juju/agents/unit-etcd-0/run.socket } 2024-09-02 10:58:50 INFO juju.worker.uniter uniter.go:335 unit "etcd/0" started 2024-09-02 10:58:50 DEBUG juju.worker.uniter runlistener.go:117 juju-run listener running 2024-09-02 10:58:50 INFO juju.worker.uniter uniter.go:651 resuming charm install 2024-09-02 10:58:50 DEBUG juju.worker.uniter.operation executor.go:85 running operation install cs:~containers/etcd-622 for etcd/0 2024-09-02 10:58:50 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "install cs:~containers/etcd-622" for etcd/0 2024-09-02 10:58:50 INFO juju.worker.uniter.charm bundles.go:81 downloading cs:~containers/etcd-622 from API server 2024-09-02 10:58:50 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "install cs:~containers/etcd-622" for etcd/0 2024-09-02 10:58:50 DEBUG juju.worker.uniter.charm manifest_deployer.go:143 preparing to deploy charm "cs:~containers/etcd-622" 2024-09-02 10:58:50 DEBUG juju.worker.uniter.charm manifest_deployer.go:132 deploying charm "cs:~containers/etcd-622" 2024-09-02 10:58:54 DEBUG juju.worker.uniter.charm manifest_deployer.go:164 finishing deploy of charm "cs:~containers/etcd-622" 2024-09-02 10:58:54 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "install cs:~containers/etcd-622" for etcd/0 2024-09-02 10:58:54 INFO juju.worker.uniter uniter.go:361 hooks are retried true 2024-09-02 10:58:54 DEBUG juju.worker.uniter.remotestate watcher.go:499 got application change for etcd/0 2024-09-02 10:58:54 DEBUG juju.worker.uniter.remotestate watcher.go:623 got update status interval change for etcd/0: ok=true 2024-09-02 10:58:54 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for etcd/0: ok=true 2024-09-02 10:58:54 DEBUG juju.worker.uniter.remotestate watcher.go:489 got unit change for etcd/0 2024-09-02 10:58:54 DEBUG juju.worker.uniter.remotestate watcher.go:603 got relations change for etcd/0: ok=true 2024-09-02 10:58:54 DEBUG juju.worker.uniter.remotestate watcher.go:553 got trust config change for etcd/0: ok=true, hashes=[17f2acda51310eebc7ec5fc33ba3e24c9838f484cf50956f7b6066f1d8bba28f] 2024-09-02 10:58:54 DEBUG juju.worker.uniter.remotestate watcher.go:595 got action change for etcd/0: [] ok=true 2024-09-02 10:58:54 DEBUG juju.worker.uniter.remotestate watcher.go:574 got address change for etcd/0: ok=true, hashes=[883fb12aa234ef06159f66d43c02fb052e704d5b56baad6138abe77b3dc439f8] 2024-09-02 10:58:54 DEBUG juju.worker.uniter.remotestate watcher.go:564 got upgrade series change 2024-09-02 10:58:54 DEBUG juju.worker.uniter.remotestate watcher.go:714 no upgrade series in progress, reinitializing local upgrade series state 2024-09-02 10:58:54 DEBUG juju.worker.uniter.remotestate watcher.go:542 got config change for etcd/0: ok=true, hashes=[51e9e2593d2d2d48099fb3c0fe9760058a9f2043cb2eddd9a7a27cc5b8850729] 2024-09-02 10:58:54 DEBUG juju.worker.uniter.remotestate watcher.go:613 got storage change for etcd/0: [] ok=true 2024-09-02 10:58:54 INFO juju.worker.uniter.storage resolver.go:126 initial storage attachments ready 2024-09-02 10:58:54 INFO juju.worker.uniter resolver.go:159 found queued "install" hook 2024-09-02 10:58:54 DEBUG juju.worker.uniter.operation executor.go:85 running operation run install hook for etcd/0 2024-09-02 10:58:54 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/0 uniter (run install hook) 2024-09-02 11:00:03 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/0 uniter (run install hook) 2024-09-02 11:00:03 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run install hook" for etcd/0 2024-09-02 11:00:03 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run install hook" for etcd/0 2024-09-02 11:00:03 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running install hook 2024-09-02 11:00:03 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-0/agent.socket } 2024-09-02 11:00:03 DEBUG unit.etcd/0.install logger.go:60 Reading package lists... 2024-09-02 11:00:03 DEBUG unit.etcd/0.install logger.go:60 Building dependency tree... 2024-09-02 11:00:03 DEBUG unit.etcd/0.install logger.go:60 Reading state information... 2024-09-02 11:00:04 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for etcd/0 : {10 {map[easyrsa/0:{0}] map[] []}} 2024-09-02 11:00:04 DEBUG unit.etcd/0.install logger.go:60 python3-dev is already the newest version (3.8.2-0ubuntu2). 2024-09-02 11:00:04 DEBUG unit.etcd/0.install logger.go:60 python3-setuptools is already the newest version (45.2.0-1ubuntu0.1). 2024-09-02 11:00:04 DEBUG unit.etcd/0.install logger.go:60 python3-yaml is already the newest version (5.3.1-1ubuntu0.1). 2024-09-02 11:00:04 DEBUG unit.etcd/0.install logger.go:60 python3-pip is already the newest version (20.0.2-5ubuntu1.10). 2024-09-02 11:00:04 DEBUG unit.etcd/0.install logger.go:60 python3-wheel is already the newest version (0.34.2-1ubuntu0.1). 2024-09-02 11:00:04 DEBUG unit.etcd/0.install logger.go:60 build-essential is already the newest version (12.8ubuntu1.1). 2024-09-02 11:00:04 DEBUG unit.etcd/0.install logger.go:60 0 upgraded, 0 newly installed, 0 to remove and 7 not upgraded. 2024-09-02 11:00:04 DEBUG unit.etcd/0.install logger.go:60 Reading package lists... 2024-09-02 11:00:04 DEBUG unit.etcd/0.install logger.go:60 Building dependency tree... 2024-09-02 11:00:04 DEBUG unit.etcd/0.install logger.go:60 Reading state information... 2024-09-02 11:00:04 DEBUG unit.etcd/0.install logger.go:60 rsync is already the newest version (3.1.3-8ubuntu0.7). 2024-09-02 11:00:04 DEBUG unit.etcd/0.install logger.go:60 rsync set to manually installed. 2024-09-02 11:00:04 DEBUG unit.etcd/0.install logger.go:60 0 upgraded, 0 newly installed, 0 to remove and 7 not upgraded. 2024-09-02 11:00:04 DEBUG unit.etcd/0.install logger.go:60 Reading package lists... 2024-09-02 11:00:04 DEBUG unit.etcd/0.install logger.go:60 Building dependency tree... 2024-09-02 11:00:04 DEBUG unit.etcd/0.install logger.go:60 Reading state information... 2024-09-02 11:00:04 DEBUG unit.etcd/0.install logger.go:60 virtualenv is already the newest version (20.0.17-1ubuntu0.4). 2024-09-02 11:00:04 DEBUG unit.etcd/0.install logger.go:60 0 upgraded, 0 newly installed, 0 to remove and 7 not upgraded. 2024-09-02 11:00:05 DEBUG unit.etcd/0.install logger.go:60 created virtual environment CPython3.8.10.final.0-64 in 101ms 2024-09-02 11:00:05 DEBUG unit.etcd/0.install logger.go:60 creator CPython3Posix(dest=/var/lib/juju/agents/unit-etcd-0/.venv, clear=False, global=False) 2024-09-02 11:00:05 DEBUG unit.etcd/0.install logger.go:60 seeder FromAppData(download=False, pip=latest, setuptools=latest, wheel=latest, pkg_resources=latest, via=copy, app_data_dir=/root/.local/share/virtualenv/seed-app-data/v1.0.1.debian.1) 2024-09-02 11:00:05 DEBUG unit.etcd/0.install logger.go:60 activators BashActivator,CShellActivator,FishActivator,PowerShellActivator,PythonActivator,XonshActivator 2024-09-02 11:00:07 DEBUG unit.etcd/0.install logger.go:60 Looking in links: wheelhouse 2024-09-02 11:00:07 DEBUG unit.etcd/0.install logger.go:60 Requirement already up-to-date: pip in /var/lib/juju/agents/unit-etcd-0/.venv/lib/python3.8/site-packages (20.0.2) 2024-09-02 11:00:07 DEBUG unit.etcd/0.install logger.go:60 Looking in links: wheelhouse 2024-09-02 11:00:07 DEBUG unit.etcd/0.install logger.go:60 Requirement already up-to-date: setuptools in /var/lib/juju/agents/unit-etcd-0/.venv/lib/python3.8/site-packages (44.0.0) 2024-09-02 11:00:08 DEBUG unit.etcd/0.install logger.go:60 Looking in links: wheelhouse 2024-09-02 11:00:08 DEBUG unit.etcd/0.install logger.go:60 Processing ./wheelhouse/setuptools_scm-1.17.0.tar.gz 2024-09-02 11:00:09 DEBUG unit.etcd/0.install logger.go:60 Building wheels for collected packages: setuptools-scm 2024-09-02 11:00:09 DEBUG unit.etcd/0.install logger.go:60 Building wheel for setuptools-scm (setup.py): started 2024-09-02 11:00:09 DEBUG unit.etcd/0.install logger.go:60 Building wheel for setuptools-scm (setup.py): finished with status 'done' 2024-09-02 11:00:09 DEBUG unit.etcd/0.install logger.go:60 Created wheel for setuptools-scm: filename=setuptools_scm-1.17.0-py2.py3-none-any.whl size=17696 sha256=5637d8e2d78114226c8a453c5b17e86d2c9819417df2269327ce85c9deb32aee 2024-09-02 11:00:09 DEBUG unit.etcd/0.install logger.go:60 Stored in directory: /root/.cache/pip/wheels/92/a8/73/8e32ec012bf8ff3e2eb554c25cdd28255afd956b18a4801e6c 2024-09-02 11:00:09 DEBUG unit.etcd/0.install logger.go:60 Successfully built setuptools-scm 2024-09-02 11:00:09 DEBUG unit.etcd/0.install logger.go:60 Installing collected packages: setuptools-scm 2024-09-02 11:00:09 DEBUG unit.etcd/0.install logger.go:60 Successfully installed setuptools-scm-1.17.0 2024-09-02 11:00:10 DEBUG unit.etcd/0.install logger.go:60 Looking in links: wheelhouse 2024-09-02 11:00:10 DEBUG unit.etcd/0.install logger.go:60 Processing ./wheelhouse/PyYAML-5.2.tar.gz 2024-09-02 11:00:10 DEBUG unit.etcd/0.install logger.go:60 Processing ./wheelhouse/MarkupSafe-1.1.1.tar.gz 2024-09-02 11:00:11 DEBUG unit.etcd/0.install logger.go:60 Processing ./wheelhouse/pbr-5.6.0.tar.gz 2024-09-02 11:00:11 DEBUG unit.etcd/0.install logger.go:60 Processing ./wheelhouse/pyaml-21.8.3.tar.gz 2024-09-02 11:00:11 DEBUG unit.etcd/0.install logger.go:60 Processing ./wheelhouse/Jinja2-2.10.1.tar.gz 2024-09-02 11:00:11 DEBUG unit.etcd/0.install logger.go:60 Processing ./wheelhouse/six-1.16.0.tar.gz 2024-09-02 11:00:11 DEBUG unit.etcd/0.install logger.go:60 Processing ./wheelhouse/tenacity-5.0.3.tar.gz 2024-09-02 11:00:13 DEBUG unit.etcd/0.install logger.go:60 Processing ./wheelhouse/charms.templating.jinja2-1.0.2.tar.gz 2024-09-02 11:00:13 DEBUG unit.etcd/0.install logger.go:60 Processing ./wheelhouse/charmhelpers-0.20.22.tar.gz 2024-09-02 11:00:14 DEBUG unit.etcd/0.install logger.go:60 Processing ./wheelhouse/netaddr-0.7.19.tar.gz 2024-09-02 11:00:15 DEBUG unit.etcd/0.install logger.go:60 Processing ./wheelhouse/Tempita-0.5.2.tar.gz 2024-09-02 11:00:15 DEBUG unit.etcd/0.install logger.go:60 Processing ./wheelhouse/wheel-0.33.6.tar.gz 2024-09-02 11:00:15 DEBUG unit.etcd/0.install logger.go:60 Processing ./wheelhouse/charms.reactive-1.4.1.tar.gz 2024-09-02 11:00:15 DEBUG unit.etcd/0.install logger.go:60 Building wheels for collected packages: PyYAML, MarkupSafe, pbr, pyaml, Jinja2, six, tenacity, charms.templating.jinja2, charmhelpers, netaddr, Tempita, wheel, charms.reactive 2024-09-02 11:00:15 DEBUG unit.etcd/0.install logger.go:60 Building wheel for PyYAML (setup.py): started 2024-09-02 11:00:16 DEBUG unit.etcd/0.install logger.go:60 Building wheel for PyYAML (setup.py): finished with status 'done' 2024-09-02 11:00:16 DEBUG unit.etcd/0.install logger.go:60 Created wheel for PyYAML: filename=PyYAML-5.2-cp38-cp38-linux_x86_64.whl size=44208 sha256=f5c588d1b6b676d70000d53416c7b436863169c216fd815af071808e8a8256ae 2024-09-02 11:00:16 DEBUG unit.etcd/0.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-82krtq02/wheels/eb/3b/b3/223119a22cad2fa77301a6fff89796ad60f9a55831df45ce63 2024-09-02 11:00:16 DEBUG unit.etcd/0.install logger.go:60 Building wheel for MarkupSafe (setup.py): started 2024-09-02 11:00:16 DEBUG unit.etcd/0.install logger.go:60 Building wheel for MarkupSafe (setup.py): finished with status 'done' 2024-09-02 11:00:16 DEBUG unit.etcd/0.install logger.go:60 Created wheel for MarkupSafe: filename=MarkupSafe-1.1.1-cp38-cp38-linux_x86_64.whl size=32940 sha256=110a568d6798c2cec8b79c1a488720af9f8543ae74acabc5ea9aad67f310d60e 2024-09-02 11:00:16 DEBUG unit.etcd/0.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-82krtq02/wheels/8b/e4/63/05e66ac8b6c177372bae37f0c3ab76a8ceb6e732014bcdfb2b 2024-09-02 11:00:16 DEBUG unit.etcd/0.install logger.go:60 Building wheel for pbr (setup.py): started 2024-09-02 11:00:16 DEBUG unit.etcd/0.install logger.go:60 Building wheel for pbr (setup.py): finished with status 'done' 2024-09-02 11:00:16 DEBUG unit.etcd/0.install logger.go:60 Created wheel for pbr: filename=pbr-5.6.0-py2.py3-none-any.whl size=111309 sha256=53965a3a4c72c49a463c2bf04ef5a4579f4eecf9d6ecd6ebb2bf6adc4967609a 2024-09-02 11:00:16 DEBUG unit.etcd/0.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-82krtq02/wheels/94/f2/f8/c9683ffd836c2914c93cb3dd7c3ef9ce463c797687a29e5a07 2024-09-02 11:00:16 DEBUG unit.etcd/0.install logger.go:60 Building wheel for pyaml (setup.py): started 2024-09-02 11:00:16 DEBUG unit.etcd/0.install logger.go:60 Building wheel for pyaml (setup.py): finished with status 'done' 2024-09-02 11:00:16 DEBUG unit.etcd/0.install logger.go:60 Created wheel for pyaml: filename=pyaml-21.8.3-py2.py3-none-any.whl size=17425 sha256=c03c2c9c1aab5bd4acca60c28049b0722254c942c89d83ce31b3e69508245702 2024-09-02 11:00:16 DEBUG unit.etcd/0.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-82krtq02/wheels/e7/2f/06/ca820bc54c7acffe635ca916b063267b55881692b7ea7bf7ca 2024-09-02 11:00:16 DEBUG unit.etcd/0.install logger.go:60 Building wheel for Jinja2 (setup.py): started 2024-09-02 11:00:17 DEBUG unit.etcd/0.install logger.go:60 Building wheel for Jinja2 (setup.py): finished with status 'done' 2024-09-02 11:00:17 DEBUG unit.etcd/0.install logger.go:60 Created wheel for Jinja2: filename=Jinja2-2.10.1-py2.py3-none-any.whl size=124884 sha256=29be39a1ae2cba18f46ef82d40e3df97ccd81b87041a569a7f952a82a7418c5e 2024-09-02 11:00:17 DEBUG unit.etcd/0.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-82krtq02/wheels/44/89/35/c880c8f974760590fe2d3da20a1aaf5bbdb9b468fb3a61a86f 2024-09-02 11:00:17 DEBUG unit.etcd/0.install logger.go:60 Building wheel for six (setup.py): started 2024-09-02 11:00:17 DEBUG unit.etcd/0.install logger.go:60 Building wheel for six (setup.py): finished with status 'done' 2024-09-02 11:00:17 DEBUG unit.etcd/0.install logger.go:60 Created wheel for six: filename=six-1.16.0-py2.py3-none-any.whl size=11053 sha256=d7324debaa8a3462f755decc67435875fa3aea8ae86184ed5600e87774a38caf 2024-09-02 11:00:17 DEBUG unit.etcd/0.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-82krtq02/wheels/76/e4/ad/673d64ce4f9a0589804db4a11fe54debed1e75f32b2e49bdfe 2024-09-02 11:00:17 DEBUG unit.etcd/0.install logger.go:60 Building wheel for tenacity (setup.py): started 2024-09-02 11:00:17 DEBUG unit.etcd/0.install logger.go:60 Building wheel for tenacity (setup.py): finished with status 'done' 2024-09-02 11:00:17 DEBUG unit.etcd/0.install logger.go:60 Created wheel for tenacity: filename=tenacity-5.0.3-py2.py3-none-any.whl size=38871 sha256=84ad40409166a46e027e8837f20f9a70bb910e88fce211fb2809dfeb7de651cd 2024-09-02 11:00:17 DEBUG unit.etcd/0.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-82krtq02/wheels/d1/1e/cc/334f97d27a162039bf8e70e17c8773541db0665c4ec7ec5f3c 2024-09-02 11:00:17 DEBUG unit.etcd/0.install logger.go:60 Building wheel for charms.templating.jinja2 (setup.py): started 2024-09-02 11:00:17 DEBUG unit.etcd/0.install logger.go:60 Building wheel for charms.templating.jinja2 (setup.py): finished with status 'done' 2024-09-02 11:00:17 DEBUG unit.etcd/0.install logger.go:60 Created wheel for charms.templating.jinja2: filename=charms.templating.jinja2-1.0.2-py3-none-any.whl size=4020 sha256=2e98552f2b5eec38939f2b234bfa2d2f75661768f67234529dc0f144ebe9d1b5 2024-09-02 11:00:17 DEBUG unit.etcd/0.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-82krtq02/wheels/19/c2/52/30dc260d6e19434717b7a2ddb0a47d560afda140fe32f54227 2024-09-02 11:00:17 DEBUG unit.etcd/0.install logger.go:60 Building wheel for charmhelpers (setup.py): started 2024-09-02 11:00:18 DEBUG unit.etcd/0.install logger.go:60 Building wheel for charmhelpers (setup.py): finished with status 'done' 2024-09-02 11:00:18 DEBUG unit.etcd/0.install logger.go:60 Created wheel for charmhelpers: filename=charmhelpers-0.20.22-py3-none-any.whl size=432838 sha256=203e79bd085a611d628a21d38ce4bac1efb9247c61900e47bc9bcd00c7dca789 2024-09-02 11:00:18 DEBUG unit.etcd/0.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-82krtq02/wheels/0e/09/f5/1b140bdcd0f0777a7bbafb2e023d61128dd4adba302d23fffd 2024-09-02 11:00:18 DEBUG unit.etcd/0.install logger.go:60 Building wheel for netaddr (setup.py): started 2024-09-02 11:00:18 DEBUG unit.etcd/0.install logger.go:60 Building wheel for netaddr (setup.py): finished with status 'done' 2024-09-02 11:00:18 DEBUG unit.etcd/0.install logger.go:60 Created wheel for netaddr: filename=netaddr-0.7.19-py3-none-any.whl size=1627892 sha256=af708946b3d0db34127c33cbc8d0fd94f59ce3ce9a9fa220259cfeea03770eb9 2024-09-02 11:00:18 DEBUG unit.etcd/0.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-82krtq02/wheels/19/33/fe/60c729bbaaf8dd94871039905175c9055300f8cbaf24938597 2024-09-02 11:00:18 DEBUG unit.etcd/0.install logger.go:60 Building wheel for Tempita (setup.py): started 2024-09-02 11:00:19 DEBUG unit.etcd/0.install logger.go:60 Building wheel for Tempita (setup.py): finished with status 'done' 2024-09-02 11:00:19 DEBUG unit.etcd/0.install logger.go:60 Created wheel for Tempita: filename=Tempita-0.5.2-py3-none-any.whl size=12880 sha256=d618eee290536ab409e1ed4b28e593240c5d7c7af81ef11b83f67e3ff9a4c83b 2024-09-02 11:00:19 DEBUG unit.etcd/0.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-82krtq02/wheels/0b/1e/40/9569398a67176617f0f32a24ca90d4010ab7b97d450c929874 2024-09-02 11:00:19 DEBUG unit.etcd/0.install logger.go:60 Building wheel for wheel (setup.py): started 2024-09-02 11:00:19 DEBUG unit.etcd/0.install logger.go:60 Building wheel for wheel (setup.py): finished with status 'done' 2024-09-02 11:00:19 DEBUG unit.etcd/0.install logger.go:60 Created wheel for wheel: filename=wheel-0.33.6-py2.py3-none-any.whl size=21555 sha256=7f1c04cee5833268bd5a77349e2b8193a4073dad7db9412e3bfb0dd116608ca8 2024-09-02 11:00:19 DEBUG unit.etcd/0.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-82krtq02/wheels/6b/1f/00/bf7f8f88871a75815eed7684abb8dc4ccfaefcb58fb45ef1f2 2024-09-02 11:00:19 DEBUG unit.etcd/0.install logger.go:60 Building wheel for charms.reactive (setup.py): started 2024-09-02 11:00:19 DEBUG unit.etcd/0.install logger.go:60 Building wheel for charms.reactive (setup.py): finished with status 'done' 2024-09-02 11:00:19 DEBUG unit.etcd/0.install logger.go:60 Created wheel for charms.reactive: filename=charms.reactive-1.4.1-py3-none-any.whl size=43697 sha256=49a5009b97a8dc1464141d10607d07540be1324f86f76fd6eacc72c8fefd46c9 2024-09-02 11:00:19 DEBUG unit.etcd/0.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-82krtq02/wheels/f7/44/90/770e954a28d1902e839c57a48de5a9bfb8a1bb6050f789e7db 2024-09-02 11:00:19 DEBUG unit.etcd/0.install logger.go:60 Successfully built PyYAML MarkupSafe pbr pyaml Jinja2 six tenacity charms.templating.jinja2 charmhelpers netaddr Tempita wheel charms.reactive 2024-09-02 11:00:19 DEBUG unit.etcd/0.install logger.go:60 Installing collected packages: PyYAML, MarkupSafe, pbr, pyaml, Jinja2, six, tenacity, Tempita, netaddr, charmhelpers, charms.templating.jinja2, wheel, charms.reactive 2024-09-02 11:00:20 DEBUG unit.etcd/0.install logger.go:60 Attempting uninstall: wheel 2024-09-02 11:00:20 DEBUG unit.etcd/0.install logger.go:60 Found existing installation: wheel 0.34.2 2024-09-02 11:00:20 DEBUG unit.etcd/0.install logger.go:60 Uninstalling wheel-0.34.2: 2024-09-02 11:00:20 DEBUG unit.etcd/0.install logger.go:60 Successfully uninstalled wheel-0.34.2 2024-09-02 11:00:20 DEBUG unit.etcd/0.install logger.go:60 Successfully installed Jinja2-2.10.1 MarkupSafe-1.1.1 PyYAML-5.2 Tempita-0.5.2 charmhelpers-0.20.22 charms.reactive-1.4.1 charms.templating.jinja2-1.0.2 netaddr-0.7.19 pbr-5.6.0 pyaml-21.8.3 six-1.16.0 tenacity-5.0.3 wheel-0.33.6 2024-09-02 11:00:20 INFO unit.etcd/0.juju-log server.go:316 Reactive main running for hook install 2024-09-02 11:00:20 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.changed 2024-09-02 11:00:20 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.changed.nagios_context 2024-09-02 11:00:20 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.nagios_context 2024-09-02 11:00:20 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.nagios_context 2024-09-02 11:00:20 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.changed.nagios_servicegroups 2024-09-02 11:00:20 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2024-09-02 11:00:20 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.changed.snapd_refresh 2024-09-02 11:00:20 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.snapd_refresh 2024-09-02 11:00:20 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.snapd_refresh 2024-09-02 11:00:20 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.changed.port 2024-09-02 11:00:20 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.port 2024-09-02 11:00:20 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.port 2024-09-02 11:00:20 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.changed.management_port 2024-09-02 11:00:20 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.management_port 2024-09-02 11:00:20 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.management_port 2024-09-02 11:00:20 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.changed.channel 2024-09-02 11:00:20 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.channel 2024-09-02 11:00:20 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.channel 2024-09-02 11:00:20 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.changed.bind_to_all_interfaces 2024-09-02 11:00:20 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.bind_to_all_interfaces 2024-09-02 11:00:20 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.bind_to_all_interfaces 2024-09-02 11:00:20 INFO unit.etcd/0.juju-log server.go:316 Initializing Leadership Layer (is leader) 2024-09-02 11:00:20 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag leadership.is_leader 2024-09-02 11:00:20 INFO unit.etcd/0.juju-log server.go:316 Initializing Snap Layer 2024-09-02 11:00:20 DEBUG unit.etcd/0.install logger.go:60 none 2024-09-02 11:00:20 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: starting handler dispatch, 22 flags set tracer: set flag config.changed tracer: set flag config.changed.bind_to_all_interfaces tracer: set flag config.changed.channel tracer: set flag config.changed.management_port tracer: set flag config.changed.nagios_context tracer: set flag config.changed.nagios_servicegroups tracer: set flag config.changed.port tracer: set flag config.changed.snapd_refresh tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag leadership.is_leader 2024-09-02 11:00:20 DEBUG unit.etcd/0.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-09-02 11:00:20 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: main dispatch loop, 6 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/cdk_service_kicker.py:13:install_cdk_service_kicker tracer: ++ queue handler reactive/etcd.py:131:missing_relation_notice tracer: ++ queue handler reactive/etcd.py:332:channel_changed tracer: ++ queue handler reactive/etcd.py:338:snap_install tracer: ++ queue handler reactive/etcd.py:748:force_update_nrpe_config 2024-09-02 11:00:20 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/cdk_service_kicker.py:13:install_cdk_service_kicker 2024-09-02 11:00:20 DEBUG unit.etcd/0.juju-log server.go:316 Writing file /usr/bin/cdk-service-kicker root:root 444 2024-09-02 11:00:20 DEBUG unit.etcd/0.juju-log server.go:316 Writing file /etc/systemd/system/cdk-service-kicker.service root:root 444 2024-09-02 11:00:20 WARNING unit.etcd/0.install logger.go:60 Created symlink /etc/systemd/system/multi-user.target.wants/cdk-service-kicker.service → /etc/systemd/system/cdk-service-kicker.service. 2024-09-02 11:00:21 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: set flag cdk-service-kicker.installed tracer: -- dequeue handler reactive/cdk_service_kicker.py:13:install_cdk_service_kicker 2024-09-02 11:00:21 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:131:missing_relation_notice 2024-09-02 11:00:21 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:332:channel_changed 2024-09-02 11:00:21 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: set flag etcd.rerender-config tracer: ++ queue handler reactive/etcd.py:235:rerender_config 2024-09-02 11:00:21 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:338:snap_install 2024-09-02 11:00:23 INFO unit.etcd/0.juju-log server.go:316 Installing core from store 2024-09-02 11:00:34 DEBUG unit.etcd/0.juju-log server.go:316 Installation successful cmd="['snap', 'install', '--channel=stable', 'core']" output="b'core 16-2.61.4-20240607 from Canonical** installed\n'" 2024-09-02 11:00:34 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: set flag snap.installed.core tracer: ++ queue handler reactive/snap.py:329:change_snapd_refresh 2024-09-02 11:00:35 INFO unit.etcd/0.juju-log server.go:316 Installing etcd from store 2024-09-02 11:00:53 DEBUG unit.etcd/0.juju-log server.go:316 Installation successful cmd="['snap', 'install', '--channel=3.4/stable', 'etcd']" output="b'etcd (3.4/stable) 3.4.22 from Canonical** installed\n'" 2024-09-02 11:00:53 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: set flag snap.installed.etcd tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:180:leader_config_changed tracer: ++ queue handler reactive/etcd.py:228:bind_to_all_interfaces_changed tracer: ++ queue handler reactive/etcd.py:367:add_systemd_restart_always tracer: ++ queue handler reactive/etcd.py:570:render_default_user_ssl_exports 2024-09-02 11:00:53 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:748:force_update_nrpe_config 2024-09-02 11:00:53 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-09-02 11:00:53 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-02 11:00:53 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:180:leader_config_changed 2024-09-02 11:00:53 INFO unit.etcd/0.juju-log server.go:316 Previous port: None 2024-09-02 11:00:53 INFO unit.etcd/0.juju-log server.go:316 Previous management port: None 2024-09-02 11:00:53 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:228:bind_to_all_interfaces_changed 2024-09-02 11:00:53 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:235:rerender_config 2024-09-02 11:00:53 INFO unit.etcd/0.juju-log server.go:316 Rendering config file for etcd0 2024-09-02 11:00:53 DEBUG unit.etcd/0.juju-log server.go:316 Writing file /var/snap/etcd/common/etcd.conf.yml root:root 444 2024-09-02 11:00:53 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: cleared flag etcd.rerender-config tracer: -- dequeue handler reactive/etcd.py:235:rerender_config 2024-09-02 11:00:53 DEBUG unit.etcd/0.install logger.go:60 inactive 2024-09-02 11:00:54 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:367:add_systemd_restart_always 2024-09-02 11:00:54 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: set flag etcd.service-restart.configured tracer: -- dequeue handler reactive/etcd.py:367:add_systemd_restart_always 2024-09-02 11:00:54 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:570:render_default_user_ssl_exports 2024-09-02 11:00:54 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: set flag etcd.ssl.exported tracer: -- dequeue handler reactive/etcd.py:570:render_default_user_ssl_exports 2024-09-02 11:00:54 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/snap.py:329:change_snapd_refresh 2024-09-02 11:00:54 INFO unit.etcd/0.juju-log server.go:316 Set config refresh.timer=sun1 for snap core 2024-09-02 11:00:54 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for etcd/0: ok=true 2024-09-02 11:00:57 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag snap.refresh.was-set 2024-09-02 11:00:57 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: set flag snap.refresh.set tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: -- dequeue handler reactive/snap.py:329:change_snapd_refresh 2024-09-02 11:00:57 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:488:process_snapd_timer 2024-09-02 11:00:57 INFO unit.etcd/0.juju-log server.go:316 Get config refresh.timer for snap core 2024-09-02 11:00:57 INFO unit.etcd/0.juju-log server.go:316 setting snapd_refresh timer to: sun1 2024-09-02 11:00:57 INFO unit.etcd/0.juju-log server.go:316 status-set: blocked: Missing relation to certificate authority. 2024-09-02 11:00:58 INFO juju.worker.uniter.operation runhook.go:159 ran "install" hook (via explicit, bespoke hook script) 2024-09-02 11:00:58 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run install hook" for etcd/0 2024-09-02 11:00:58 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-02 11:00:58 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/0 uniter (run install hook) 2024-09-02 11:00:58 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/0 2024-09-02 11:00:58 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "etcd/0" (leader=true) entered scope for relation "etcd:certificates easyrsa:client" 2024-09-02 11:00:58 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for etcd/0: ok=true 2024-09-02 11:00:58 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "etcd/0" (leader=true) entered scope for relation "etcd:cluster" 2024-09-02 11:00:58 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "etcd/0" (leader=true) entered scope for relation "kubernetes-master:etcd etcd:db" 2024-09-02 11:00:58 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-created (10; app: easyrsa) hook for etcd/0 2024-09-02 11:00:58 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/0 uniter (run relation-created (10; app: easyrsa) hook) 2024-09-02 11:03:49 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for etcd/0 : {8 {map[kubernetes-master/0:{0}] map[] []}} 2024-09-02 11:03:50 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/0 uniter (run relation-created (10; app: easyrsa) hook) 2024-09-02 11:03:50 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-created (10; app: easyrsa) hook" for etcd/0 2024-09-02 11:03:51 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-created (10; app: easyrsa) hook" for etcd/0 2024-09-02 11:03:51 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running certificates-relation-created hook 2024-09-02 11:03:51 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-0/agent.socket } 2024-09-02 11:03:51 INFO unit.etcd/0.juju-log server.go:316 certificates:10: Reactive main running for hook certificates-relation-created 2024-09-02 11:03:51 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:131:missing_relation_notice tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer 2024-09-02 11:03:51 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer: set flag config.default.nagios_context 2024-09-02 11:03:51 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer: set flag config.default.nagios_servicegroups 2024-09-02 11:03:51 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer: set flag config.set.snapd_refresh 2024-09-02 11:03:51 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer: set flag config.default.snapd_refresh 2024-09-02 11:03:51 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer: set flag config.set.port 2024-09-02 11:03:51 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer: set flag config.default.port 2024-09-02 11:03:51 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer: set flag config.set.management_port 2024-09-02 11:03:51 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer: set flag config.default.management_port 2024-09-02 11:03:51 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer: set flag config.set.channel 2024-09-02 11:03:51 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer: set flag config.default.channel 2024-09-02 11:03:51 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer: set flag config.set.bind_to_all_interfaces 2024-09-02 11:03:51 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer: set flag config.default.bind_to_all_interfaces 2024-09-02 11:03:51 INFO unit.etcd/0.juju-log server.go:316 certificates:10: Initializing Leadership Layer (is leader) 2024-09-02 11:03:51 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer: set flag leadership.changed.snapd_refresh 2024-09-02 11:03:52 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer: set flag leadership.set.snapd_refresh 2024-09-02 11:03:52 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer: set flag leadership.changed.token 2024-09-02 11:03:52 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer: set flag leadership.set.token 2024-09-02 11:03:52 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer: set flag leadership.changed 2024-09-02 11:03:52 INFO unit.etcd/0.juju-log server.go:316 certificates:10: Initializing Snap Layer 2024-09-02 11:03:52 DEBUG unit.etcd/0.certificates-relation-created logger.go:60 none 2024-09-02 11:03:52 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer> tracer: starting handler dispatch, 26 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag leadership.changed tracer: set flag leadership.changed.snapd_refresh tracer: set flag leadership.changed.token tracer: set flag leadership.is_leader tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set 2024-09-02 11:03:52 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer: hooks phase, 0 handlers queued 2024-09-02 11:03:52 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer> tracer: main dispatch loop, 4 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:131:missing_relation_notice tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer 2024-09-02 11:03:52 INFO unit.etcd/0.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-02 11:03:52 INFO unit.etcd/0.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/etcd.py:131:missing_relation_notice 2024-09-02 11:03:52 INFO unit.etcd/0.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/etcd.py:488:process_snapd_timer 2024-09-02 11:03:52 INFO unit.etcd/0.juju-log server.go:316 certificates:10: Get config refresh.timer for snap core 2024-09-02 11:03:52 INFO unit.etcd/0.juju-log server.go:316 certificates:10: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-09-02 11:03:52 INFO unit.etcd/0.juju-log server.go:316 certificates:10: status-set: blocked: Missing relation to certificate authority. 2024-09-02 11:03:52 INFO juju.worker.uniter.operation runhook.go:159 ran "certificates-relation-created" hook (via explicit, bespoke hook script) 2024-09-02 11:03:52 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-created (10; app: easyrsa) hook" for etcd/0 2024-09-02 11:03:52 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-02 11:03:52 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/0 uniter (run relation-created (10; app: easyrsa) hook) 2024-09-02 11:03:52 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/0 2024-09-02 11:03:52 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-created (0; app: etcd) hook for etcd/0 2024-09-02 11:03:52 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/0 uniter (run relation-created (0; app: etcd) hook) 2024-09-02 11:03:57 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for etcd/0 2024-09-02 11:05:11 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/0 uniter (run relation-created (0; app: etcd) hook) 2024-09-02 11:05:11 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-created (0; app: etcd) hook" for etcd/0 2024-09-02 11:05:11 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-created (0; app: etcd) hook" for etcd/0 2024-09-02 11:05:11 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running cluster-relation-created hook 2024-09-02 11:05:11 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-0/agent.socket } 2024-09-02 11:05:11 INFO unit.etcd/0.juju-log server.go:316 cluster:0: Reactive main running for hook cluster-relation-created 2024-09-02 11:05:11 DEBUG unit.etcd/0.juju-log server.go:316 cluster:0: tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:131:missing_relation_notice tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer 2024-09-02 11:05:12 DEBUG unit.etcd/0.juju-log server.go:316 cluster:0: tracer: set flag config.default.nagios_context 2024-09-02 11:05:12 DEBUG unit.etcd/0.juju-log server.go:316 cluster:0: tracer: set flag config.default.nagios_servicegroups 2024-09-02 11:05:12 DEBUG unit.etcd/0.juju-log server.go:316 cluster:0: tracer: set flag config.set.snapd_refresh 2024-09-02 11:05:12 DEBUG unit.etcd/0.juju-log server.go:316 cluster:0: tracer: set flag config.default.snapd_refresh 2024-09-02 11:05:12 DEBUG unit.etcd/0.juju-log server.go:316 cluster:0: tracer: set flag config.set.port 2024-09-02 11:05:12 DEBUG unit.etcd/0.juju-log server.go:316 cluster:0: tracer: set flag config.default.port 2024-09-02 11:05:12 DEBUG unit.etcd/0.juju-log server.go:316 cluster:0: tracer: set flag config.set.management_port 2024-09-02 11:05:12 DEBUG unit.etcd/0.juju-log server.go:316 cluster:0: tracer: set flag config.default.management_port 2024-09-02 11:05:12 DEBUG unit.etcd/0.juju-log server.go:316 cluster:0: tracer: set flag config.set.channel 2024-09-02 11:05:12 DEBUG unit.etcd/0.juju-log server.go:316 cluster:0: tracer: set flag config.default.channel 2024-09-02 11:05:12 DEBUG unit.etcd/0.juju-log server.go:316 cluster:0: tracer: set flag config.set.bind_to_all_interfaces 2024-09-02 11:05:12 DEBUG unit.etcd/0.juju-log server.go:316 cluster:0: tracer: set flag config.default.bind_to_all_interfaces 2024-09-02 11:05:12 INFO unit.etcd/0.juju-log server.go:316 cluster:0: Initializing Leadership Layer (is leader) 2024-09-02 11:05:12 DEBUG unit.etcd/0.juju-log server.go:316 cluster:0: tracer: cleared flag leadership.changed.snapd_refresh 2024-09-02 11:05:12 DEBUG unit.etcd/0.juju-log server.go:316 cluster:0: tracer: cleared flag leadership.changed.token 2024-09-02 11:05:12 DEBUG unit.etcd/0.juju-log server.go:316 cluster:0: tracer: cleared flag leadership.changed 2024-09-02 11:05:12 INFO unit.etcd/0.juju-log server.go:316 cluster:0: Initializing Snap Layer 2024-09-02 11:05:12 DEBUG unit.etcd/0.cluster-relation-created logger.go:60 none 2024-09-02 11:05:12 DEBUG unit.etcd/0.juju-log server.go:316 cluster:0: tracer> tracer: starting handler dispatch, 23 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag leadership.is_leader tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set 2024-09-02 11:05:12 DEBUG unit.etcd/0.juju-log server.go:316 cluster:0: tracer: hooks phase, 0 handlers queued 2024-09-02 11:05:12 DEBUG unit.etcd/0.juju-log server.go:316 cluster:0: tracer> tracer: main dispatch loop, 4 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:131:missing_relation_notice tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer 2024-09-02 11:05:12 INFO unit.etcd/0.juju-log server.go:316 cluster:0: Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-02 11:05:13 INFO unit.etcd/0.juju-log server.go:316 cluster:0: Invoking reactive handler: reactive/etcd.py:131:missing_relation_notice 2024-09-02 11:05:13 INFO unit.etcd/0.juju-log server.go:316 cluster:0: Invoking reactive handler: reactive/etcd.py:488:process_snapd_timer 2024-09-02 11:05:13 INFO unit.etcd/0.juju-log server.go:316 cluster:0: Get config refresh.timer for snap core 2024-09-02 11:05:13 INFO unit.etcd/0.juju-log server.go:316 cluster:0: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-09-02 11:05:13 INFO unit.etcd/0.juju-log server.go:316 cluster:0: status-set: blocked: Missing relation to certificate authority. 2024-09-02 11:05:13 INFO juju.worker.uniter.operation runhook.go:159 ran "cluster-relation-created" hook (via explicit, bespoke hook script) 2024-09-02 11:05:13 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-created (0; app: etcd) hook" for etcd/0 2024-09-02 11:05:13 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-02 11:05:13 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/0 uniter (run relation-created (0; app: etcd) hook) 2024-09-02 11:05:13 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/0 2024-09-02 11:05:13 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-created (8; app: kubernetes-master) hook for etcd/0 2024-09-02 11:05:13 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/0 uniter (run relation-created (8; app: kubernetes-master) hook) 2024-09-02 11:05:22 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/0 uniter (run relation-created (8; app: kubernetes-master) hook) 2024-09-02 11:05:22 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-created (8; app: kubernetes-master) hook" for etcd/0 2024-09-02 11:05:22 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-created (8; app: kubernetes-master) hook" for etcd/0 2024-09-02 11:05:22 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running db-relation-created hook 2024-09-02 11:05:22 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-0/agent.socket } 2024-09-02 11:05:23 INFO unit.etcd/0.juju-log server.go:316 db:8: Reactive main running for hook db-relation-created 2024-09-02 11:05:23 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:131:missing_relation_notice tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer 2024-09-02 11:05:23 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer: set flag config.default.nagios_context 2024-09-02 11:05:23 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer: set flag config.default.nagios_servicegroups 2024-09-02 11:05:23 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer: set flag config.set.snapd_refresh 2024-09-02 11:05:23 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer: set flag config.default.snapd_refresh 2024-09-02 11:05:23 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer: set flag config.set.port 2024-09-02 11:05:23 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer: set flag config.default.port 2024-09-02 11:05:23 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer: set flag config.set.management_port 2024-09-02 11:05:23 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer: set flag config.default.management_port 2024-09-02 11:05:23 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer: set flag config.set.channel 2024-09-02 11:05:23 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer: set flag config.default.channel 2024-09-02 11:05:23 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer: set flag config.set.bind_to_all_interfaces 2024-09-02 11:05:23 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer: set flag config.default.bind_to_all_interfaces 2024-09-02 11:05:23 INFO unit.etcd/0.juju-log server.go:316 db:8: Initializing Leadership Layer (is leader) 2024-09-02 11:05:23 INFO unit.etcd/0.juju-log server.go:316 db:8: Initializing Snap Layer 2024-09-02 11:05:23 DEBUG unit.etcd/0.db-relation-created logger.go:60 none 2024-09-02 11:05:23 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer> tracer: starting handler dispatch, 23 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag leadership.is_leader tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set 2024-09-02 11:05:23 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer: hooks phase, 0 handlers queued 2024-09-02 11:05:23 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer> tracer: main dispatch loop, 4 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:131:missing_relation_notice tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer 2024-09-02 11:05:23 INFO unit.etcd/0.juju-log server.go:316 db:8: Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-02 11:05:23 INFO unit.etcd/0.juju-log server.go:316 db:8: Invoking reactive handler: reactive/etcd.py:131:missing_relation_notice 2024-09-02 11:05:23 INFO unit.etcd/0.juju-log server.go:316 db:8: Invoking reactive handler: reactive/etcd.py:488:process_snapd_timer 2024-09-02 11:05:23 INFO unit.etcd/0.juju-log server.go:316 db:8: Get config refresh.timer for snap core 2024-09-02 11:05:23 INFO unit.etcd/0.juju-log server.go:316 db:8: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-09-02 11:05:23 INFO unit.etcd/0.juju-log server.go:316 db:8: status-set: blocked: Missing relation to certificate authority. 2024-09-02 11:05:23 INFO juju.worker.uniter.operation runhook.go:159 ran "db-relation-created" hook (via explicit, bespoke hook script) 2024-09-02 11:05:23 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-created (8; app: kubernetes-master) hook" for etcd/0 2024-09-02 11:05:23 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-02 11:05:23 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/0 uniter (run relation-created (8; app: kubernetes-master) hook) 2024-09-02 11:05:23 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/0 2024-09-02 11:05:23 DEBUG juju.worker.uniter.operation executor.go:85 running operation accept leadership for etcd/0 2024-09-02 11:05:23 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "accept leadership" for etcd/0 2024-09-02 11:05:23 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "accept leadership" for etcd/0 2024-09-02 11:05:23 INFO juju.worker.uniter resolver.go:159 found queued "leader-elected" hook 2024-09-02 11:05:23 DEBUG juju.worker.uniter.operation executor.go:85 running operation run leader-elected hook for etcd/0 2024-09-02 11:05:23 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/0 uniter (run leader-elected hook) 2024-09-02 11:05:36 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/0 uniter (run leader-elected hook) 2024-09-02 11:05:36 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run leader-elected hook" for etcd/0 2024-09-02 11:05:36 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run leader-elected hook" for etcd/0 2024-09-02 11:05:36 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running leader-elected hook 2024-09-02 11:05:36 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-0/agent.socket } 2024-09-02 11:05:36 INFO unit.etcd/0.juju-log server.go:316 Reactive main running for hook leader-elected 2024-09-02 11:05:36 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:131:missing_relation_notice tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer 2024-09-02 11:05:36 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.nagios_context 2024-09-02 11:05:36 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2024-09-02 11:05:36 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.snapd_refresh 2024-09-02 11:05:36 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.snapd_refresh 2024-09-02 11:05:36 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.port 2024-09-02 11:05:36 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.port 2024-09-02 11:05:36 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.management_port 2024-09-02 11:05:36 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.management_port 2024-09-02 11:05:36 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.channel 2024-09-02 11:05:36 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.channel 2024-09-02 11:05:36 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.bind_to_all_interfaces 2024-09-02 11:05:36 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.bind_to_all_interfaces 2024-09-02 11:05:36 INFO unit.etcd/0.juju-log server.go:316 Initializing Leadership Layer (is leader) 2024-09-02 11:05:36 INFO unit.etcd/0.juju-log server.go:316 Initializing Snap Layer 2024-09-02 11:05:36 DEBUG unit.etcd/0.leader-elected logger.go:60 none 2024-09-02 11:05:36 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: starting handler dispatch, 23 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag leadership.is_leader tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set 2024-09-02 11:05:36 DEBUG unit.etcd/0.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-09-02 11:05:36 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: main dispatch loop, 4 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:131:missing_relation_notice tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer 2024-09-02 11:05:36 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-02 11:05:36 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:131:missing_relation_notice 2024-09-02 11:05:36 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:488:process_snapd_timer 2024-09-02 11:05:36 INFO unit.etcd/0.juju-log server.go:316 Get config refresh.timer for snap core 2024-09-02 11:05:36 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-09-02 11:05:36 INFO unit.etcd/0.juju-log server.go:316 status-set: blocked: Missing relation to certificate authority. 2024-09-02 11:05:37 INFO juju.worker.uniter.operation runhook.go:159 ran "leader-elected" hook (via explicit, bespoke hook script) 2024-09-02 11:05:37 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run leader-elected hook" for etcd/0 2024-09-02 11:05:37 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-02 11:05:37 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/0 uniter (run leader-elected hook) 2024-09-02 11:05:37 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/0 2024-09-02 11:05:37 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-02 11:05:37 DEBUG juju.worker.uniter.operation executor.go:85 running operation run config-changed hook for etcd/0 2024-09-02 11:05:37 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/0 uniter (run config-changed hook) 2024-09-02 11:05:47 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/0 uniter (run config-changed hook) 2024-09-02 11:05:47 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run config-changed hook" for etcd/0 2024-09-02 11:05:47 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run config-changed hook" for etcd/0 2024-09-02 11:05:47 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running config-changed hook 2024-09-02 11:05:47 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-0/agent.socket } 2024-09-02 11:05:48 INFO unit.etcd/0.juju-log server.go:316 Reactive main running for hook config-changed 2024-09-02 11:05:48 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:131:missing_relation_notice tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer 2024-09-02 11:05:48 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.nagios_context 2024-09-02 11:05:48 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2024-09-02 11:05:48 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.snapd_refresh 2024-09-02 11:05:48 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.snapd_refresh 2024-09-02 11:05:48 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.port 2024-09-02 11:05:48 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.port 2024-09-02 11:05:48 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.management_port 2024-09-02 11:05:48 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.management_port 2024-09-02 11:05:48 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.channel 2024-09-02 11:05:48 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.channel 2024-09-02 11:05:48 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.bind_to_all_interfaces 2024-09-02 11:05:48 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.bind_to_all_interfaces 2024-09-02 11:05:48 INFO unit.etcd/0.juju-log server.go:316 Initializing Leadership Layer (is leader) 2024-09-02 11:05:48 INFO unit.etcd/0.juju-log server.go:316 Initializing Snap Layer 2024-09-02 11:05:48 DEBUG unit.etcd/0.config-changed logger.go:60 none 2024-09-02 11:05:48 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: starting handler dispatch, 23 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag leadership.is_leader tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set 2024-09-02 11:05:48 DEBUG unit.etcd/0.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-09-02 11:05:48 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: main dispatch loop, 4 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:131:missing_relation_notice tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer 2024-09-02 11:05:48 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-02 11:05:48 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:131:missing_relation_notice 2024-09-02 11:05:48 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:488:process_snapd_timer 2024-09-02 11:05:48 INFO unit.etcd/0.juju-log server.go:316 Get config refresh.timer for snap core 2024-09-02 11:05:48 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-09-02 11:05:48 INFO unit.etcd/0.juju-log server.go:316 status-set: blocked: Missing relation to certificate authority. 2024-09-02 11:05:49 INFO juju.worker.uniter.operation runhook.go:159 ran "config-changed" hook (via explicit, bespoke hook script) 2024-09-02 11:05:52 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run config-changed hook" for etcd/0 2024-09-02 11:05:52 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-02 11:05:52 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/0 uniter (run config-changed hook) 2024-09-02 11:05:52 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/0 2024-09-02 11:05:52 INFO juju.worker.uniter resolver.go:159 found queued "start" hook 2024-09-02 11:05:52 DEBUG juju.worker.uniter.operation executor.go:85 running operation run start hook for etcd/0 2024-09-02 11:05:52 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/0 uniter (run start hook) 2024-09-02 11:06:05 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/0 uniter (run start hook) 2024-09-02 11:06:05 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run start hook" for etcd/0 2024-09-02 11:06:05 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run start hook" for etcd/0 2024-09-02 11:06:05 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running start hook 2024-09-02 11:06:05 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-0/agent.socket } 2024-09-02 11:06:05 INFO unit.etcd/0.juju-log server.go:316 Reactive main running for hook start 2024-09-02 11:06:05 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:131:missing_relation_notice tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer 2024-09-02 11:06:05 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.nagios_context 2024-09-02 11:06:05 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2024-09-02 11:06:05 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.snapd_refresh 2024-09-02 11:06:05 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.snapd_refresh 2024-09-02 11:06:05 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.port 2024-09-02 11:06:05 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.port 2024-09-02 11:06:05 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.management_port 2024-09-02 11:06:05 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.management_port 2024-09-02 11:06:05 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.channel 2024-09-02 11:06:05 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.channel 2024-09-02 11:06:05 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.bind_to_all_interfaces 2024-09-02 11:06:05 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.bind_to_all_interfaces 2024-09-02 11:06:05 INFO unit.etcd/0.juju-log server.go:316 Initializing Leadership Layer (is leader) 2024-09-02 11:06:05 INFO unit.etcd/0.juju-log server.go:316 Initializing Snap Layer 2024-09-02 11:06:05 DEBUG unit.etcd/0.start logger.go:60 none 2024-09-02 11:06:05 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: starting handler dispatch, 23 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag leadership.is_leader tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set 2024-09-02 11:06:05 DEBUG unit.etcd/0.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-09-02 11:06:05 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: main dispatch loop, 4 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:131:missing_relation_notice tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer 2024-09-02 11:06:05 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-02 11:06:05 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:131:missing_relation_notice 2024-09-02 11:06:05 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:488:process_snapd_timer 2024-09-02 11:06:05 INFO unit.etcd/0.juju-log server.go:316 Get config refresh.timer for snap core 2024-09-02 11:06:05 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-09-02 11:06:05 INFO unit.etcd/0.juju-log server.go:316 status-set: blocked: Missing relation to certificate authority. 2024-09-02 11:06:06 INFO juju.worker.uniter.operation runhook.go:159 ran "start" hook (via explicit, bespoke hook script) 2024-09-02 11:06:06 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run start hook" for etcd/0 2024-09-02 11:06:06 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-02 11:06:06 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/0 uniter (run start hook) 2024-09-02 11:06:06 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/0 2024-09-02 11:06:06 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-02 11:06:06 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-joined (10; unit: easyrsa/0) hook for etcd/0 2024-09-02 11:06:06 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/0 uniter (run relation-joined (10; unit: easyrsa/0) hook) 2024-09-02 11:06:06 DEBUG juju.worker.dependency engine.go:580 "metric-collect" manifold worker started at 2024-09-02 11:06:06.2169206 +0000 UTC 2024-09-02 11:06:18 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/0 uniter (run relation-joined (10; unit: easyrsa/0) hook) 2024-09-02 11:06:18 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-joined (10; unit: easyrsa/0) hook" for etcd/0 2024-09-02 11:06:18 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-joined (10; unit: easyrsa/0) hook" for etcd/0 2024-09-02 11:06:18 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running certificates-relation-joined hook for easyrsa/0 2024-09-02 11:06:19 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-0/agent.socket } 2024-09-02 11:06:19 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for etcd/0 : {10 {map[easyrsa/0:{1}] map[] []}} 2024-09-02 11:06:19 INFO unit.etcd/0.juju-log server.go:316 certificates:10: Reactive main running for hook certificates-relation-joined 2024-09-02 11:06:19 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer> tracer: set flag endpoint.certificates.joined tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:131:missing_relation_notice tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer 2024-09-02 11:06:19 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer: set flag endpoint.certificates.changed 2024-09-02 11:06:19 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer: set flag endpoint.certificates.changed.ca 2024-09-02 11:06:19 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer: set flag endpoint.certificates.changed.client.cert 2024-09-02 11:06:19 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer: set flag endpoint.certificates.changed.client.key 2024-09-02 11:06:19 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer: set flag endpoint.certificates.changed.egress-subnets 2024-09-02 11:06:19 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer: set flag endpoint.certificates.changed.ingress-address 2024-09-02 11:06:19 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer: set flag endpoint.certificates.changed.private-address 2024-09-02 11:06:19 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer: set flag config.set.nagios_context 2024-09-02 11:06:19 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer: set flag config.default.nagios_context 2024-09-02 11:06:19 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer: set flag config.default.nagios_servicegroups 2024-09-02 11:06:19 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer: set flag config.set.snapd_refresh 2024-09-02 11:06:19 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer: set flag config.default.snapd_refresh 2024-09-02 11:06:19 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer: set flag config.set.port 2024-09-02 11:06:19 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer: set flag config.default.port 2024-09-02 11:06:19 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer: set flag config.set.management_port 2024-09-02 11:06:19 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer: set flag config.default.management_port 2024-09-02 11:06:19 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer: set flag config.set.channel 2024-09-02 11:06:19 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer: set flag config.default.channel 2024-09-02 11:06:19 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer: set flag config.set.bind_to_all_interfaces 2024-09-02 11:06:19 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer: set flag config.default.bind_to_all_interfaces 2024-09-02 11:06:19 INFO unit.etcd/0.juju-log server.go:316 certificates:10: Initializing Leadership Layer (is leader) 2024-09-02 11:06:19 INFO unit.etcd/0.juju-log server.go:316 certificates:10: Initializing Snap Layer 2024-09-02 11:06:20 DEBUG unit.etcd/0.certificates-relation-joined logger.go:60 none 2024-09-02 11:06:20 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer> tracer: starting handler dispatch, 31 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag leadership.is_leader tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set 2024-09-02 11:06:20 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer: hooks phase, 0 handlers queued 2024-09-02 11:06:20 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer> tracer: main dispatch loop, 4 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:131:missing_relation_notice tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer 2024-09-02 11:06:20 INFO unit.etcd/0.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-02 11:06:20 INFO unit.etcd/0.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/etcd.py:131:missing_relation_notice 2024-09-02 11:06:20 INFO unit.etcd/0.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/etcd.py:488:process_snapd_timer 2024-09-02 11:06:20 INFO unit.etcd/0.juju-log server.go:316 certificates:10: Get config refresh.timer for snap core 2024-09-02 11:06:20 INFO unit.etcd/0.juju-log server.go:316 certificates:10: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-02 11:06:20 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer> tracer: set flag certificates.available tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: -- dequeue handler reactive/etcd.py:131:missing_relation_notice 2024-09-02 11:06:20 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer> tracer: set flag certificates.ca.available tracer: ++ queue handler reactive/tls_client.py:18:store_ca 2024-09-02 11:06:20 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer: set flag certificates.ca.changed 2024-09-02 11:06:20 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer> tracer: set flag certificates.client.cert.available tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-02 11:06:20 INFO unit.etcd/0.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-02 11:06:20 INFO unit.etcd/0.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/tls_client.py:18:store_ca 2024-09-02 11:06:20 INFO unit.etcd/0.juju-log server.go:316 certificates:10: Writing CA certificate to /var/snap/etcd/common/ca.crt 2024-09-02 11:06:20 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer: set flag tls_client.ca.written 2024-09-02 11:06:20 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer: set flag tls_client.ca.saved 2024-09-02 11:06:20 INFO unit.etcd/0.juju-log server.go:316 certificates:10: Writing CA certificate to /usr/local/share/ca-certificates/etcd.crt 2024-09-02 11:06:20 DEBUG unit.etcd/0.certificates-relation-joined logger.go:60 Updating certificates in /etc/ssl/certs... 2024-09-02 11:06:20 WARNING unit.etcd/0.certificates-relation-joined logger.go:60 rehash: warning: skipping ca-certificates.crt,it does not contain exactly one certificate or CRL 2024-09-02 11:06:20 WARNING unit.etcd/0.certificates-relation-joined logger.go:60 rehash: warning: skipping duplicate certificate in etcd.pem 2024-09-02 11:06:20 DEBUG unit.etcd/0.certificates-relation-joined logger.go:60 1 added, 0 removed; done. 2024-09-02 11:06:20 DEBUG unit.etcd/0.certificates-relation-joined logger.go:60 Running hooks in /etc/ca-certificates/update.d... 2024-09-02 11:06:20 DEBUG unit.etcd/0.certificates-relation-joined logger.go:60 done. 2024-09-02 11:06:20 INFO unit.etcd/0.juju-log server.go:316 certificates:10: Generated ca-certificates.crt for etcd 2024-09-02 11:06:20 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer: set flag tls_client.ca_installed 2024-09-02 11:06:20 INFO unit.etcd/0.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-02 11:06:20 INFO unit.etcd/0.juju-log server.go:316 certificates:10: Writing client certificate to /var/snap/etcd/common/client.crt 2024-09-02 11:06:20 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer: set flag tls_client.client.certificate.written 2024-09-02 11:06:21 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer: set flag tls_client.client.certificate.saved 2024-09-02 11:06:21 INFO unit.etcd/0.juju-log server.go:316 certificates:10: Writing client key to /var/snap/etcd/common/client.key 2024-09-02 11:06:21 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer: set flag tls_client.client.key.saved 2024-09-02 11:06:21 INFO unit.etcd/0.juju-log server.go:316 certificates:10: status-set: blocked: Missing relation to certificate authority. 2024-09-02 11:06:21 INFO juju.worker.uniter.operation runhook.go:159 ran "certificates-relation-joined" hook (via explicit, bespoke hook script) 2024-09-02 11:06:21 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-joined (10; unit: easyrsa/0) hook" for etcd/0 2024-09-02 11:06:21 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-02 11:06:21 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/0 uniter (run relation-joined (10; unit: easyrsa/0) hook) 2024-09-02 11:06:21 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/0 2024-09-02 11:06:21 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-02 11:06:21 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (10; unit: easyrsa/0) hook for etcd/0 2024-09-02 11:06:21 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/0 uniter (run relation-changed (10; unit: easyrsa/0) hook) 2024-09-02 11:06:32 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/0 uniter (run relation-changed (10; unit: easyrsa/0) hook) 2024-09-02 11:06:32 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (10; unit: easyrsa/0) hook" for etcd/0 2024-09-02 11:06:32 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (10; unit: easyrsa/0) hook" for etcd/0 2024-09-02 11:06:32 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running certificates-relation-changed hook for easyrsa/0 2024-09-02 11:06:32 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-0/agent.socket } 2024-09-02 11:06:32 INFO unit.etcd/0.juju-log server.go:316 certificates:10: Reactive main running for hook certificates-relation-changed 2024-09-02 11:06:32 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-02 11:06:32 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer: set flag config.default.nagios_context 2024-09-02 11:06:32 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer: set flag config.default.nagios_servicegroups 2024-09-02 11:06:32 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer: set flag config.set.snapd_refresh 2024-09-02 11:06:32 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer: set flag config.default.snapd_refresh 2024-09-02 11:06:32 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer: set flag config.set.port 2024-09-02 11:06:32 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer: set flag config.default.port 2024-09-02 11:06:32 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer: set flag config.set.management_port 2024-09-02 11:06:32 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer: set flag config.default.management_port 2024-09-02 11:06:32 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer: set flag config.set.channel 2024-09-02 11:06:32 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer: set flag config.default.channel 2024-09-02 11:06:32 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer: set flag config.set.bind_to_all_interfaces 2024-09-02 11:06:32 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer: set flag config.default.bind_to_all_interfaces 2024-09-02 11:06:32 INFO unit.etcd/0.juju-log server.go:316 certificates:10: Initializing Leadership Layer (is leader) 2024-09-02 11:06:32 INFO unit.etcd/0.juju-log server.go:316 certificates:10: Initializing Snap Layer 2024-09-02 11:06:32 DEBUG unit.etcd/0.certificates-relation-changed logger.go:60 none 2024-09-02 11:06:32 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer> tracer: starting handler dispatch, 41 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.ca.available tracer: set flag certificates.ca.changed tracer: set flag certificates.client.cert.available tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag leadership.is_leader tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca.written tracer: set flag tls_client.ca_installed tracer: set flag tls_client.client.certificate.saved tracer: set flag tls_client.client.certificate.written tracer: set flag tls_client.client.key.saved 2024-09-02 11:06:32 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer: hooks phase, 0 handlers queued 2024-09-02 11:06:32 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer> tracer: main dispatch loop, 6 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-02 11:06:32 INFO unit.etcd/0.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-02 11:06:33 INFO unit.etcd/0.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-02 11:06:33 INFO unit.etcd/0.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/etcd.py:488:process_snapd_timer 2024-09-02 11:06:33 INFO unit.etcd/0.juju-log server.go:316 certificates:10: Get config refresh.timer for snap core 2024-09-02 11:06:33 INFO unit.etcd/0.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/tls_client.py:18:store_ca 2024-09-02 11:06:33 INFO unit.etcd/0.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-02 11:06:33 INFO unit.etcd/0.juju-log server.go:316 certificates:10: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-02 11:06:33 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer: cleared flag certificates.ca.changed 2024-09-02 11:06:33 INFO juju.worker.uniter.operation runhook.go:159 ran "certificates-relation-changed" hook (via explicit, bespoke hook script) 2024-09-02 11:06:33 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (10; unit: easyrsa/0) hook" for etcd/0 2024-09-02 11:06:33 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-02 11:06:33 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/0 uniter (run relation-changed (10; unit: easyrsa/0) hook) 2024-09-02 11:06:33 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/0 2024-09-02 11:06:33 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-02 11:06:33 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-joined (8; unit: kubernetes-master/0) hook for etcd/0 2024-09-02 11:06:33 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/0 uniter (run relation-joined (8; unit: kubernetes-master/0) hook) 2024-09-02 11:06:45 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/0 uniter (run relation-joined (8; unit: kubernetes-master/0) hook) 2024-09-02 11:06:45 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-joined (8; unit: kubernetes-master/0) hook" for etcd/0 2024-09-02 11:06:45 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-joined (8; unit: kubernetes-master/0) hook" for etcd/0 2024-09-02 11:06:45 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running db-relation-joined hook for kubernetes-master/0 2024-09-02 11:06:45 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-0/agent.socket } 2024-09-02 11:06:46 INFO unit.etcd/0.juju-log server.go:316 db:8: Reactive main running for hook db-relation-joined 2024-09-02 11:06:46 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-02 11:06:46 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer: set flag config.default.nagios_context 2024-09-02 11:06:46 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer: set flag config.default.nagios_servicegroups 2024-09-02 11:06:46 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer: set flag config.set.snapd_refresh 2024-09-02 11:06:46 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer: set flag config.default.snapd_refresh 2024-09-02 11:06:46 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer: set flag config.set.port 2024-09-02 11:06:46 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer: set flag config.default.port 2024-09-02 11:06:46 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer: set flag config.set.management_port 2024-09-02 11:06:46 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer: set flag config.default.management_port 2024-09-02 11:06:46 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer: set flag config.set.channel 2024-09-02 11:06:46 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer: set flag config.default.channel 2024-09-02 11:06:46 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer: set flag config.set.bind_to_all_interfaces 2024-09-02 11:06:46 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer: set flag config.default.bind_to_all_interfaces 2024-09-02 11:06:46 INFO unit.etcd/0.juju-log server.go:316 db:8: Initializing Leadership Layer (is leader) 2024-09-02 11:06:46 INFO unit.etcd/0.juju-log server.go:316 db:8: Initializing Snap Layer 2024-09-02 11:06:46 DEBUG unit.etcd/0.db-relation-joined logger.go:60 none 2024-09-02 11:06:46 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer> tracer: starting handler dispatch, 40 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.ca.available tracer: set flag certificates.client.cert.available tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag leadership.is_leader tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca.written tracer: set flag tls_client.ca_installed tracer: set flag tls_client.client.certificate.saved tracer: set flag tls_client.client.certificate.written tracer: set flag tls_client.client.key.saved 2024-09-02 11:06:46 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler hooks/relations/etcd/provides.py:22:joined_or_changed 2024-09-02 11:06:46 INFO unit.etcd/0.juju-log server.go:316 db:8: Invoking reactive handler: hooks/relations/etcd/provides.py:22:joined_or_changed 2024-09-02 11:06:46 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer: set flag db.connected 2024-09-02 11:06:46 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer> tracer: main dispatch loop, 6 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-02 11:06:46 INFO unit.etcd/0.juju-log server.go:316 db:8: Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-02 11:06:46 INFO unit.etcd/0.juju-log server.go:316 db:8: Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-02 11:06:46 INFO unit.etcd/0.juju-log server.go:316 db:8: Invoking reactive handler: reactive/etcd.py:488:process_snapd_timer 2024-09-02 11:06:46 INFO unit.etcd/0.juju-log server.go:316 db:8: Get config refresh.timer for snap core 2024-09-02 11:06:46 INFO unit.etcd/0.juju-log server.go:316 db:8: Invoking reactive handler: reactive/tls_client.py:18:store_ca 2024-09-02 11:06:46 INFO unit.etcd/0.juju-log server.go:316 db:8: Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-02 11:06:46 INFO unit.etcd/0.juju-log server.go:316 db:8: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-02 11:06:46 INFO juju.worker.uniter.operation runhook.go:159 ran "db-relation-joined" hook (via explicit, bespoke hook script) 2024-09-02 11:06:47 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-joined (8; unit: kubernetes-master/0) hook" for etcd/0 2024-09-02 11:06:47 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-02 11:06:47 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/0 uniter (run relation-joined (8; unit: kubernetes-master/0) hook) 2024-09-02 11:06:47 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/0 2024-09-02 11:06:47 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-02 11:06:47 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (8; unit: kubernetes-master/0) hook for etcd/0 2024-09-02 11:06:47 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/0 uniter (run relation-changed (8; unit: kubernetes-master/0) hook) 2024-09-02 11:06:57 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/0 uniter (run relation-changed (8; unit: kubernetes-master/0) hook) 2024-09-02 11:06:57 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (8; unit: kubernetes-master/0) hook" for etcd/0 2024-09-02 11:06:57 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (8; unit: kubernetes-master/0) hook" for etcd/0 2024-09-02 11:06:57 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running db-relation-changed hook for kubernetes-master/0 2024-09-02 11:06:57 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-0/agent.socket } 2024-09-02 11:06:57 INFO unit.etcd/0.juju-log server.go:316 db:8: Reactive main running for hook db-relation-changed 2024-09-02 11:06:57 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-02 11:06:57 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer: set flag config.default.nagios_context 2024-09-02 11:06:57 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer: set flag config.default.nagios_servicegroups 2024-09-02 11:06:57 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer: set flag config.set.snapd_refresh 2024-09-02 11:06:57 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer: set flag config.default.snapd_refresh 2024-09-02 11:06:57 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer: set flag config.set.port 2024-09-02 11:06:57 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer: set flag config.default.port 2024-09-02 11:06:57 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer: set flag config.set.management_port 2024-09-02 11:06:57 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer: set flag config.default.management_port 2024-09-02 11:06:57 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer: set flag config.set.channel 2024-09-02 11:06:57 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer: set flag config.default.channel 2024-09-02 11:06:57 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer: set flag config.set.bind_to_all_interfaces 2024-09-02 11:06:57 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer: set flag config.default.bind_to_all_interfaces 2024-09-02 11:06:57 INFO unit.etcd/0.juju-log server.go:316 db:8: Initializing Leadership Layer (is leader) 2024-09-02 11:06:57 INFO unit.etcd/0.juju-log server.go:316 db:8: Initializing Snap Layer 2024-09-02 11:06:57 DEBUG unit.etcd/0.db-relation-changed logger.go:60 none 2024-09-02 11:06:57 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer> tracer: starting handler dispatch, 41 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.ca.available tracer: set flag certificates.client.cert.available tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag leadership.is_leader tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca.written tracer: set flag tls_client.ca_installed tracer: set flag tls_client.client.certificate.saved tracer: set flag tls_client.client.certificate.written tracer: set flag tls_client.client.key.saved 2024-09-02 11:06:57 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler hooks/relations/etcd/provides.py:22:joined_or_changed 2024-09-02 11:06:57 INFO unit.etcd/0.juju-log server.go:316 db:8: Invoking reactive handler: hooks/relations/etcd/provides.py:22:joined_or_changed 2024-09-02 11:06:57 DEBUG unit.etcd/0.juju-log server.go:316 db:8: tracer> tracer: main dispatch loop, 6 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-02 11:06:57 INFO unit.etcd/0.juju-log server.go:316 db:8: Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-02 11:06:57 INFO unit.etcd/0.juju-log server.go:316 db:8: Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-02 11:06:58 INFO unit.etcd/0.juju-log server.go:316 db:8: Invoking reactive handler: reactive/etcd.py:488:process_snapd_timer 2024-09-02 11:06:58 INFO unit.etcd/0.juju-log server.go:316 db:8: Get config refresh.timer for snap core 2024-09-02 11:06:58 INFO unit.etcd/0.juju-log server.go:316 db:8: Invoking reactive handler: reactive/tls_client.py:18:store_ca 2024-09-02 11:06:58 INFO unit.etcd/0.juju-log server.go:316 db:8: Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-02 11:06:58 INFO unit.etcd/0.juju-log server.go:316 db:8: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-02 11:06:58 INFO juju.worker.uniter.operation runhook.go:159 ran "db-relation-changed" hook (via explicit, bespoke hook script) 2024-09-02 11:06:58 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (8; unit: kubernetes-master/0) hook" for etcd/0 2024-09-02 11:06:58 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-02 11:06:58 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/0 uniter (run relation-changed (8; unit: kubernetes-master/0) hook) 2024-09-02 11:06:58 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/0 2024-09-02 11:06:58 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-02 11:06:58 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-02 11:06:58 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-02 11:06:58 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 2024-09-02 11:06:58 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-02 11:06:58 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-02 11:06:58 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-02 11:07:17 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for etcd/0 : {10 {map[easyrsa/0:{2}] map[] []}} 2024-09-02 11:07:17 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-02 11:07:17 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-02 11:07:17 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (10; unit: easyrsa/0) hook for etcd/0 2024-09-02 11:07:17 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/0 uniter (run relation-changed (10; unit: easyrsa/0) hook) 2024-09-02 11:07:25 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/0 uniter (run relation-changed (10; unit: easyrsa/0) hook) 2024-09-02 11:07:25 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (10; unit: easyrsa/0) hook" for etcd/0 2024-09-02 11:07:25 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (10; unit: easyrsa/0) hook" for etcd/0 2024-09-02 11:07:25 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running certificates-relation-changed hook for easyrsa/0 2024-09-02 11:07:25 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-0/agent.socket } 2024-09-02 11:07:25 INFO unit.etcd/0.juju-log server.go:316 certificates:10: Reactive main running for hook certificates-relation-changed 2024-09-02 11:07:25 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer> tracer: set flag endpoint.certificates.changed.etcd_0.server.cert tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-02 11:07:25 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer: set flag endpoint.certificates.changed.etcd_0.server.key 2024-09-02 11:07:25 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer: set flag config.set.nagios_context 2024-09-02 11:07:25 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer: set flag config.default.nagios_context 2024-09-02 11:07:25 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer: set flag config.default.nagios_servicegroups 2024-09-02 11:07:25 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer: set flag config.set.snapd_refresh 2024-09-02 11:07:25 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer: set flag config.default.snapd_refresh 2024-09-02 11:07:25 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer: set flag config.set.port 2024-09-02 11:07:25 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer: set flag config.default.port 2024-09-02 11:07:25 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer: set flag config.set.management_port 2024-09-02 11:07:25 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer: set flag config.default.management_port 2024-09-02 11:07:25 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer: set flag config.set.channel 2024-09-02 11:07:25 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer: set flag config.default.channel 2024-09-02 11:07:25 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer: set flag config.set.bind_to_all_interfaces 2024-09-02 11:07:25 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer: set flag config.default.bind_to_all_interfaces 2024-09-02 11:07:25 INFO unit.etcd/0.juju-log server.go:316 certificates:10: Initializing Leadership Layer (is leader) 2024-09-02 11:07:25 INFO unit.etcd/0.juju-log server.go:316 certificates:10: Initializing Snap Layer 2024-09-02 11:07:25 DEBUG unit.etcd/0.certificates-relation-changed logger.go:60 none 2024-09-02 11:07:25 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer> tracer: starting handler dispatch, 43 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.ca.available tracer: set flag certificates.client.cert.available tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.etcd_0.server.cert tracer: set flag endpoint.certificates.changed.etcd_0.server.key tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag leadership.is_leader tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca.written tracer: set flag tls_client.ca_installed tracer: set flag tls_client.client.certificate.saved tracer: set flag tls_client.client.certificate.written tracer: set flag tls_client.client.key.saved 2024-09-02 11:07:25 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer: hooks phase, 0 handlers queued 2024-09-02 11:07:25 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer> tracer: main dispatch loop, 6 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-02 11:07:25 INFO unit.etcd/0.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-02 11:07:25 INFO unit.etcd/0.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-02 11:07:25 INFO unit.etcd/0.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/etcd.py:488:process_snapd_timer 2024-09-02 11:07:25 INFO unit.etcd/0.juju-log server.go:316 certificates:10: Get config refresh.timer for snap core 2024-09-02 11:07:25 INFO unit.etcd/0.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/tls_client.py:18:store_ca 2024-09-02 11:07:25 INFO unit.etcd/0.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-02 11:07:25 INFO unit.etcd/0.juju-log server.go:316 certificates:10: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-02 11:07:25 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer: set flag certificates.server.certs.available 2024-09-02 11:07:26 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer: set flag certificates.server.certs.changed 2024-09-02 11:07:26 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer: set flag certificates.certs.available 2024-09-02 11:07:26 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer> tracer: set flag certificates.certs.changed tracer: ++ queue handler reactive/tls_client.py:98:update_certs 2024-09-02 11:07:26 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer> tracer: set flag certificates.server.cert.available tracer: ++ queue handler reactive/tls_client.py:44:store_server 2024-09-02 11:07:26 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer: set flag certificates.batch.cert.available 2024-09-02 11:07:26 INFO unit.etcd/0.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/tls_client.py:44:store_server 2024-09-02 11:07:26 INFO unit.etcd/0.juju-log server.go:316 certificates:10: Writing server certificate to /var/snap/etcd/common/server.crt 2024-09-02 11:07:26 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer: set flag tls_client.server.certificate.written 2024-09-02 11:07:26 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer: set flag tls_client.server.certificate.saved 2024-09-02 11:07:26 INFO unit.etcd/0.juju-log server.go:316 certificates:10: Writing server key to /var/snap/etcd/common/server.key 2024-09-02 11:07:26 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer: set flag tls_client.server.key.saved 2024-09-02 11:07:26 INFO unit.etcd/0.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/tls_client.py:98:update_certs 2024-09-02 11:07:26 WARNING unit.etcd/0.juju-log server.go:316 certificates:10: No client certs found using maps. Checking for global client certificates. 2024-09-02 11:07:26 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer: set flag tls_client.certs.saved 2024-09-02 11:07:26 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer> tracer: cleared flag certificates.certs.changed tracer: -- dequeue handler reactive/tls_client.py:98:update_certs 2024-09-02 11:07:26 INFO unit.etcd/0.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/etcd.py:530:tls_state_control 2024-09-02 11:07:26 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer> tracer: set flag etcd.ssl.placed tracer: ++ queue handler reactive/etcd.py:549:tls_update tracer: -- dequeue handler reactive/etcd.py:530:tls_state_control 2024-09-02 11:07:26 INFO unit.etcd/0.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/etcd.py:282:send_single_connection_details 2024-09-02 11:07:26 INFO unit.etcd/0.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/etcd.py:445:initialize_new_leader 2024-09-02 11:07:26 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: Writing file /var/snap/etcd/common/etcd.conf.yml root:root 444 2024-09-02 11:07:29 ERROR unit.etcd/0.juju-log server.go:316 certificates:10: ['/snap/bin/etcd.etcdctl', 'cluster-health'] 2024-09-02 11:07:29 ERROR unit.etcd/0.juju-log server.go:316 certificates:10: {'ETCDCTL_API': '2', 'ETCDCTL_CA_FILE': '/var/snap/etcd/common/ca.crt', 'ETCDCTL_CERT_FILE': '/var/snap/etcd/common/server.crt', 'ETCDCTL_KEY_FILE': '/var/snap/etcd/common/server.key'} 2024-09-02 11:07:29 ERROR unit.etcd/0.juju-log server.go:316 certificates:10: b'member 119668e5855c97d9 is unhealthy: got unhealthy result from https://10.0.0.24:2379\ncluster is unavailable\n' 2024-09-02 11:07:29 ERROR unit.etcd/0.juju-log server.go:316 certificates:10: None 2024-09-02 11:07:29 WARNING unit.etcd/0.juju-log server.go:316 certificates:10: Notice: Unit failed cluster-health check 2024-09-02 11:07:30 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer: set flag etcd.registered 2024-09-02 11:07:30 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer> tracer: set flag etcd.leader.configured tracer: -- dequeue handler reactive/etcd.py:445:initialize_new_leader 2024-09-02 11:07:30 INFO unit.etcd/0.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/etcd.py:549:tls_update 2024-09-02 11:07:30 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: Changing permissions on existing content: 33060 -> 292 2024-09-02 11:07:30 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer> tracer: cleared flag etcd.ssl.placed tracer: ++ queue handler reactive/etcd.py:530:tls_state_control tracer: -- dequeue handler reactive/etcd.py:282:send_single_connection_details tracer: -- dequeue handler reactive/etcd.py:549:tls_update 2024-09-02 11:07:30 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer: cleared flag tls_client.ca.written 2024-09-02 11:07:30 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer: cleared flag tls_client.server.certificate.written 2024-09-02 11:07:30 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer: cleared flag tls_client.client.certificate.written 2024-09-02 11:07:30 INFO unit.etcd/0.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/etcd.py:95:check_cluster_health 2024-09-02 11:07:30 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for etcd/0: ok=true 2024-09-02 11:07:32 INFO unit.etcd/0.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/etcd.py:530:tls_state_control 2024-09-02 11:07:32 DEBUG unit.etcd/0.juju-log server.go:316 certificates:10: tracer> tracer: set flag etcd.ssl.placed tracer: ++ queue handler reactive/etcd.py:282:send_single_connection_details tracer: -- dequeue handler reactive/etcd.py:530:tls_state_control 2024-09-02 11:07:32 INFO unit.etcd/0.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/etcd.py:282:send_single_connection_details 2024-09-02 11:07:32 INFO unit.etcd/0.juju-log server.go:316 certificates:10: status-set: active: Healthy with 1 known peer 2024-09-02 11:07:32 INFO juju.worker.uniter.operation runhook.go:159 ran "certificates-relation-changed" hook (via explicit, bespoke hook script) 2024-09-02 11:07:32 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (10; unit: easyrsa/0) hook" for etcd/0 2024-09-02 11:07:32 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-02 11:07:32 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/0 uniter (run relation-changed (10; unit: easyrsa/0) hook) 2024-09-02 11:07:32 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/0 2024-09-02 11:07:32 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-02 11:07:32 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-02 11:07:32 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-02 11:07:32 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 2024-09-02 11:07:32 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-02 11:07:32 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-02 11:07:32 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-02 11:09:05 DEBUG juju.worker.meterstatus connected.go:93 got meter status change signal from watcher 2024-09-02 11:09:16 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for etcd/0 2024-09-02 11:09:16 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-02 11:09:16 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-02 11:09:16 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-02 11:09:16 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for etcd/0 2024-09-02 11:09:16 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/0 uniter (run update-status hook) 2024-09-02 11:09:16 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/0 uniter (run update-status hook) 2024-09-02 11:09:16 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for etcd/0 2024-09-02 11:09:16 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for etcd/0 2024-09-02 11:09:16 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-0/agent.socket } 2024-09-02 11:09:16 INFO unit.etcd/0.juju-log server.go:316 Reactive main running for hook update-status 2024-09-02 11:09:16 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:282:send_single_connection_details tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-02 11:09:16 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.nagios_context 2024-09-02 11:09:16 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2024-09-02 11:09:16 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.snapd_refresh 2024-09-02 11:09:16 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.snapd_refresh 2024-09-02 11:09:16 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.port 2024-09-02 11:09:16 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.port 2024-09-02 11:09:16 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.management_port 2024-09-02 11:09:16 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.management_port 2024-09-02 11:09:16 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.channel 2024-09-02 11:09:16 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.channel 2024-09-02 11:09:16 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.bind_to_all_interfaces 2024-09-02 11:09:16 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.bind_to_all_interfaces 2024-09-02 11:09:16 INFO unit.etcd/0.juju-log server.go:316 Initializing Leadership Layer (is leader) 2024-09-02 11:09:16 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag leadership.changed.cluster 2024-09-02 11:09:16 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag leadership.set.cluster 2024-09-02 11:09:16 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag leadership.changed.leader_address 2024-09-02 11:09:16 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag leadership.set.leader_address 2024-09-02 11:09:16 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag leadership.changed 2024-09-02 11:09:16 INFO unit.etcd/0.juju-log server.go:316 Initializing Snap Layer 2024-09-02 11:09:16 DEBUG unit.etcd/0.update-status logger.go:60 none 2024-09-02 11:09:16 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: starting handler dispatch, 57 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.batch.cert.available tracer: set flag certificates.ca.available tracer: set flag certificates.certs.available tracer: set flag certificates.client.cert.available tracer: set flag certificates.server.cert.available tracer: set flag certificates.server.certs.available tracer: set flag certificates.server.certs.changed tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.etcd_0.server.cert tracer: set flag endpoint.certificates.changed.etcd_0.server.key tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.leader.configured tracer: set flag etcd.registered tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag etcd.ssl.placed tracer: set flag leadership.changed tracer: set flag leadership.changed.cluster tracer: set flag leadership.changed.leader_address tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster tracer: set flag leadership.set.leader_address tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca_installed tracer: set flag tls_client.certs.saved tracer: set flag tls_client.client.certificate.saved tracer: set flag tls_client.client.key.saved tracer: set flag tls_client.server.certificate.saved tracer: set flag tls_client.server.key.saved 2024-09-02 11:09:16 DEBUG unit.etcd/0.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-09-02 11:09:16 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: main dispatch loop, 9 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:282:send_single_connection_details tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-02 11:09:16 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:95:check_cluster_health 2024-09-02 11:09:16 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-02 11:09:17 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-02 11:09:17 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:282:send_single_connection_details 2024-09-02 11:09:17 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:488:process_snapd_timer 2024-09-02 11:09:17 INFO unit.etcd/0.juju-log server.go:316 Get config refresh.timer for snap core 2024-09-02 11:09:17 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:18:store_ca 2024-09-02 11:09:17 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:44:store_server 2024-09-02 11:09:17 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-02 11:09:17 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-02 11:09:17 DEBUG unit.etcd/0.juju-log server.go:316 tracer: cleared flag certificates.server.certs.changed 2024-09-02 11:09:17 INFO unit.etcd/0.juju-log server.go:316 status-set: active: Healthy with 1 known peer 2024-09-02 11:09:17 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-09-02 11:09:17 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for etcd/0 2024-09-02 11:09:17 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-02 11:09:17 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/0 uniter (run update-status hook) 2024-09-02 11:09:17 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/0 2024-09-02 11:09:17 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-02 11:09:17 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-02 11:09:17 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-02 11:14:07 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for etcd/0 2024-09-02 11:14:07 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-02 11:14:07 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-02 11:14:07 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-02 11:14:07 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for etcd/0 2024-09-02 11:14:07 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/0 uniter (run update-status hook) 2024-09-02 11:14:07 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/0 uniter (run update-status hook) 2024-09-02 11:14:07 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for etcd/0 2024-09-02 11:14:07 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for etcd/0 2024-09-02 11:14:07 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-0/agent.socket } 2024-09-02 11:14:07 INFO unit.etcd/0.juju-log server.go:316 Reactive main running for hook update-status 2024-09-02 11:14:08 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:282:send_single_connection_details tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-02 11:14:08 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.nagios_context 2024-09-02 11:14:08 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2024-09-02 11:14:08 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.snapd_refresh 2024-09-02 11:14:08 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.snapd_refresh 2024-09-02 11:14:08 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.port 2024-09-02 11:14:08 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.port 2024-09-02 11:14:08 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.management_port 2024-09-02 11:14:08 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.management_port 2024-09-02 11:14:08 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.channel 2024-09-02 11:14:08 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.channel 2024-09-02 11:14:08 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.bind_to_all_interfaces 2024-09-02 11:14:08 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.bind_to_all_interfaces 2024-09-02 11:14:08 INFO unit.etcd/0.juju-log server.go:316 Initializing Leadership Layer (is leader) 2024-09-02 11:14:08 DEBUG unit.etcd/0.juju-log server.go:316 tracer: cleared flag leadership.changed.cluster 2024-09-02 11:14:08 DEBUG unit.etcd/0.juju-log server.go:316 tracer: cleared flag leadership.changed.leader_address 2024-09-02 11:14:08 DEBUG unit.etcd/0.juju-log server.go:316 tracer: cleared flag leadership.changed 2024-09-02 11:14:08 INFO unit.etcd/0.juju-log server.go:316 Initializing Snap Layer 2024-09-02 11:14:08 DEBUG unit.etcd/0.update-status logger.go:60 none 2024-09-02 11:14:08 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: starting handler dispatch, 53 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.batch.cert.available tracer: set flag certificates.ca.available tracer: set flag certificates.certs.available tracer: set flag certificates.client.cert.available tracer: set flag certificates.server.cert.available tracer: set flag certificates.server.certs.available tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.etcd_0.server.cert tracer: set flag endpoint.certificates.changed.etcd_0.server.key tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.leader.configured tracer: set flag etcd.registered tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag etcd.ssl.placed tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster tracer: set flag leadership.set.leader_address tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca_installed tracer: set flag tls_client.certs.saved tracer: set flag tls_client.client.certificate.saved tracer: set flag tls_client.client.key.saved tracer: set flag tls_client.server.certificate.saved tracer: set flag tls_client.server.key.saved 2024-09-02 11:14:08 DEBUG unit.etcd/0.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-09-02 11:14:08 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: main dispatch loop, 9 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:282:send_single_connection_details tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-02 11:14:08 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:95:check_cluster_health 2024-09-02 11:14:09 ERROR unit.etcd/0.juju-log server.go:316 ['/snap/bin/etcd.etcdctl', 'cluster-health'] 2024-09-02 11:14:09 ERROR unit.etcd/0.juju-log server.go:316 {'ETCDCTL_API': '2', 'ETCDCTL_CA_FILE': '/var/snap/etcd/common/ca.crt', 'ETCDCTL_CERT_FILE': '/var/snap/etcd/common/server.crt', 'ETCDCTL_KEY_FILE': '/var/snap/etcd/common/server.key'} 2024-09-02 11:14:09 ERROR unit.etcd/0.juju-log server.go:316 b'member 119668e5855c97d9 is unhealthy: got unhealthy result from https://10.0.0.24:2379\ncluster is unavailable\n' 2024-09-02 11:14:09 ERROR unit.etcd/0.juju-log server.go:316 None 2024-09-02 11:14:09 WARNING unit.etcd/0.juju-log server.go:316 Notice: Unit failed cluster-health check 2024-09-02 11:14:09 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-02 11:14:10 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-02 11:14:10 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:282:send_single_connection_details 2024-09-02 11:14:10 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:488:process_snapd_timer 2024-09-02 11:14:10 INFO unit.etcd/0.juju-log server.go:316 Get config refresh.timer for snap core 2024-09-02 11:14:10 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:18:store_ca 2024-09-02 11:14:10 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:44:store_server 2024-09-02 11:14:10 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-02 11:14:10 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-02 11:14:10 INFO unit.etcd/0.juju-log server.go:316 status-set: active: UnHealthy with 1 known peer 2024-09-02 11:14:10 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-09-02 11:14:10 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for etcd/0 2024-09-02 11:14:10 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-02 11:14:10 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/0 uniter (run update-status hook) 2024-09-02 11:14:10 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/0 2024-09-02 11:14:10 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-02 11:14:10 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-02 11:14:10 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-02 11:19:25 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for etcd/0 2024-09-02 11:19:25 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-02 11:19:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-02 11:19:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-02 11:19:25 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for etcd/0 2024-09-02 11:19:25 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/0 uniter (run update-status hook) 2024-09-02 11:19:25 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/0 uniter (run update-status hook) 2024-09-02 11:19:25 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for etcd/0 2024-09-02 11:19:25 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for etcd/0 2024-09-02 11:19:25 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-0/agent.socket } 2024-09-02 11:19:25 INFO unit.etcd/0.juju-log server.go:316 Reactive main running for hook update-status 2024-09-02 11:19:25 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:282:send_single_connection_details tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-02 11:19:25 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.nagios_context 2024-09-02 11:19:25 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2024-09-02 11:19:25 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.snapd_refresh 2024-09-02 11:19:25 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.snapd_refresh 2024-09-02 11:19:25 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.port 2024-09-02 11:19:25 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.port 2024-09-02 11:19:25 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.management_port 2024-09-02 11:19:25 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.management_port 2024-09-02 11:19:25 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.channel 2024-09-02 11:19:25 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.channel 2024-09-02 11:19:25 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.bind_to_all_interfaces 2024-09-02 11:19:25 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.bind_to_all_interfaces 2024-09-02 11:19:25 INFO unit.etcd/0.juju-log server.go:316 Initializing Leadership Layer (is leader) 2024-09-02 11:19:25 INFO unit.etcd/0.juju-log server.go:316 Initializing Snap Layer 2024-09-02 11:19:25 DEBUG unit.etcd/0.update-status logger.go:60 none 2024-09-02 11:19:25 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: starting handler dispatch, 53 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.batch.cert.available tracer: set flag certificates.ca.available tracer: set flag certificates.certs.available tracer: set flag certificates.client.cert.available tracer: set flag certificates.server.cert.available tracer: set flag certificates.server.certs.available tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.etcd_0.server.cert tracer: set flag endpoint.certificates.changed.etcd_0.server.key tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.leader.configured tracer: set flag etcd.registered tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag etcd.ssl.placed tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster tracer: set flag leadership.set.leader_address tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca_installed tracer: set flag tls_client.certs.saved tracer: set flag tls_client.client.certificate.saved tracer: set flag tls_client.client.key.saved tracer: set flag tls_client.server.certificate.saved tracer: set flag tls_client.server.key.saved 2024-09-02 11:19:25 DEBUG unit.etcd/0.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-09-02 11:19:25 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: main dispatch loop, 9 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:282:send_single_connection_details tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-02 11:19:25 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:95:check_cluster_health 2024-09-02 11:19:26 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-02 11:19:26 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-02 11:19:26 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:282:send_single_connection_details 2024-09-02 11:19:26 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:488:process_snapd_timer 2024-09-02 11:19:26 INFO unit.etcd/0.juju-log server.go:316 Get config refresh.timer for snap core 2024-09-02 11:19:26 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:18:store_ca 2024-09-02 11:19:26 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:44:store_server 2024-09-02 11:19:26 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-02 11:19:26 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-02 11:19:26 INFO unit.etcd/0.juju-log server.go:316 status-set: active: Healthy with 1 known peer 2024-09-02 11:19:26 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-09-02 11:19:26 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for etcd/0 2024-09-02 11:19:26 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-02 11:19:26 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/0 uniter (run update-status hook) 2024-09-02 11:19:26 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/0 2024-09-02 11:19:26 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-02 11:19:26 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-02 11:19:26 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-02 11:24:24 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for etcd/0 2024-09-02 11:24:24 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-02 11:24:24 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-02 11:24:24 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-02 11:24:24 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for etcd/0 2024-09-02 11:24:24 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/0 uniter (run update-status hook) 2024-09-02 11:24:24 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/0 uniter (run update-status hook) 2024-09-02 11:24:24 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for etcd/0 2024-09-02 11:24:24 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for etcd/0 2024-09-02 11:24:24 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-0/agent.socket } 2024-09-02 11:24:24 INFO unit.etcd/0.juju-log server.go:316 Reactive main running for hook update-status 2024-09-02 11:24:24 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:282:send_single_connection_details tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-02 11:24:24 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.nagios_context 2024-09-02 11:24:24 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2024-09-02 11:24:24 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.snapd_refresh 2024-09-02 11:24:24 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.snapd_refresh 2024-09-02 11:24:24 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.port 2024-09-02 11:24:24 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.port 2024-09-02 11:24:24 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.management_port 2024-09-02 11:24:24 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.management_port 2024-09-02 11:24:24 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.channel 2024-09-02 11:24:24 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.channel 2024-09-02 11:24:24 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.bind_to_all_interfaces 2024-09-02 11:24:24 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.bind_to_all_interfaces 2024-09-02 11:24:24 INFO unit.etcd/0.juju-log server.go:316 Initializing Leadership Layer (is leader) 2024-09-02 11:24:24 INFO unit.etcd/0.juju-log server.go:316 Initializing Snap Layer 2024-09-02 11:24:25 DEBUG unit.etcd/0.update-status logger.go:60 none 2024-09-02 11:24:25 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: starting handler dispatch, 53 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.batch.cert.available tracer: set flag certificates.ca.available tracer: set flag certificates.certs.available tracer: set flag certificates.client.cert.available tracer: set flag certificates.server.cert.available tracer: set flag certificates.server.certs.available tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.etcd_0.server.cert tracer: set flag endpoint.certificates.changed.etcd_0.server.key tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.leader.configured tracer: set flag etcd.registered tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag etcd.ssl.placed tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster tracer: set flag leadership.set.leader_address tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca_installed tracer: set flag tls_client.certs.saved tracer: set flag tls_client.client.certificate.saved tracer: set flag tls_client.client.key.saved tracer: set flag tls_client.server.certificate.saved tracer: set flag tls_client.server.key.saved 2024-09-02 11:24:25 DEBUG unit.etcd/0.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-09-02 11:24:25 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: main dispatch loop, 9 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:282:send_single_connection_details tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-02 11:24:25 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:95:check_cluster_health 2024-09-02 11:24:25 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-02 11:24:25 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-02 11:24:25 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:282:send_single_connection_details 2024-09-02 11:24:25 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:488:process_snapd_timer 2024-09-02 11:24:25 INFO unit.etcd/0.juju-log server.go:316 Get config refresh.timer for snap core 2024-09-02 11:24:25 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:18:store_ca 2024-09-02 11:24:25 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:44:store_server 2024-09-02 11:24:25 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-02 11:24:25 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-02 11:24:25 INFO unit.etcd/0.juju-log server.go:316 status-set: active: Healthy with 1 known peer 2024-09-02 11:24:25 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-09-02 11:24:25 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for etcd/0 2024-09-02 11:24:25 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-02 11:24:25 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/0 uniter (run update-status hook) 2024-09-02 11:24:25 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/0 2024-09-02 11:24:25 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-02 11:24:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-02 11:24:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-02 11:28:40 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for etcd/0 2024-09-02 11:28:40 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-02 11:28:40 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-02 11:28:40 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-02 11:28:40 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for etcd/0 2024-09-02 11:28:40 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/0 uniter (run update-status hook) 2024-09-02 11:28:40 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/0 uniter (run update-status hook) 2024-09-02 11:28:40 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for etcd/0 2024-09-02 11:28:40 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for etcd/0 2024-09-02 11:28:40 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-0/agent.socket } 2024-09-02 11:28:40 INFO unit.etcd/0.juju-log server.go:316 Reactive main running for hook update-status 2024-09-02 11:28:40 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:282:send_single_connection_details tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-02 11:28:40 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.nagios_context 2024-09-02 11:28:40 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2024-09-02 11:28:40 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.snapd_refresh 2024-09-02 11:28:40 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.snapd_refresh 2024-09-02 11:28:40 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.port 2024-09-02 11:28:40 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.port 2024-09-02 11:28:40 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.management_port 2024-09-02 11:28:40 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.management_port 2024-09-02 11:28:40 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.channel 2024-09-02 11:28:40 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.channel 2024-09-02 11:28:40 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.bind_to_all_interfaces 2024-09-02 11:28:40 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.bind_to_all_interfaces 2024-09-02 11:28:40 INFO unit.etcd/0.juju-log server.go:316 Initializing Leadership Layer (is leader) 2024-09-02 11:28:40 INFO unit.etcd/0.juju-log server.go:316 Initializing Snap Layer 2024-09-02 11:28:40 DEBUG unit.etcd/0.update-status logger.go:60 none 2024-09-02 11:28:40 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: starting handler dispatch, 53 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.batch.cert.available tracer: set flag certificates.ca.available tracer: set flag certificates.certs.available tracer: set flag certificates.client.cert.available tracer: set flag certificates.server.cert.available tracer: set flag certificates.server.certs.available tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.etcd_0.server.cert tracer: set flag endpoint.certificates.changed.etcd_0.server.key tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.leader.configured tracer: set flag etcd.registered tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag etcd.ssl.placed tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster tracer: set flag leadership.set.leader_address tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca_installed tracer: set flag tls_client.certs.saved tracer: set flag tls_client.client.certificate.saved tracer: set flag tls_client.client.key.saved tracer: set flag tls_client.server.certificate.saved tracer: set flag tls_client.server.key.saved 2024-09-02 11:28:40 DEBUG unit.etcd/0.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-09-02 11:28:40 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: main dispatch loop, 9 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:282:send_single_connection_details tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-02 11:28:40 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:95:check_cluster_health 2024-09-02 11:28:41 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-02 11:28:41 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-02 11:28:41 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:282:send_single_connection_details 2024-09-02 11:28:41 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:488:process_snapd_timer 2024-09-02 11:28:41 INFO unit.etcd/0.juju-log server.go:316 Get config refresh.timer for snap core 2024-09-02 11:28:41 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:18:store_ca 2024-09-02 11:28:41 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:44:store_server 2024-09-02 11:28:41 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-02 11:28:41 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-02 11:28:41 INFO unit.etcd/0.juju-log server.go:316 status-set: active: Healthy with 1 known peer 2024-09-02 11:28:41 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-09-02 11:28:41 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for etcd/0 2024-09-02 11:28:41 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-02 11:28:41 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/0 uniter (run update-status hook) 2024-09-02 11:28:41 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/0 2024-09-02 11:28:41 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-02 11:28:41 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-02 11:28:41 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-02 11:32:40 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for etcd/0 2024-09-02 11:32:40 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-02 11:32:40 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-02 11:32:40 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-02 11:32:40 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for etcd/0 2024-09-02 11:32:40 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/0 uniter (run update-status hook) 2024-09-02 11:32:40 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/0 uniter (run update-status hook) 2024-09-02 11:32:40 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for etcd/0 2024-09-02 11:32:40 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for etcd/0 2024-09-02 11:32:40 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-0/agent.socket } 2024-09-02 11:32:41 INFO unit.etcd/0.juju-log server.go:316 Reactive main running for hook update-status 2024-09-02 11:32:41 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:282:send_single_connection_details tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-02 11:32:41 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.nagios_context 2024-09-02 11:32:41 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2024-09-02 11:32:41 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.snapd_refresh 2024-09-02 11:32:41 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.snapd_refresh 2024-09-02 11:32:41 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.port 2024-09-02 11:32:41 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.port 2024-09-02 11:32:41 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.management_port 2024-09-02 11:32:41 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.management_port 2024-09-02 11:32:41 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.channel 2024-09-02 11:32:41 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.channel 2024-09-02 11:32:41 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.bind_to_all_interfaces 2024-09-02 11:32:41 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.bind_to_all_interfaces 2024-09-02 11:32:41 INFO unit.etcd/0.juju-log server.go:316 Initializing Leadership Layer (is leader) 2024-09-02 11:32:41 INFO unit.etcd/0.juju-log server.go:316 Initializing Snap Layer 2024-09-02 11:32:41 DEBUG unit.etcd/0.update-status logger.go:60 none 2024-09-02 11:32:41 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: starting handler dispatch, 53 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.batch.cert.available tracer: set flag certificates.ca.available tracer: set flag certificates.certs.available tracer: set flag certificates.client.cert.available tracer: set flag certificates.server.cert.available tracer: set flag certificates.server.certs.available tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.etcd_0.server.cert tracer: set flag endpoint.certificates.changed.etcd_0.server.key tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.leader.configured tracer: set flag etcd.registered tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag etcd.ssl.placed tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster tracer: set flag leadership.set.leader_address tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca_installed tracer: set flag tls_client.certs.saved tracer: set flag tls_client.client.certificate.saved tracer: set flag tls_client.client.key.saved tracer: set flag tls_client.server.certificate.saved tracer: set flag tls_client.server.key.saved 2024-09-02 11:32:41 DEBUG unit.etcd/0.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-09-02 11:32:41 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: main dispatch loop, 9 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:282:send_single_connection_details tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-02 11:32:41 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:95:check_cluster_health 2024-09-02 11:32:41 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-02 11:32:41 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-02 11:32:41 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:282:send_single_connection_details 2024-09-02 11:32:41 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:488:process_snapd_timer 2024-09-02 11:32:41 INFO unit.etcd/0.juju-log server.go:316 Get config refresh.timer for snap core 2024-09-02 11:32:41 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:18:store_ca 2024-09-02 11:32:41 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:44:store_server 2024-09-02 11:32:41 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-02 11:32:41 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-02 11:32:41 INFO unit.etcd/0.juju-log server.go:316 status-set: active: Healthy with 1 known peer 2024-09-02 11:32:42 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-09-02 11:32:42 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for etcd/0 2024-09-02 11:32:42 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-02 11:32:42 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/0 uniter (run update-status hook) 2024-09-02 11:32:42 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/0 2024-09-02 11:32:42 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-02 11:32:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-02 11:32:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-02 11:38:06 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for etcd/0 2024-09-02 11:38:06 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-02 11:38:06 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-02 11:38:06 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-02 11:38:06 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for etcd/0 2024-09-02 11:38:06 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/0 uniter (run update-status hook) 2024-09-02 11:38:07 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/0 uniter (run update-status hook) 2024-09-02 11:38:07 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for etcd/0 2024-09-02 11:38:07 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for etcd/0 2024-09-02 11:38:07 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-0/agent.socket } 2024-09-02 11:38:07 INFO unit.etcd/0.juju-log server.go:316 Reactive main running for hook update-status 2024-09-02 11:38:08 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:282:send_single_connection_details tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-02 11:38:08 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.nagios_context 2024-09-02 11:38:08 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2024-09-02 11:38:08 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.snapd_refresh 2024-09-02 11:38:08 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.snapd_refresh 2024-09-02 11:38:08 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.port 2024-09-02 11:38:08 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.port 2024-09-02 11:38:08 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.management_port 2024-09-02 11:38:08 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.management_port 2024-09-02 11:38:08 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.channel 2024-09-02 11:38:08 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.channel 2024-09-02 11:38:08 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.bind_to_all_interfaces 2024-09-02 11:38:08 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.bind_to_all_interfaces 2024-09-02 11:38:08 INFO unit.etcd/0.juju-log server.go:316 Initializing Leadership Layer (is leader) 2024-09-02 11:38:08 INFO unit.etcd/0.juju-log server.go:316 Initializing Snap Layer 2024-09-02 11:38:08 DEBUG unit.etcd/0.update-status logger.go:60 none 2024-09-02 11:38:08 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: starting handler dispatch, 53 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.batch.cert.available tracer: set flag certificates.ca.available tracer: set flag certificates.certs.available tracer: set flag certificates.client.cert.available tracer: set flag certificates.server.cert.available tracer: set flag certificates.server.certs.available tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.etcd_0.server.cert tracer: set flag endpoint.certificates.changed.etcd_0.server.key tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.leader.configured tracer: set flag etcd.registered tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag etcd.ssl.placed tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster tracer: set flag leadership.set.leader_address tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca_installed tracer: set flag tls_client.certs.saved tracer: set flag tls_client.client.certificate.saved tracer: set flag tls_client.client.key.saved tracer: set flag tls_client.server.certificate.saved tracer: set flag tls_client.server.key.saved 2024-09-02 11:38:08 DEBUG unit.etcd/0.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-09-02 11:38:08 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: main dispatch loop, 9 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:282:send_single_connection_details tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-02 11:38:08 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:95:check_cluster_health 2024-09-02 11:38:08 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-02 11:38:08 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-02 11:38:08 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:282:send_single_connection_details 2024-09-02 11:38:08 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:488:process_snapd_timer 2024-09-02 11:38:08 INFO unit.etcd/0.juju-log server.go:316 Get config refresh.timer for snap core 2024-09-02 11:38:08 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:18:store_ca 2024-09-02 11:38:08 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:44:store_server 2024-09-02 11:38:08 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-02 11:38:08 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-02 11:38:08 INFO unit.etcd/0.juju-log server.go:316 status-set: active: Healthy with 1 known peer 2024-09-02 11:38:09 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-09-02 11:38:09 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for etcd/0 2024-09-02 11:38:09 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-02 11:38:09 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/0 uniter (run update-status hook) 2024-09-02 11:38:09 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/0 2024-09-02 11:38:09 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-02 11:38:09 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-02 11:38:09 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-02 11:43:56 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for etcd/0 2024-09-02 11:43:56 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-02 11:43:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-02 11:43:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-02 11:43:56 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for etcd/0 2024-09-02 11:43:56 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/0 uniter (run update-status hook) 2024-09-02 11:43:56 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/0 uniter (run update-status hook) 2024-09-02 11:43:56 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for etcd/0 2024-09-02 11:43:56 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for etcd/0 2024-09-02 11:43:56 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-0/agent.socket } 2024-09-02 11:43:56 INFO unit.etcd/0.juju-log server.go:316 Reactive main running for hook update-status 2024-09-02 11:43:57 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:282:send_single_connection_details tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-02 11:43:57 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.nagios_context 2024-09-02 11:43:57 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2024-09-02 11:43:57 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.snapd_refresh 2024-09-02 11:43:57 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.snapd_refresh 2024-09-02 11:43:57 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.port 2024-09-02 11:43:57 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.port 2024-09-02 11:43:57 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.management_port 2024-09-02 11:43:57 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.management_port 2024-09-02 11:43:57 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.channel 2024-09-02 11:43:57 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.channel 2024-09-02 11:43:57 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.bind_to_all_interfaces 2024-09-02 11:43:57 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.bind_to_all_interfaces 2024-09-02 11:43:57 INFO unit.etcd/0.juju-log server.go:316 Initializing Leadership Layer (is leader) 2024-09-02 11:43:57 INFO unit.etcd/0.juju-log server.go:316 Initializing Snap Layer 2024-09-02 11:43:57 DEBUG unit.etcd/0.update-status logger.go:60 none 2024-09-02 11:43:57 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: starting handler dispatch, 53 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.batch.cert.available tracer: set flag certificates.ca.available tracer: set flag certificates.certs.available tracer: set flag certificates.client.cert.available tracer: set flag certificates.server.cert.available tracer: set flag certificates.server.certs.available tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.etcd_0.server.cert tracer: set flag endpoint.certificates.changed.etcd_0.server.key tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.leader.configured tracer: set flag etcd.registered tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag etcd.ssl.placed tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster tracer: set flag leadership.set.leader_address tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca_installed tracer: set flag tls_client.certs.saved tracer: set flag tls_client.client.certificate.saved tracer: set flag tls_client.client.key.saved tracer: set flag tls_client.server.certificate.saved tracer: set flag tls_client.server.key.saved 2024-09-02 11:43:57 DEBUG unit.etcd/0.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-09-02 11:43:57 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: main dispatch loop, 9 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:282:send_single_connection_details tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-02 11:43:57 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:95:check_cluster_health 2024-09-02 11:43:57 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-02 11:43:57 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-02 11:43:57 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:282:send_single_connection_details 2024-09-02 11:43:57 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:488:process_snapd_timer 2024-09-02 11:43:57 INFO unit.etcd/0.juju-log server.go:316 Get config refresh.timer for snap core 2024-09-02 11:43:57 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:18:store_ca 2024-09-02 11:43:57 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:44:store_server 2024-09-02 11:43:57 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-02 11:43:57 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-02 11:43:57 INFO unit.etcd/0.juju-log server.go:316 status-set: active: Healthy with 1 known peer 2024-09-02 11:43:58 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-09-02 11:43:58 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for etcd/0 2024-09-02 11:43:58 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-02 11:43:58 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/0 uniter (run update-status hook) 2024-09-02 11:43:58 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/0 2024-09-02 11:43:58 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-02 11:43:58 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-02 11:43:58 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-02 11:48:02 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for etcd/0 2024-09-02 11:48:02 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-02 11:48:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-02 11:48:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-02 11:48:02 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for etcd/0 2024-09-02 11:48:02 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/0 uniter (run update-status hook) 2024-09-02 11:48:02 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/0 uniter (run update-status hook) 2024-09-02 11:48:02 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for etcd/0 2024-09-02 11:48:02 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for etcd/0 2024-09-02 11:48:02 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-0/agent.socket } 2024-09-02 11:48:02 INFO unit.etcd/0.juju-log server.go:316 Reactive main running for hook update-status 2024-09-02 11:48:02 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:282:send_single_connection_details tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-02 11:48:02 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.nagios_context 2024-09-02 11:48:02 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2024-09-02 11:48:02 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.snapd_refresh 2024-09-02 11:48:02 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.snapd_refresh 2024-09-02 11:48:02 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.port 2024-09-02 11:48:02 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.port 2024-09-02 11:48:02 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.management_port 2024-09-02 11:48:02 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.management_port 2024-09-02 11:48:02 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.channel 2024-09-02 11:48:02 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.channel 2024-09-02 11:48:02 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.bind_to_all_interfaces 2024-09-02 11:48:02 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.bind_to_all_interfaces 2024-09-02 11:48:02 INFO unit.etcd/0.juju-log server.go:316 Initializing Leadership Layer (is leader) 2024-09-02 11:48:02 INFO unit.etcd/0.juju-log server.go:316 Initializing Snap Layer 2024-09-02 11:48:02 DEBUG unit.etcd/0.update-status logger.go:60 none 2024-09-02 11:48:02 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: starting handler dispatch, 53 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.batch.cert.available tracer: set flag certificates.ca.available tracer: set flag certificates.certs.available tracer: set flag certificates.client.cert.available tracer: set flag certificates.server.cert.available tracer: set flag certificates.server.certs.available tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.etcd_0.server.cert tracer: set flag endpoint.certificates.changed.etcd_0.server.key tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.leader.configured tracer: set flag etcd.registered tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag etcd.ssl.placed tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster tracer: set flag leadership.set.leader_address tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca_installed tracer: set flag tls_client.certs.saved tracer: set flag tls_client.client.certificate.saved tracer: set flag tls_client.client.key.saved tracer: set flag tls_client.server.certificate.saved tracer: set flag tls_client.server.key.saved 2024-09-02 11:48:02 DEBUG unit.etcd/0.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-09-02 11:48:02 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: main dispatch loop, 9 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:282:send_single_connection_details tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-02 11:48:02 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:95:check_cluster_health 2024-09-02 11:48:03 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-02 11:48:03 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-02 11:48:03 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:282:send_single_connection_details 2024-09-02 11:48:03 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:488:process_snapd_timer 2024-09-02 11:48:03 INFO unit.etcd/0.juju-log server.go:316 Get config refresh.timer for snap core 2024-09-02 11:48:03 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:18:store_ca 2024-09-02 11:48:03 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:44:store_server 2024-09-02 11:48:03 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-02 11:48:03 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-02 11:48:03 INFO unit.etcd/0.juju-log server.go:316 status-set: active: Healthy with 1 known peer 2024-09-02 11:48:03 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-09-02 11:48:03 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for etcd/0 2024-09-02 11:48:03 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-02 11:48:03 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/0 uniter (run update-status hook) 2024-09-02 11:48:03 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/0 2024-09-02 11:48:03 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-02 11:48:03 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-02 11:48:03 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-02 11:53:36 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for etcd/0 2024-09-02 11:53:36 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-02 11:53:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-02 11:53:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-02 11:53:36 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for etcd/0 2024-09-02 11:53:36 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/0 uniter (run update-status hook) 2024-09-02 11:53:36 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/0 uniter (run update-status hook) 2024-09-02 11:53:36 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for etcd/0 2024-09-02 11:53:36 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for etcd/0 2024-09-02 11:53:36 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-0/agent.socket } 2024-09-02 11:53:36 INFO unit.etcd/0.juju-log server.go:316 Reactive main running for hook update-status 2024-09-02 11:53:36 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:282:send_single_connection_details tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-02 11:53:36 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.nagios_context 2024-09-02 11:53:36 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2024-09-02 11:53:36 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.snapd_refresh 2024-09-02 11:53:37 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.snapd_refresh 2024-09-02 11:53:37 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.port 2024-09-02 11:53:37 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.port 2024-09-02 11:53:37 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.management_port 2024-09-02 11:53:37 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.management_port 2024-09-02 11:53:37 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.channel 2024-09-02 11:53:37 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.channel 2024-09-02 11:53:37 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.bind_to_all_interfaces 2024-09-02 11:53:37 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.bind_to_all_interfaces 2024-09-02 11:53:37 INFO unit.etcd/0.juju-log server.go:316 Initializing Leadership Layer (is leader) 2024-09-02 11:53:37 INFO unit.etcd/0.juju-log server.go:316 Initializing Snap Layer 2024-09-02 11:53:37 DEBUG unit.etcd/0.update-status logger.go:60 none 2024-09-02 11:53:37 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: starting handler dispatch, 53 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.batch.cert.available tracer: set flag certificates.ca.available tracer: set flag certificates.certs.available tracer: set flag certificates.client.cert.available tracer: set flag certificates.server.cert.available tracer: set flag certificates.server.certs.available tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.etcd_0.server.cert tracer: set flag endpoint.certificates.changed.etcd_0.server.key tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.leader.configured tracer: set flag etcd.registered tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag etcd.ssl.placed tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster tracer: set flag leadership.set.leader_address tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca_installed tracer: set flag tls_client.certs.saved tracer: set flag tls_client.client.certificate.saved tracer: set flag tls_client.client.key.saved tracer: set flag tls_client.server.certificate.saved tracer: set flag tls_client.server.key.saved 2024-09-02 11:53:37 DEBUG unit.etcd/0.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-09-02 11:53:37 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: main dispatch loop, 9 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:282:send_single_connection_details tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-02 11:53:37 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:95:check_cluster_health 2024-09-02 11:53:37 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-02 11:53:39 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-02 11:53:39 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:282:send_single_connection_details 2024-09-02 11:53:39 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:488:process_snapd_timer 2024-09-02 11:53:39 INFO unit.etcd/0.juju-log server.go:316 Get config refresh.timer for snap core 2024-09-02 11:53:39 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:18:store_ca 2024-09-02 11:53:39 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:44:store_server 2024-09-02 11:53:39 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-02 11:53:39 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-02 11:53:39 INFO unit.etcd/0.juju-log server.go:316 status-set: active: Healthy with 1 known peer 2024-09-02 11:53:39 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-09-02 11:53:39 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for etcd/0 2024-09-02 11:53:39 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-02 11:53:39 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/0 uniter (run update-status hook) 2024-09-02 11:53:39 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/0 2024-09-02 11:53:39 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-02 11:53:39 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-02 11:53:39 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-02 11:58:12 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for etcd/0 2024-09-02 11:58:12 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-02 11:58:12 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-02 11:58:12 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-02 11:58:12 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for etcd/0 2024-09-02 11:58:12 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/0 uniter (run update-status hook) 2024-09-02 11:58:12 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/0 uniter (run update-status hook) 2024-09-02 11:58:12 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for etcd/0 2024-09-02 11:58:12 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for etcd/0 2024-09-02 11:58:12 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-0/agent.socket } 2024-09-02 11:58:13 INFO unit.etcd/0.juju-log server.go:316 Reactive main running for hook update-status 2024-09-02 11:58:13 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:282:send_single_connection_details tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-02 11:58:13 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.nagios_context 2024-09-02 11:58:13 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2024-09-02 11:58:13 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.snapd_refresh 2024-09-02 11:58:13 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.snapd_refresh 2024-09-02 11:58:13 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.port 2024-09-02 11:58:13 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.port 2024-09-02 11:58:13 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.management_port 2024-09-02 11:58:13 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.management_port 2024-09-02 11:58:13 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.channel 2024-09-02 11:58:13 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.channel 2024-09-02 11:58:13 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.bind_to_all_interfaces 2024-09-02 11:58:13 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.bind_to_all_interfaces 2024-09-02 11:58:13 INFO unit.etcd/0.juju-log server.go:316 Initializing Leadership Layer (is leader) 2024-09-02 11:58:13 INFO unit.etcd/0.juju-log server.go:316 Initializing Snap Layer 2024-09-02 11:58:13 DEBUG unit.etcd/0.update-status logger.go:60 none 2024-09-02 11:58:13 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: starting handler dispatch, 53 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.batch.cert.available tracer: set flag certificates.ca.available tracer: set flag certificates.certs.available tracer: set flag certificates.client.cert.available tracer: set flag certificates.server.cert.available tracer: set flag certificates.server.certs.available tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.etcd_0.server.cert tracer: set flag endpoint.certificates.changed.etcd_0.server.key tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.leader.configured tracer: set flag etcd.registered tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag etcd.ssl.placed tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster tracer: set flag leadership.set.leader_address tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca_installed tracer: set flag tls_client.certs.saved tracer: set flag tls_client.client.certificate.saved tracer: set flag tls_client.client.key.saved tracer: set flag tls_client.server.certificate.saved tracer: set flag tls_client.server.key.saved 2024-09-02 11:58:13 DEBUG unit.etcd/0.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-09-02 11:58:13 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: main dispatch loop, 9 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:282:send_single_connection_details tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-02 11:58:13 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:95:check_cluster_health 2024-09-02 11:58:13 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-02 11:58:13 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-02 11:58:13 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:282:send_single_connection_details 2024-09-02 11:58:13 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:488:process_snapd_timer 2024-09-02 11:58:13 INFO unit.etcd/0.juju-log server.go:316 Get config refresh.timer for snap core 2024-09-02 11:58:13 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:18:store_ca 2024-09-02 11:58:13 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:44:store_server 2024-09-02 11:58:13 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-02 11:58:13 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-02 11:58:13 INFO unit.etcd/0.juju-log server.go:316 status-set: active: Healthy with 1 known peer 2024-09-02 11:58:14 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-09-02 11:58:14 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for etcd/0 2024-09-02 11:58:14 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-02 11:58:14 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/0 uniter (run update-status hook) 2024-09-02 11:58:14 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/0 2024-09-02 11:58:14 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-02 11:58:14 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-02 11:58:14 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-02 12:03:20 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for etcd/0 2024-09-02 12:03:20 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-02 12:03:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-02 12:03:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-02 12:03:20 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for etcd/0 2024-09-02 12:03:20 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/0 uniter (run update-status hook) 2024-09-02 12:03:21 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/0 uniter (run update-status hook) 2024-09-02 12:03:21 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for etcd/0 2024-09-02 12:03:21 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for etcd/0 2024-09-02 12:03:21 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-0/agent.socket } 2024-09-02 12:03:21 INFO unit.etcd/0.juju-log server.go:316 Reactive main running for hook update-status 2024-09-02 12:03:22 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:282:send_single_connection_details tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-02 12:03:22 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.nagios_context 2024-09-02 12:03:22 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2024-09-02 12:03:22 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.snapd_refresh 2024-09-02 12:03:22 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.snapd_refresh 2024-09-02 12:03:22 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.port 2024-09-02 12:03:22 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.port 2024-09-02 12:03:22 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.management_port 2024-09-02 12:03:22 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.management_port 2024-09-02 12:03:22 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.channel 2024-09-02 12:03:22 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.channel 2024-09-02 12:03:22 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.bind_to_all_interfaces 2024-09-02 12:03:22 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.bind_to_all_interfaces 2024-09-02 12:03:22 INFO unit.etcd/0.juju-log server.go:316 Initializing Leadership Layer (is leader) 2024-09-02 12:03:22 INFO unit.etcd/0.juju-log server.go:316 Initializing Snap Layer 2024-09-02 12:03:22 DEBUG unit.etcd/0.update-status logger.go:60 none 2024-09-02 12:03:22 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: starting handler dispatch, 53 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.batch.cert.available tracer: set flag certificates.ca.available tracer: set flag certificates.certs.available tracer: set flag certificates.client.cert.available tracer: set flag certificates.server.cert.available tracer: set flag certificates.server.certs.available tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.etcd_0.server.cert tracer: set flag endpoint.certificates.changed.etcd_0.server.key tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.leader.configured tracer: set flag etcd.registered tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag etcd.ssl.placed tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster tracer: set flag leadership.set.leader_address tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca_installed tracer: set flag tls_client.certs.saved tracer: set flag tls_client.client.certificate.saved tracer: set flag tls_client.client.key.saved tracer: set flag tls_client.server.certificate.saved tracer: set flag tls_client.server.key.saved 2024-09-02 12:03:22 DEBUG unit.etcd/0.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-09-02 12:03:22 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: main dispatch loop, 9 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:282:send_single_connection_details tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-02 12:03:22 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:95:check_cluster_health 2024-09-02 12:03:22 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-02 12:03:22 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-02 12:03:22 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:282:send_single_connection_details 2024-09-02 12:03:22 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:488:process_snapd_timer 2024-09-02 12:03:22 INFO unit.etcd/0.juju-log server.go:316 Get config refresh.timer for snap core 2024-09-02 12:03:22 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:18:store_ca 2024-09-02 12:03:22 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:44:store_server 2024-09-02 12:03:22 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-02 12:03:22 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-02 12:03:22 INFO unit.etcd/0.juju-log server.go:316 status-set: active: Healthy with 1 known peer 2024-09-02 12:03:22 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-09-02 12:03:23 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for etcd/0 2024-09-02 12:03:23 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-02 12:03:23 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/0 uniter (run update-status hook) 2024-09-02 12:03:23 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/0 2024-09-02 12:03:23 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-02 12:03:23 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-02 12:03:23 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-02 12:09:14 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for etcd/0 2024-09-02 12:09:14 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-02 12:09:14 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-02 12:09:14 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-02 12:09:14 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for etcd/0 2024-09-02 12:09:14 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/0 uniter (run update-status hook) 2024-09-02 12:09:14 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/0 uniter (run update-status hook) 2024-09-02 12:09:14 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for etcd/0 2024-09-02 12:09:14 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for etcd/0 2024-09-02 12:09:14 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-0/agent.socket } 2024-09-02 12:09:14 INFO unit.etcd/0.juju-log server.go:316 Reactive main running for hook update-status 2024-09-02 12:09:14 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:282:send_single_connection_details tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-02 12:09:14 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.nagios_context 2024-09-02 12:09:14 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2024-09-02 12:09:14 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.snapd_refresh 2024-09-02 12:09:14 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.snapd_refresh 2024-09-02 12:09:14 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.port 2024-09-02 12:09:14 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.port 2024-09-02 12:09:14 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.management_port 2024-09-02 12:09:14 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.management_port 2024-09-02 12:09:14 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.channel 2024-09-02 12:09:14 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.channel 2024-09-02 12:09:14 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.bind_to_all_interfaces 2024-09-02 12:09:14 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.bind_to_all_interfaces 2024-09-02 12:09:14 INFO unit.etcd/0.juju-log server.go:316 Initializing Leadership Layer (is leader) 2024-09-02 12:09:14 INFO unit.etcd/0.juju-log server.go:316 Initializing Snap Layer 2024-09-02 12:09:14 DEBUG unit.etcd/0.update-status logger.go:60 none 2024-09-02 12:09:14 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: starting handler dispatch, 53 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.batch.cert.available tracer: set flag certificates.ca.available tracer: set flag certificates.certs.available tracer: set flag certificates.client.cert.available tracer: set flag certificates.server.cert.available tracer: set flag certificates.server.certs.available tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.etcd_0.server.cert tracer: set flag endpoint.certificates.changed.etcd_0.server.key tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.leader.configured tracer: set flag etcd.registered tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag etcd.ssl.placed tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster tracer: set flag leadership.set.leader_address tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca_installed tracer: set flag tls_client.certs.saved tracer: set flag tls_client.client.certificate.saved tracer: set flag tls_client.client.key.saved tracer: set flag tls_client.server.certificate.saved tracer: set flag tls_client.server.key.saved 2024-09-02 12:09:14 DEBUG unit.etcd/0.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-09-02 12:09:14 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: main dispatch loop, 9 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:282:send_single_connection_details tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-02 12:09:14 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:95:check_cluster_health 2024-09-02 12:09:14 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-02 12:09:14 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-02 12:09:14 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:282:send_single_connection_details 2024-09-02 12:09:15 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:488:process_snapd_timer 2024-09-02 12:09:15 INFO unit.etcd/0.juju-log server.go:316 Get config refresh.timer for snap core 2024-09-02 12:09:15 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:18:store_ca 2024-09-02 12:09:15 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:44:store_server 2024-09-02 12:09:15 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-02 12:09:15 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-02 12:09:15 INFO unit.etcd/0.juju-log server.go:316 status-set: active: Healthy with 1 known peer 2024-09-02 12:09:15 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-09-02 12:09:15 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for etcd/0 2024-09-02 12:09:15 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-02 12:09:15 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/0 uniter (run update-status hook) 2024-09-02 12:09:15 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/0 2024-09-02 12:09:15 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-02 12:09:15 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-02 12:09:15 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-02 12:14:53 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for etcd/0 2024-09-02 12:14:53 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-02 12:14:53 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-02 12:14:53 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-02 12:14:53 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for etcd/0 2024-09-02 12:14:53 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/0 uniter (run update-status hook) 2024-09-02 12:14:53 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/0 uniter (run update-status hook) 2024-09-02 12:14:53 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for etcd/0 2024-09-02 12:14:53 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for etcd/0 2024-09-02 12:14:53 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-0/agent.socket } 2024-09-02 12:14:53 INFO unit.etcd/0.juju-log server.go:316 Reactive main running for hook update-status 2024-09-02 12:14:53 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:282:send_single_connection_details tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-02 12:14:53 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.nagios_context 2024-09-02 12:14:53 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2024-09-02 12:14:53 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.snapd_refresh 2024-09-02 12:14:53 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.snapd_refresh 2024-09-02 12:14:53 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.port 2024-09-02 12:14:53 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.port 2024-09-02 12:14:53 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.management_port 2024-09-02 12:14:53 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.management_port 2024-09-02 12:14:53 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.channel 2024-09-02 12:14:53 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.channel 2024-09-02 12:14:53 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.bind_to_all_interfaces 2024-09-02 12:14:53 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.bind_to_all_interfaces 2024-09-02 12:14:53 INFO unit.etcd/0.juju-log server.go:316 Initializing Leadership Layer (is leader) 2024-09-02 12:14:53 INFO unit.etcd/0.juju-log server.go:316 Initializing Snap Layer 2024-09-02 12:14:53 DEBUG unit.etcd/0.update-status logger.go:60 none 2024-09-02 12:14:53 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: starting handler dispatch, 53 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.batch.cert.available tracer: set flag certificates.ca.available tracer: set flag certificates.certs.available tracer: set flag certificates.client.cert.available tracer: set flag certificates.server.cert.available tracer: set flag certificates.server.certs.available tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.etcd_0.server.cert tracer: set flag endpoint.certificates.changed.etcd_0.server.key tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.leader.configured tracer: set flag etcd.registered tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag etcd.ssl.placed tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster tracer: set flag leadership.set.leader_address tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca_installed tracer: set flag tls_client.certs.saved tracer: set flag tls_client.client.certificate.saved tracer: set flag tls_client.client.key.saved tracer: set flag tls_client.server.certificate.saved tracer: set flag tls_client.server.key.saved 2024-09-02 12:14:53 DEBUG unit.etcd/0.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-09-02 12:14:53 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: main dispatch loop, 9 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:282:send_single_connection_details tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-02 12:14:53 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:95:check_cluster_health 2024-09-02 12:14:54 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-02 12:14:54 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-02 12:14:54 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:282:send_single_connection_details 2024-09-02 12:14:54 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:488:process_snapd_timer 2024-09-02 12:14:54 INFO unit.etcd/0.juju-log server.go:316 Get config refresh.timer for snap core 2024-09-02 12:14:54 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:18:store_ca 2024-09-02 12:14:54 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:44:store_server 2024-09-02 12:14:54 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-02 12:14:54 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-02 12:14:54 INFO unit.etcd/0.juju-log server.go:316 status-set: active: Healthy with 1 known peer 2024-09-02 12:14:55 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-09-02 12:14:55 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for etcd/0 2024-09-02 12:14:55 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-02 12:14:55 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/0 uniter (run update-status hook) 2024-09-02 12:14:55 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/0 2024-09-02 12:14:55 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-02 12:14:55 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-02 12:14:55 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-02 12:18:33 DEBUG juju.worker.uniter.remotestate watcher.go:623 got update status interval change for etcd/0: ok=true 2024-09-02 12:18:33 DEBUG juju.worker.retrystrategy worker.go:92 bouncing retrystrategy worker to get new values 2024-09-02 12:18:33 DEBUG juju.worker.dependency engine.go:621 "hook-retry-strategy" manifold worker stopped: restart immediately 2024-09-02 12:18:33 DEBUG juju.worker.uniter runlistener.go:130 juju-run listener stopping 2024-09-02 12:18:33 DEBUG juju.worker.uniter runlistener.go:149 juju-run listener stopped 2024-09-02 12:18:33 INFO juju.worker.uniter uniter.go:319 unit "etcd/0" shutting down: catacomb 0xc000ff8900 is dying 2024-09-02 12:18:33 DEBUG juju.worker.dependency engine.go:580 "hook-retry-strategy" manifold worker started at 2024-09-02 12:18:33.48077458 +0000 UTC 2024-09-02 12:18:33 DEBUG juju.worker.dependency engine.go:603 "uniter" manifold worker completed successfully 2024-09-02 12:18:33 DEBUG juju.worker.dependency engine.go:580 "uniter" manifold worker started at 2024-09-02 12:18:33.490850362 +0000 UTC 2024-09-02 12:18:33 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "etcd/0" (leader=true) entered scope for relation "etcd:cluster" 2024-09-02 12:18:33 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "etcd/0" (leader=true) entered scope for relation "etcd:certificates easyrsa:client" 2024-09-02 12:18:33 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "etcd/0" (leader=true) entered scope for relation "kubernetes-master:etcd etcd:db" 2024-09-02 12:18:33 DEBUG juju.worker.uniter uniter.go:883 starting local juju-run listener on {unix /var/lib/juju/agents/unit-etcd-0/run.socket } 2024-09-02 12:18:33 INFO juju.worker.uniter uniter.go:335 unit "etcd/0" started 2024-09-02 12:18:33 DEBUG juju.worker.uniter runlistener.go:117 juju-run listener running 2024-09-02 12:18:33 INFO juju.worker.uniter uniter.go:361 hooks are retried false 2024-09-02 12:18:33 DEBUG juju.worker.uniter.remotestate watcher.go:564 got upgrade series change 2024-09-02 12:18:33 DEBUG juju.worker.uniter.remotestate watcher.go:714 no upgrade series in progress, reinitializing local upgrade series state 2024-09-02 12:18:33 DEBUG juju.worker.uniter.remotestate watcher.go:553 got trust config change for etcd/0: ok=true, hashes=[17f2acda51310eebc7ec5fc33ba3e24c9838f484cf50956f7b6066f1d8bba28f] 2024-09-02 12:18:33 DEBUG juju.worker.uniter.remotestate watcher.go:499 got application change for etcd/0 2024-09-02 12:18:33 DEBUG juju.worker.uniter.remotestate watcher.go:613 got storage change for etcd/0: [] ok=true 2024-09-02 12:18:33 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for etcd/0: ok=true 2024-09-02 12:18:33 DEBUG juju.worker.uniter.remotestate watcher.go:574 got address change for etcd/0: ok=true, hashes=[883fb12aa234ef06159f66d43c02fb052e704d5b56baad6138abe77b3dc439f8] 2024-09-02 12:18:33 DEBUG juju.worker.uniter.remotestate watcher.go:595 got action change for etcd/0: [] ok=true 2024-09-02 12:18:33 DEBUG juju.worker.uniter.remotestate watcher.go:623 got update status interval change for etcd/0: ok=true 2024-09-02 12:18:33 DEBUG juju.worker.uniter.remotestate watcher.go:489 got unit change for etcd/0 2024-09-02 12:18:33 DEBUG juju.worker.uniter.remotestate watcher.go:542 got config change for etcd/0: ok=true, hashes=[51e9e2593d2d2d48099fb3c0fe9760058a9f2043cb2eddd9a7a27cc5b8850729] 2024-09-02 12:18:33 DEBUG juju.worker.uniter.remotestate watcher.go:603 got relations change for etcd/0: ok=true 2024-09-02 12:18:33 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-02 12:18:33 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-02 12:18:33 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-02 12:18:33 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 2024-09-02 12:22:44 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for etcd/0 2024-09-02 12:22:48 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-02 12:22:48 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-02 12:22:48 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-02 12:22:48 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for etcd/0 2024-09-02 12:22:48 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/0 uniter (run update-status hook) 2024-09-02 12:23:47 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/0 uniter (run update-status hook) 2024-09-02 12:23:47 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for etcd/0 2024-09-02 12:23:47 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for etcd/0 2024-09-02 12:23:47 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-0/agent.socket } 2024-09-02 12:23:47 INFO unit.etcd/0.juju-log server.go:316 Reactive main running for hook update-status 2024-09-02 12:23:47 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:282:send_single_connection_details tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-02 12:23:47 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.nagios_context 2024-09-02 12:23:47 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2024-09-02 12:23:47 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.snapd_refresh 2024-09-02 12:23:47 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.snapd_refresh 2024-09-02 12:23:47 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.port 2024-09-02 12:23:47 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.port 2024-09-02 12:23:47 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.management_port 2024-09-02 12:23:47 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.management_port 2024-09-02 12:23:47 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.channel 2024-09-02 12:23:47 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.channel 2024-09-02 12:23:47 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.bind_to_all_interfaces 2024-09-02 12:23:47 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.bind_to_all_interfaces 2024-09-02 12:23:47 INFO unit.etcd/0.juju-log server.go:316 Initializing Leadership Layer (is leader) 2024-09-02 12:23:47 INFO unit.etcd/0.juju-log server.go:316 Initializing Snap Layer 2024-09-02 12:23:47 DEBUG unit.etcd/0.update-status logger.go:60 none 2024-09-02 12:23:47 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: starting handler dispatch, 53 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.batch.cert.available tracer: set flag certificates.ca.available tracer: set flag certificates.certs.available tracer: set flag certificates.client.cert.available tracer: set flag certificates.server.cert.available tracer: set flag certificates.server.certs.available tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.etcd_0.server.cert tracer: set flag endpoint.certificates.changed.etcd_0.server.key tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.leader.configured tracer: set flag etcd.registered tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag etcd.ssl.placed tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster tracer: set flag leadership.set.leader_address tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca_installed tracer: set flag tls_client.certs.saved tracer: set flag tls_client.client.certificate.saved tracer: set flag tls_client.client.key.saved tracer: set flag tls_client.server.certificate.saved tracer: set flag tls_client.server.key.saved 2024-09-02 12:23:47 DEBUG unit.etcd/0.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-09-02 12:23:47 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: main dispatch loop, 9 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:282:send_single_connection_details tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-02 12:23:47 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:95:check_cluster_health 2024-09-02 12:23:48 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-02 12:23:48 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-02 12:23:48 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:282:send_single_connection_details 2024-09-02 12:23:48 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:488:process_snapd_timer 2024-09-02 12:23:48 INFO unit.etcd/0.juju-log server.go:316 Get config refresh.timer for snap core 2024-09-02 12:23:48 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:18:store_ca 2024-09-02 12:23:48 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:44:store_server 2024-09-02 12:23:48 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-02 12:23:48 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-02 12:23:48 INFO unit.etcd/0.juju-log server.go:316 status-set: active: Healthy with 1 known peer 2024-09-02 12:23:48 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-09-02 12:23:48 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for etcd/0 2024-09-02 12:23:48 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-02 12:23:48 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/0 uniter (run update-status hook) 2024-09-02 12:23:48 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/0 2024-09-02 12:23:48 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-02 12:23:48 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-02 12:23:48 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-02 12:27:23 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for etcd/0 2024-09-02 12:27:23 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-02 12:27:23 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-02 12:27:23 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-02 12:27:23 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for etcd/0 2024-09-02 12:27:23 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/0 uniter (run update-status hook) 2024-09-02 12:28:33 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/0 uniter (run update-status hook) 2024-09-02 12:28:33 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for etcd/0 2024-09-02 12:28:33 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for etcd/0 2024-09-02 12:28:33 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-0/agent.socket } 2024-09-02 12:28:34 INFO unit.etcd/0.juju-log server.go:316 Reactive main running for hook update-status 2024-09-02 12:28:34 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:282:send_single_connection_details tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-02 12:28:34 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.nagios_context 2024-09-02 12:28:34 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2024-09-02 12:28:34 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.snapd_refresh 2024-09-02 12:28:34 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.snapd_refresh 2024-09-02 12:28:34 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.port 2024-09-02 12:28:34 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.port 2024-09-02 12:28:34 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.management_port 2024-09-02 12:28:34 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.management_port 2024-09-02 12:28:34 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.channel 2024-09-02 12:28:34 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.channel 2024-09-02 12:28:34 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.bind_to_all_interfaces 2024-09-02 12:28:34 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.bind_to_all_interfaces 2024-09-02 12:28:34 INFO unit.etcd/0.juju-log server.go:316 Initializing Leadership Layer (is leader) 2024-09-02 12:28:34 INFO unit.etcd/0.juju-log server.go:316 Initializing Snap Layer 2024-09-02 12:28:34 DEBUG unit.etcd/0.update-status logger.go:60 none 2024-09-02 12:28:34 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: starting handler dispatch, 53 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.batch.cert.available tracer: set flag certificates.ca.available tracer: set flag certificates.certs.available tracer: set flag certificates.client.cert.available tracer: set flag certificates.server.cert.available tracer: set flag certificates.server.certs.available tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.etcd_0.server.cert tracer: set flag endpoint.certificates.changed.etcd_0.server.key tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.leader.configured tracer: set flag etcd.registered tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag etcd.ssl.placed tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster tracer: set flag leadership.set.leader_address tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca_installed tracer: set flag tls_client.certs.saved tracer: set flag tls_client.client.certificate.saved tracer: set flag tls_client.client.key.saved tracer: set flag tls_client.server.certificate.saved tracer: set flag tls_client.server.key.saved 2024-09-02 12:28:34 DEBUG unit.etcd/0.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-09-02 12:28:34 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: main dispatch loop, 9 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:282:send_single_connection_details tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-02 12:28:34 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:95:check_cluster_health 2024-09-02 12:28:35 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-02 12:28:35 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-02 12:28:35 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:282:send_single_connection_details 2024-09-02 12:28:35 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:488:process_snapd_timer 2024-09-02 12:28:35 INFO unit.etcd/0.juju-log server.go:316 Get config refresh.timer for snap core 2024-09-02 12:28:35 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:18:store_ca 2024-09-02 12:28:35 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:44:store_server 2024-09-02 12:28:35 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-02 12:28:35 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-02 12:28:35 INFO unit.etcd/0.juju-log server.go:316 status-set: active: Healthy with 1 known peer 2024-09-02 12:28:36 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-09-02 12:28:36 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for etcd/0 2024-09-02 12:28:36 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-02 12:28:36 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/0 uniter (run update-status hook) 2024-09-02 12:28:36 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/0 2024-09-02 12:28:36 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-02 12:28:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-02 12:28:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-02 12:33:21 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for etcd/0 2024-09-02 12:33:21 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-02 12:33:21 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-02 12:33:21 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-02 12:33:21 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for etcd/0 2024-09-02 12:33:21 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/0 uniter (run update-status hook) 2024-09-02 12:33:43 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/0 uniter (run update-status hook) 2024-09-02 12:33:43 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for etcd/0 2024-09-02 12:33:43 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for etcd/0 2024-09-02 12:33:43 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-0/agent.socket } 2024-09-02 12:33:44 INFO unit.etcd/0.juju-log server.go:316 Reactive main running for hook update-status 2024-09-02 12:33:44 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:282:send_single_connection_details tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-02 12:33:44 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.nagios_context 2024-09-02 12:33:44 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2024-09-02 12:33:44 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.snapd_refresh 2024-09-02 12:33:44 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.snapd_refresh 2024-09-02 12:33:44 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.port 2024-09-02 12:33:44 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.port 2024-09-02 12:33:44 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.management_port 2024-09-02 12:33:44 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.management_port 2024-09-02 12:33:44 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.channel 2024-09-02 12:33:44 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.channel 2024-09-02 12:33:44 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.bind_to_all_interfaces 2024-09-02 12:33:44 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.bind_to_all_interfaces 2024-09-02 12:33:44 INFO unit.etcd/0.juju-log server.go:316 Initializing Leadership Layer (is leader) 2024-09-02 12:33:44 INFO unit.etcd/0.juju-log server.go:316 Initializing Snap Layer 2024-09-02 12:33:44 DEBUG unit.etcd/0.update-status logger.go:60 none 2024-09-02 12:33:44 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: starting handler dispatch, 53 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.batch.cert.available tracer: set flag certificates.ca.available tracer: set flag certificates.certs.available tracer: set flag certificates.client.cert.available tracer: set flag certificates.server.cert.available tracer: set flag certificates.server.certs.available tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.etcd_0.server.cert tracer: set flag endpoint.certificates.changed.etcd_0.server.key tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.leader.configured tracer: set flag etcd.registered tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag etcd.ssl.placed tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster tracer: set flag leadership.set.leader_address tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca_installed tracer: set flag tls_client.certs.saved tracer: set flag tls_client.client.certificate.saved tracer: set flag tls_client.client.key.saved tracer: set flag tls_client.server.certificate.saved tracer: set flag tls_client.server.key.saved 2024-09-02 12:33:44 DEBUG unit.etcd/0.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-09-02 12:33:44 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: main dispatch loop, 9 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:282:send_single_connection_details tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-02 12:33:44 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:95:check_cluster_health 2024-09-02 12:33:44 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-02 12:33:44 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-02 12:33:44 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:282:send_single_connection_details 2024-09-02 12:33:45 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:488:process_snapd_timer 2024-09-02 12:33:45 INFO unit.etcd/0.juju-log server.go:316 Get config refresh.timer for snap core 2024-09-02 12:33:45 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:18:store_ca 2024-09-02 12:33:45 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:44:store_server 2024-09-02 12:33:45 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-02 12:33:45 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-02 12:33:45 INFO unit.etcd/0.juju-log server.go:316 status-set: active: Healthy with 1 known peer 2024-09-02 12:33:45 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-09-02 12:33:46 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for etcd/0 2024-09-02 12:33:46 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-02 12:33:46 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/0 uniter (run update-status hook) 2024-09-02 12:33:46 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/0 2024-09-02 12:33:46 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-02 12:33:46 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-02 12:33:46 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-02 12:37:30 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for etcd/0 2024-09-02 12:37:30 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-02 12:37:30 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-02 12:37:30 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-02 12:37:30 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for etcd/0 2024-09-02 12:37:30 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/0 uniter (run update-status hook) 2024-09-02 12:37:37 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/0 uniter (run update-status hook) 2024-09-02 12:37:37 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for etcd/0 2024-09-02 12:37:38 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for etcd/0 2024-09-02 12:37:38 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-0/agent.socket } 2024-09-02 12:37:38 INFO unit.etcd/0.juju-log server.go:316 Reactive main running for hook update-status 2024-09-02 12:37:38 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:282:send_single_connection_details tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-02 12:37:38 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.nagios_context 2024-09-02 12:37:38 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2024-09-02 12:37:38 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.snapd_refresh 2024-09-02 12:37:38 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.snapd_refresh 2024-09-02 12:37:38 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.port 2024-09-02 12:37:38 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.port 2024-09-02 12:37:38 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.management_port 2024-09-02 12:37:38 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.management_port 2024-09-02 12:37:38 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.channel 2024-09-02 12:37:38 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.channel 2024-09-02 12:37:38 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.bind_to_all_interfaces 2024-09-02 12:37:38 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.bind_to_all_interfaces 2024-09-02 12:37:38 INFO unit.etcd/0.juju-log server.go:316 Initializing Leadership Layer (is leader) 2024-09-02 12:37:38 INFO unit.etcd/0.juju-log server.go:316 Initializing Snap Layer 2024-09-02 12:37:38 DEBUG unit.etcd/0.update-status logger.go:60 none 2024-09-02 12:37:38 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: starting handler dispatch, 53 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.batch.cert.available tracer: set flag certificates.ca.available tracer: set flag certificates.certs.available tracer: set flag certificates.client.cert.available tracer: set flag certificates.server.cert.available tracer: set flag certificates.server.certs.available tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.etcd_0.server.cert tracer: set flag endpoint.certificates.changed.etcd_0.server.key tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.leader.configured tracer: set flag etcd.registered tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag etcd.ssl.placed tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster tracer: set flag leadership.set.leader_address tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca_installed tracer: set flag tls_client.certs.saved tracer: set flag tls_client.client.certificate.saved tracer: set flag tls_client.client.key.saved tracer: set flag tls_client.server.certificate.saved tracer: set flag tls_client.server.key.saved 2024-09-02 12:37:38 DEBUG unit.etcd/0.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-09-02 12:37:38 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: main dispatch loop, 9 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:282:send_single_connection_details tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-02 12:37:38 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:95:check_cluster_health 2024-09-02 12:37:38 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-02 12:37:38 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-02 12:37:39 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:282:send_single_connection_details 2024-09-02 12:37:39 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:488:process_snapd_timer 2024-09-02 12:37:39 INFO unit.etcd/0.juju-log server.go:316 Get config refresh.timer for snap core 2024-09-02 12:37:39 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:18:store_ca 2024-09-02 12:37:39 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:44:store_server 2024-09-02 12:37:39 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-02 12:37:39 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-02 12:37:39 INFO unit.etcd/0.juju-log server.go:316 status-set: active: Healthy with 1 known peer 2024-09-02 12:37:39 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-09-02 12:37:39 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for etcd/0 2024-09-02 12:37:39 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-02 12:37:39 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/0 uniter (run update-status hook) 2024-09-02 12:37:39 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/0 2024-09-02 12:37:39 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-02 12:37:39 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-02 12:37:39 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-02 12:41:54 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for etcd/0 2024-09-02 12:41:54 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-02 12:41:54 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-02 12:41:54 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-02 12:41:54 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for etcd/0 2024-09-02 12:41:54 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/0 uniter (run update-status hook) 2024-09-02 12:42:05 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/0 uniter (run update-status hook) 2024-09-02 12:42:05 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for etcd/0 2024-09-02 12:42:05 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for etcd/0 2024-09-02 12:42:05 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-0/agent.socket } 2024-09-02 12:42:05 INFO unit.etcd/0.juju-log server.go:316 Reactive main running for hook update-status 2024-09-02 12:42:05 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:282:send_single_connection_details tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-02 12:42:05 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.nagios_context 2024-09-02 12:42:05 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2024-09-02 12:42:05 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.snapd_refresh 2024-09-02 12:42:05 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.snapd_refresh 2024-09-02 12:42:05 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.port 2024-09-02 12:42:05 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.port 2024-09-02 12:42:05 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.management_port 2024-09-02 12:42:05 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.management_port 2024-09-02 12:42:05 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.channel 2024-09-02 12:42:05 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.channel 2024-09-02 12:42:06 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.bind_to_all_interfaces 2024-09-02 12:42:06 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.bind_to_all_interfaces 2024-09-02 12:42:06 INFO unit.etcd/0.juju-log server.go:316 Initializing Leadership Layer (is leader) 2024-09-02 12:42:06 INFO unit.etcd/0.juju-log server.go:316 Initializing Snap Layer 2024-09-02 12:42:06 DEBUG unit.etcd/0.update-status logger.go:60 none 2024-09-02 12:42:06 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: starting handler dispatch, 53 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.batch.cert.available tracer: set flag certificates.ca.available tracer: set flag certificates.certs.available tracer: set flag certificates.client.cert.available tracer: set flag certificates.server.cert.available tracer: set flag certificates.server.certs.available tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.etcd_0.server.cert tracer: set flag endpoint.certificates.changed.etcd_0.server.key tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.leader.configured tracer: set flag etcd.registered tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag etcd.ssl.placed tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster tracer: set flag leadership.set.leader_address tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca_installed tracer: set flag tls_client.certs.saved tracer: set flag tls_client.client.certificate.saved tracer: set flag tls_client.client.key.saved tracer: set flag tls_client.server.certificate.saved tracer: set flag tls_client.server.key.saved 2024-09-02 12:42:06 DEBUG unit.etcd/0.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-09-02 12:42:06 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: main dispatch loop, 9 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:282:send_single_connection_details tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-02 12:42:06 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:95:check_cluster_health 2024-09-02 12:42:06 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-02 12:42:06 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-02 12:42:06 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:282:send_single_connection_details 2024-09-02 12:42:06 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:488:process_snapd_timer 2024-09-02 12:42:06 INFO unit.etcd/0.juju-log server.go:316 Get config refresh.timer for snap core 2024-09-02 12:42:06 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:18:store_ca 2024-09-02 12:42:06 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:44:store_server 2024-09-02 12:42:06 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-02 12:42:07 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-02 12:42:07 INFO unit.etcd/0.juju-log server.go:316 status-set: active: Healthy with 1 known peer 2024-09-02 12:42:07 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-09-02 12:42:07 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for etcd/0 2024-09-02 12:42:07 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-02 12:42:07 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/0 uniter (run update-status hook) 2024-09-02 12:42:07 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/0 2024-09-02 12:42:07 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-02 12:42:07 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-02 12:42:07 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-02 12:46:32 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for etcd/0 2024-09-02 12:46:32 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-02 12:46:32 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-02 12:46:32 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-02 12:46:32 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for etcd/0 2024-09-02 12:46:32 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/0 uniter (run update-status hook) 2024-09-02 12:46:34 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/0 uniter (run update-status hook) 2024-09-02 12:46:34 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for etcd/0 2024-09-02 12:46:34 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for etcd/0 2024-09-02 12:46:34 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-0/agent.socket } 2024-09-02 12:46:34 INFO unit.etcd/0.juju-log server.go:316 Reactive main running for hook update-status 2024-09-02 12:46:34 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:282:send_single_connection_details tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-02 12:46:34 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.nagios_context 2024-09-02 12:46:35 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2024-09-02 12:46:35 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.snapd_refresh 2024-09-02 12:46:35 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.snapd_refresh 2024-09-02 12:46:35 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.port 2024-09-02 12:46:35 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.port 2024-09-02 12:46:35 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.management_port 2024-09-02 12:46:35 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.management_port 2024-09-02 12:46:35 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.channel 2024-09-02 12:46:35 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.channel 2024-09-02 12:46:35 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.bind_to_all_interfaces 2024-09-02 12:46:35 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.bind_to_all_interfaces 2024-09-02 12:46:35 INFO unit.etcd/0.juju-log server.go:316 Initializing Leadership Layer (is leader) 2024-09-02 12:46:35 INFO unit.etcd/0.juju-log server.go:316 Initializing Snap Layer 2024-09-02 12:46:35 DEBUG unit.etcd/0.update-status logger.go:60 none 2024-09-02 12:46:35 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: starting handler dispatch, 53 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.batch.cert.available tracer: set flag certificates.ca.available tracer: set flag certificates.certs.available tracer: set flag certificates.client.cert.available tracer: set flag certificates.server.cert.available tracer: set flag certificates.server.certs.available tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.etcd_0.server.cert tracer: set flag endpoint.certificates.changed.etcd_0.server.key tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.leader.configured tracer: set flag etcd.registered tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag etcd.ssl.placed tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster tracer: set flag leadership.set.leader_address tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca_installed tracer: set flag tls_client.certs.saved tracer: set flag tls_client.client.certificate.saved tracer: set flag tls_client.client.key.saved tracer: set flag tls_client.server.certificate.saved tracer: set flag tls_client.server.key.saved 2024-09-02 12:46:35 DEBUG unit.etcd/0.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-09-02 12:46:35 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: main dispatch loop, 9 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:282:send_single_connection_details tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-02 12:46:35 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:95:check_cluster_health 2024-09-02 12:46:35 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-02 12:46:35 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-02 12:46:35 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:282:send_single_connection_details 2024-09-02 12:46:36 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:488:process_snapd_timer 2024-09-02 12:46:36 INFO unit.etcd/0.juju-log server.go:316 Get config refresh.timer for snap core 2024-09-02 12:46:36 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:18:store_ca 2024-09-02 12:46:36 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:44:store_server 2024-09-02 12:46:36 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-02 12:46:36 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-02 12:46:36 INFO unit.etcd/0.juju-log server.go:316 status-set: active: Healthy with 1 known peer 2024-09-02 12:46:38 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-09-02 12:46:38 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for etcd/0 2024-09-02 12:46:38 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-02 12:46:38 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/0 uniter (run update-status hook) 2024-09-02 12:46:38 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/0 2024-09-02 12:46:38 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-02 12:46:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-02 12:46:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-02 12:51:05 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for etcd/0 2024-09-02 12:51:05 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-02 12:51:05 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-02 12:51:05 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-02 12:51:05 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for etcd/0 2024-09-02 12:51:05 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/0 uniter (run update-status hook) 2024-09-02 12:51:43 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/0 uniter (run update-status hook) 2024-09-02 12:51:43 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for etcd/0 2024-09-02 12:51:43 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for etcd/0 2024-09-02 12:51:43 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-0/agent.socket } 2024-09-02 12:51:43 INFO unit.etcd/0.juju-log server.go:316 Reactive main running for hook update-status 2024-09-02 12:51:43 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:282:send_single_connection_details tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-02 12:51:43 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.nagios_context 2024-09-02 12:51:43 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2024-09-02 12:51:43 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.snapd_refresh 2024-09-02 12:51:43 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.snapd_refresh 2024-09-02 12:51:43 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.port 2024-09-02 12:51:43 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.port 2024-09-02 12:51:43 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.management_port 2024-09-02 12:51:43 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.management_port 2024-09-02 12:51:43 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.channel 2024-09-02 12:51:43 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.channel 2024-09-02 12:51:43 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.set.bind_to_all_interfaces 2024-09-02 12:51:43 DEBUG unit.etcd/0.juju-log server.go:316 tracer: set flag config.default.bind_to_all_interfaces 2024-09-02 12:51:43 INFO unit.etcd/0.juju-log server.go:316 Initializing Leadership Layer (is leader) 2024-09-02 12:51:43 INFO unit.etcd/0.juju-log server.go:316 Initializing Snap Layer 2024-09-02 12:51:43 DEBUG unit.etcd/0.update-status logger.go:60 none 2024-09-02 12:51:43 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: starting handler dispatch, 53 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.batch.cert.available tracer: set flag certificates.ca.available tracer: set flag certificates.certs.available tracer: set flag certificates.client.cert.available tracer: set flag certificates.server.cert.available tracer: set flag certificates.server.certs.available tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.etcd_0.server.cert tracer: set flag endpoint.certificates.changed.etcd_0.server.key tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.leader.configured tracer: set flag etcd.registered tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag etcd.ssl.placed tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster tracer: set flag leadership.set.leader_address tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca_installed tracer: set flag tls_client.certs.saved tracer: set flag tls_client.client.certificate.saved tracer: set flag tls_client.client.key.saved tracer: set flag tls_client.server.certificate.saved tracer: set flag tls_client.server.key.saved 2024-09-02 12:51:43 DEBUG unit.etcd/0.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-09-02 12:51:43 DEBUG unit.etcd/0.juju-log server.go:316 tracer> tracer: main dispatch loop, 9 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:282:send_single_connection_details tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-02 12:51:43 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:95:check_cluster_health 2024-09-02 12:51:44 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-02 12:51:44 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-02 12:51:44 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:282:send_single_connection_details 2024-09-02 12:51:44 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:488:process_snapd_timer 2024-09-02 12:51:44 INFO unit.etcd/0.juju-log server.go:316 Get config refresh.timer for snap core 2024-09-02 12:51:44 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:18:store_ca 2024-09-02 12:51:44 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:44:store_server 2024-09-02 12:51:44 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-02 12:51:44 INFO unit.etcd/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-02 12:51:44 INFO unit.etcd/0.juju-log server.go:316 status-set: active: Healthy with 1 known peer 2024-09-02 12:51:44 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-09-02 12:51:44 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for etcd/0 2024-09-02 12:51:44 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-02 12:51:44 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/0 uniter (run update-status hook) 2024-09-02 12:51:44 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/0 2024-09-02 12:51:44 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-02 12:51:44 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-02 12:51:44 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8