2024-09-14 07:03:07 INFO juju unit_agent.go:289 Starting unit workers for "etcd/1" 2024-09-14 07:03:07 INFO juju.worker.apicaller connect.go:163 [36d8fd] "unit-etcd-1" successfully connected to "10.0.0.42:17070" 2024-09-14 07:03:07 INFO juju.worker.apicaller connect.go:260 [36d8fd] password changed for "unit-etcd-1" 2024-09-14 07:03:07 INFO juju.worker.apicaller connect.go:163 [36d8fd] "unit-etcd-1" successfully connected to "252.42.0.1:17070" 2024-09-14 07:03:07 INFO juju.worker.migrationminion worker.go:142 migration phase is now: NONE 2024-09-14 07:03:07 INFO juju.worker.logger logger.go:120 logger worker started 2024-09-14 07:03:07 DEBUG juju.worker.dependency engine.go:580 "metric-sender" manifold worker started at 2024-09-14 07:03:07.363115927 +0000 UTC 2024-09-14 07:03:07 DEBUG juju.worker.dependency engine.go:580 "uniter" manifold worker started at 2024-09-14 07:03:07.367187128 +0000 UTC 2024-09-14 07:03:07 DEBUG juju.worker.apiaddressupdater apiaddressupdater.go:98 updating API hostPorts to [[10.0.0.42:17070 252.42.0.1:17070 127.0.0.1:17070 [::1]:17070]] 2024-09-14 07:03:07 DEBUG juju.worker.meterstatus connected.go:93 got meter status change signal from watcher 2024-09-14 07:03:07 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for meterstatus (meter-status-changed) 2024-09-14 07:03:07 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for meterstatus (meter-status-changed) 2024-09-14 07:03:07 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-1/agent.socket } 2024-09-14 07:03:07 ERROR juju.worker.meterstatus runner.go:93 error running "meter-status-changed": charm missing from disk 2024-09-14 07:03:07 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-14 07:03:07 DEBUG juju.machinelock machinelock.go:186 machine lock released for meterstatus (meter-status-changed) 2024-09-14 07:03:07 INFO juju.worker.upgrader upgrader.go:216 no waiter, upgrader is done 2024-09-14 07:03:07 DEBUG juju.worker.dependency engine.go:603 "upgrader" manifold worker completed successfully 2024-09-14 07:03:07 DEBUG juju.worker.uniter uniter.go:883 starting local juju-run listener on {unix /var/lib/juju/agents/unit-etcd-1/run.socket } 2024-09-14 07:03:07 INFO juju.worker.uniter uniter.go:335 unit "etcd/1" started 2024-09-14 07:03:07 DEBUG juju.worker.uniter runlistener.go:117 juju-run listener running 2024-09-14 07:03:07 INFO juju.worker.uniter uniter.go:651 resuming charm install 2024-09-14 07:03:07 DEBUG juju.worker.uniter.operation executor.go:85 running operation install cs:~containers/etcd-622 for etcd/1 2024-09-14 07:03:07 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "install cs:~containers/etcd-622" for etcd/1 2024-09-14 07:03:07 INFO juju.worker.uniter.charm bundles.go:81 downloading cs:~containers/etcd-622 from API server 2024-09-14 07:03:07 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "install cs:~containers/etcd-622" for etcd/1 2024-09-14 07:03:07 DEBUG juju.worker.uniter.charm manifest_deployer.go:143 preparing to deploy charm "cs:~containers/etcd-622" 2024-09-14 07:03:07 DEBUG juju.worker.uniter.charm manifest_deployer.go:132 deploying charm "cs:~containers/etcd-622" 2024-09-14 07:03:10 DEBUG juju.worker.uniter.charm manifest_deployer.go:164 finishing deploy of charm "cs:~containers/etcd-622" 2024-09-14 07:03:10 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "install cs:~containers/etcd-622" for etcd/1 2024-09-14 07:03:10 INFO juju.worker.uniter uniter.go:361 hooks are retried true 2024-09-14 07:03:10 DEBUG juju.worker.uniter.remotestate watcher.go:603 got relations change for etcd/1: ok=true 2024-09-14 07:03:10 DEBUG juju.worker.uniter.remotestate watcher.go:553 got trust config change for etcd/1: ok=true, hashes=[17f2acda51310eebc7ec5fc33ba3e24c9838f484cf50956f7b6066f1d8bba28f] 2024-09-14 07:03:10 DEBUG juju.worker.uniter.remotestate watcher.go:595 got action change for etcd/1: [] ok=true 2024-09-14 07:03:10 DEBUG juju.worker.uniter.remotestate watcher.go:623 got update status interval change for etcd/1: ok=true 2024-09-14 07:03:10 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for etcd/1: ok=true 2024-09-14 07:03:10 DEBUG juju.worker.uniter.remotestate watcher.go:564 got upgrade series change 2024-09-14 07:03:10 DEBUG juju.worker.uniter.remotestate watcher.go:714 no upgrade series in progress, reinitializing local upgrade series state 2024-09-14 07:03:10 DEBUG juju.worker.uniter.remotestate watcher.go:613 got storage change for etcd/1: [] ok=true 2024-09-14 07:03:10 DEBUG juju.worker.uniter.remotestate watcher.go:499 got application change for etcd/1 2024-09-14 07:03:10 DEBUG juju.worker.uniter.remotestate watcher.go:542 got config change for etcd/1: ok=true, hashes=[51e9e2593d2d2d48099fb3c0fe9760058a9f2043cb2eddd9a7a27cc5b8850729] 2024-09-14 07:03:10 DEBUG juju.worker.uniter.remotestate watcher.go:574 got address change for etcd/1: ok=true, hashes=[843f625ebaf8471f073b1a21cd550b961636698be715f06c7f05a3c7a6837450] 2024-09-14 07:03:10 DEBUG juju.worker.uniter.remotestate watcher.go:489 got unit change for etcd/1 2024-09-14 07:03:10 INFO juju.worker.uniter.storage resolver.go:126 initial storage attachments ready 2024-09-14 07:03:10 INFO juju.worker.uniter resolver.go:159 found queued "install" hook 2024-09-14 07:03:10 DEBUG juju.worker.uniter.operation executor.go:85 running operation run install hook for etcd/1 2024-09-14 07:03:10 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/1 uniter (run install hook) 2024-09-14 07:03:10 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/1 uniter (run install hook) 2024-09-14 07:03:10 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run install hook" for etcd/1 2024-09-14 07:03:10 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run install hook" for etcd/1 2024-09-14 07:03:10 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running install hook 2024-09-14 07:03:11 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-1/agent.socket } 2024-09-14 07:03:11 DEBUG unit.etcd/1.install logger.go:60 Reading package lists... 2024-09-14 07:03:11 DEBUG unit.etcd/1.install logger.go:60 Building dependency tree... 2024-09-14 07:03:11 DEBUG unit.etcd/1.install logger.go:60 Reading state information... 2024-09-14 07:03:12 DEBUG unit.etcd/1.install logger.go:60 python3-setuptools is already the newest version (45.2.0-1ubuntu0.1). 2024-09-14 07:03:12 DEBUG unit.etcd/1.install logger.go:60 python3-yaml is already the newest version (5.3.1-1ubuntu0.1). 2024-09-14 07:03:12 DEBUG unit.etcd/1.install logger.go:60 python3-yaml set to manually installed. 2024-09-14 07:03:12 DEBUG unit.etcd/1.install logger.go:60 The following additional packages will be installed: 2024-09-14 07:03:12 DEBUG unit.etcd/1.install logger.go:60 cpp cpp-9 dpkg-dev fakeroot g++ g++-9 gcc gcc-9 gcc-9-base 2024-09-14 07:03:12 DEBUG unit.etcd/1.install logger.go:60 libalgorithm-diff-perl libalgorithm-diff-xs-perl libalgorithm-merge-perl 2024-09-14 07:03:12 DEBUG unit.etcd/1.install logger.go:60 libasan5 libatomic1 libc-dev-bin libc6-dev libcc1-0 libcrypt-dev 2024-09-14 07:03:12 DEBUG unit.etcd/1.install logger.go:60 libdpkg-perl libexpat1-dev libfakeroot libfile-fcntllock-perl libgcc-9-dev 2024-09-14 07:03:12 DEBUG unit.etcd/1.install logger.go:60 libgomp1 libisl22 libitm1 liblsan0 libmpc3 libpython3-dev libpython3.8-dev 2024-09-14 07:03:12 DEBUG unit.etcd/1.install logger.go:60 libquadmath0 libstdc++-9-dev libtsan0 libubsan1 linux-libc-dev make 2024-09-14 07:03:12 DEBUG unit.etcd/1.install logger.go:60 manpages-dev python-pip-whl python3.8-dev zlib1g-dev 2024-09-14 07:03:12 DEBUG unit.etcd/1.install logger.go:60 Suggested packages: 2024-09-14 07:03:12 DEBUG unit.etcd/1.install logger.go:60 cpp-doc gcc-9-locales debian-keyring g++-multilib g++-9-multilib gcc-9-doc 2024-09-14 07:03:12 DEBUG unit.etcd/1.install logger.go:60 gcc-multilib autoconf automake libtool flex bison gdb gcc-doc gcc-9-multilib 2024-09-14 07:03:12 DEBUG unit.etcd/1.install logger.go:60 glibc-doc bzr libstdc++-9-doc make-doc 2024-09-14 07:03:12 DEBUG unit.etcd/1.install logger.go:60 The following NEW packages will be installed: 2024-09-14 07:03:12 DEBUG unit.etcd/1.install logger.go:60 build-essential cpp cpp-9 dpkg-dev fakeroot g++ g++-9 gcc gcc-9 gcc-9-base 2024-09-14 07:03:12 DEBUG unit.etcd/1.install logger.go:60 libalgorithm-diff-perl libalgorithm-diff-xs-perl libalgorithm-merge-perl 2024-09-14 07:03:12 DEBUG unit.etcd/1.install logger.go:60 libasan5 libatomic1 libc-dev-bin libc6-dev libcc1-0 libcrypt-dev 2024-09-14 07:03:12 DEBUG unit.etcd/1.install logger.go:60 libdpkg-perl libexpat1-dev libfakeroot libfile-fcntllock-perl libgcc-9-dev 2024-09-14 07:03:12 DEBUG unit.etcd/1.install logger.go:60 libgomp1 libisl22 libitm1 liblsan0 libmpc3 libpython3-dev libpython3.8-dev 2024-09-14 07:03:12 DEBUG unit.etcd/1.install logger.go:60 libquadmath0 libstdc++-9-dev libtsan0 libubsan1 linux-libc-dev make 2024-09-14 07:03:12 DEBUG unit.etcd/1.install logger.go:60 manpages-dev python-pip-whl python3-dev python3-pip python3-wheel 2024-09-14 07:03:12 DEBUG unit.etcd/1.install logger.go:60 python3.8-dev zlib1g-dev 2024-09-14 07:03:12 DEBUG unit.etcd/1.install logger.go:60 0 upgraded, 44 newly installed, 0 to remove and 7 not upgraded. 2024-09-14 07:03:12 DEBUG unit.etcd/1.install logger.go:60 Need to get 49.9 MB of archives. 2024-09-14 07:03:12 DEBUG unit.etcd/1.install logger.go:60 After this operation, 215 MB of additional disk space will be used. 2024-09-14 07:03:12 DEBUG unit.etcd/1.install logger.go:60 Get:1 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security/main amd64 libc-dev-bin amd64 2.31-0ubuntu9.15 [71.8 kB] 2024-09-14 07:03:12 DEBUG unit.etcd/1.install logger.go:60 Get:2 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-proposed/main amd64 linux-libc-dev amd64 5.4.0-181.201 [1134 kB] 2024-09-14 07:03:12 DEBUG unit.etcd/1.install logger.go:60 Get:3 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal/main amd64 libcrypt-dev amd64 1:4.4.10-10ubuntu4 [104 kB] 2024-09-14 07:03:12 DEBUG unit.etcd/1.install logger.go:60 Get:4 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security/main amd64 libc6-dev amd64 2.31-0ubuntu9.15 [2519 kB] 2024-09-14 07:03:12 DEBUG unit.etcd/1.install logger.go:60 Get:5 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-proposed/main amd64 gcc-9-base amd64 9.4.0-1ubuntu1~20.04.3 [18.9 kB] 2024-09-14 07:03:12 DEBUG unit.etcd/1.install logger.go:60 Get:6 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal/main amd64 libisl22 amd64 0.22.1-1 [592 kB] 2024-09-14 07:03:12 DEBUG unit.etcd/1.install logger.go:60 Get:7 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal/main amd64 libmpc3 amd64 1.1.0-1 [40.8 kB] 2024-09-14 07:03:12 DEBUG unit.etcd/1.install logger.go:60 Get:8 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-proposed/main amd64 cpp-9 amd64 9.4.0-1ubuntu1~20.04.3 [7500 kB] 2024-09-14 07:03:12 DEBUG unit.etcd/1.install logger.go:60 Get:9 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal/main amd64 cpp amd64 4:9.3.0-1ubuntu2 [27.6 kB] 2024-09-14 07:03:12 DEBUG unit.etcd/1.install logger.go:60 Get:10 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security/main amd64 libcc1-0 amd64 10.5.0-1ubuntu1~20.04 [48.8 kB] 2024-09-14 07:03:12 DEBUG unit.etcd/1.install logger.go:60 Get:11 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security/main amd64 libgomp1 amd64 10.5.0-1ubuntu1~20.04 [102 kB] 2024-09-14 07:03:12 DEBUG unit.etcd/1.install logger.go:60 Get:12 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security/main amd64 libitm1 amd64 10.5.0-1ubuntu1~20.04 [26.2 kB] 2024-09-14 07:03:12 DEBUG unit.etcd/1.install logger.go:60 Get:13 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security/main amd64 libatomic1 amd64 10.5.0-1ubuntu1~20.04 [9284 B] 2024-09-14 07:03:12 DEBUG unit.etcd/1.install logger.go:60 Get:14 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-proposed/main amd64 libasan5 amd64 9.4.0-1ubuntu1~20.04.3 [2753 kB] 2024-09-14 07:03:12 DEBUG unit.etcd/1.install logger.go:60 Get:15 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security/main amd64 liblsan0 amd64 10.5.0-1ubuntu1~20.04 [835 kB] 2024-09-14 07:03:12 DEBUG unit.etcd/1.install logger.go:60 Get:16 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security/main amd64 libtsan0 amd64 10.5.0-1ubuntu1~20.04 [2016 kB] 2024-09-14 07:03:12 DEBUG unit.etcd/1.install logger.go:60 Get:17 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security/main amd64 libubsan1 amd64 10.5.0-1ubuntu1~20.04 [785 kB] 2024-09-14 07:03:12 DEBUG unit.etcd/1.install logger.go:60 Get:18 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security/main amd64 libquadmath0 amd64 10.5.0-1ubuntu1~20.04 [146 kB] 2024-09-14 07:03:12 DEBUG unit.etcd/1.install logger.go:60 Get:19 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-proposed/main amd64 libgcc-9-dev amd64 9.4.0-1ubuntu1~20.04.3 [2361 kB] 2024-09-14 07:03:12 DEBUG unit.etcd/1.install logger.go:60 Get:20 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-proposed/main amd64 gcc-9 amd64 9.4.0-1ubuntu1~20.04.3 [8275 kB] 2024-09-14 07:03:12 DEBUG unit.etcd/1.install logger.go:60 Get:21 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal/main amd64 gcc amd64 4:9.3.0-1ubuntu2 [5208 B] 2024-09-14 07:03:12 DEBUG unit.etcd/1.install logger.go:60 Get:22 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-proposed/main amd64 libstdc++-9-dev amd64 9.4.0-1ubuntu1~20.04.3 [1722 kB] 2024-09-14 07:03:12 DEBUG unit.etcd/1.install logger.go:60 Get:23 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-proposed/main amd64 g++-9 amd64 9.4.0-1ubuntu1~20.04.3 [8421 kB] 2024-09-14 07:03:13 DEBUG unit.etcd/1.install logger.go:60 Get:24 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal/main amd64 g++ amd64 4:9.3.0-1ubuntu2 [1604 B] 2024-09-14 07:03:13 DEBUG unit.etcd/1.install logger.go:60 Get:25 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal/main amd64 make amd64 4.2.1-1.2 [162 kB] 2024-09-14 07:03:13 DEBUG unit.etcd/1.install logger.go:60 Get:26 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security/main amd64 libdpkg-perl all 1.19.7ubuntu3.2 [231 kB] 2024-09-14 07:03:13 DEBUG unit.etcd/1.install logger.go:60 Get:27 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security/main amd64 dpkg-dev all 1.19.7ubuntu3.2 [679 kB] 2024-09-14 07:03:13 DEBUG unit.etcd/1.install logger.go:60 Get:28 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-updates/main amd64 build-essential amd64 12.8ubuntu1.1 [4664 B] 2024-09-14 07:03:13 DEBUG unit.etcd/1.install logger.go:60 Get:29 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal/main amd64 libfakeroot amd64 1.24-1 [25.7 kB] 2024-09-14 07:03:13 DEBUG unit.etcd/1.install logger.go:60 Get:30 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal/main amd64 fakeroot amd64 1.24-1 [62.6 kB] 2024-09-14 07:03:13 DEBUG unit.etcd/1.install logger.go:60 Get:31 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal/main amd64 libalgorithm-diff-perl all 1.19.03-2 [46.6 kB] 2024-09-14 07:03:13 DEBUG unit.etcd/1.install logger.go:60 Get:32 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal/main amd64 libalgorithm-diff-xs-perl amd64 0.04-6 [11.3 kB] 2024-09-14 07:03:13 DEBUG unit.etcd/1.install logger.go:60 Get:33 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal/main amd64 libalgorithm-merge-perl all 0.08-3 [12.0 kB] 2024-09-14 07:03:13 DEBUG unit.etcd/1.install logger.go:60 Get:34 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security/main amd64 libexpat1-dev amd64 2.2.9-1ubuntu0.6 [116 kB] 2024-09-14 07:03:13 DEBUG unit.etcd/1.install logger.go:60 Get:35 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal/main amd64 libfile-fcntllock-perl amd64 0.22-3build4 [33.1 kB] 2024-09-14 07:03:13 DEBUG unit.etcd/1.install logger.go:60 Get:36 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security/main amd64 libpython3.8-dev amd64 3.8.10-0ubuntu1~20.04.9 [3950 kB] 2024-09-14 07:03:13 DEBUG unit.etcd/1.install logger.go:60 Get:37 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal/main amd64 libpython3-dev amd64 3.8.2-0ubuntu2 [7236 B] 2024-09-14 07:03:13 DEBUG unit.etcd/1.install logger.go:60 Get:38 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal/main amd64 manpages-dev all 5.05-1 [2266 kB] 2024-09-14 07:03:13 DEBUG unit.etcd/1.install logger.go:60 Get:39 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security/universe amd64 python-pip-whl all 20.0.2-5ubuntu1.10 [1805 kB] 2024-09-14 07:03:13 DEBUG unit.etcd/1.install logger.go:60 Get:40 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security/main amd64 zlib1g-dev amd64 1:1.2.11.dfsg-2ubuntu1.5 [155 kB] 2024-09-14 07:03:13 DEBUG unit.etcd/1.install logger.go:60 Get:41 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security/main amd64 python3.8-dev amd64 3.8.10-0ubuntu1~20.04.9 [514 kB] 2024-09-14 07:03:13 DEBUG unit.etcd/1.install logger.go:60 Get:42 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal/main amd64 python3-dev amd64 3.8.2-0ubuntu2 [1212 B] 2024-09-14 07:03:13 DEBUG unit.etcd/1.install logger.go:60 Get:43 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security/universe amd64 python3-wheel all 0.34.2-1ubuntu0.1 [23.9 kB] 2024-09-14 07:03:13 DEBUG unit.etcd/1.install logger.go:60 Get:44 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security/universe amd64 python3-pip all 20.0.2-5ubuntu1.10 [231 kB] 2024-09-14 07:03:13 DEBUG unit.etcd/1.install logger.go:60 Fetched 49.9 MB in 1s (58.4 MB/s) 2024-09-14 07:03:14 DEBUG unit.etcd/1.install logger.go:60 Selecting previously unselected package libc-dev-bin. 2024-09-14 07:03:14 DEBUG unit.etcd/1.install logger.go:60 (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 64824 files and directories currently installed.) 2024-09-14 07:03:14 DEBUG unit.etcd/1.install logger.go:60 Preparing to unpack .../00-libc-dev-bin_2.31-0ubuntu9.15_amd64.deb ... 2024-09-14 07:03:14 DEBUG unit.etcd/1.install logger.go:60 Unpacking libc-dev-bin (2.31-0ubuntu9.15) ... 2024-09-14 07:03:14 DEBUG unit.etcd/1.install logger.go:60 Selecting previously unselected package linux-libc-dev:amd64. 2024-09-14 07:03:14 DEBUG unit.etcd/1.install logger.go:60 Preparing to unpack .../01-linux-libc-dev_5.4.0-181.201_amd64.deb ... 2024-09-14 07:03:14 DEBUG unit.etcd/1.install logger.go:60 Unpacking linux-libc-dev:amd64 (5.4.0-181.201) ... 2024-09-14 07:03:17 DEBUG unit.etcd/1.install logger.go:60 Selecting previously unselected package libcrypt-dev:amd64. 2024-09-14 07:03:17 DEBUG unit.etcd/1.install logger.go:60 Preparing to unpack .../02-libcrypt-dev_1%3a4.4.10-10ubuntu4_amd64.deb ... 2024-09-14 07:03:17 DEBUG unit.etcd/1.install logger.go:60 Unpacking libcrypt-dev:amd64 (1:4.4.10-10ubuntu4) ... 2024-09-14 07:03:17 DEBUG unit.etcd/1.install logger.go:60 Selecting previously unselected package libc6-dev:amd64. 2024-09-14 07:03:17 DEBUG unit.etcd/1.install logger.go:60 Preparing to unpack .../03-libc6-dev_2.31-0ubuntu9.15_amd64.deb ... 2024-09-14 07:03:17 DEBUG unit.etcd/1.install logger.go:60 Unpacking libc6-dev:amd64 (2.31-0ubuntu9.15) ... 2024-09-14 07:03:17 DEBUG unit.etcd/1.install logger.go:60 Selecting previously unselected package gcc-9-base:amd64. 2024-09-14 07:03:17 DEBUG unit.etcd/1.install logger.go:60 Preparing to unpack .../04-gcc-9-base_9.4.0-1ubuntu1~20.04.3_amd64.deb ... 2024-09-14 07:03:17 DEBUG unit.etcd/1.install logger.go:60 Unpacking gcc-9-base:amd64 (9.4.0-1ubuntu1~20.04.3) ... 2024-09-14 07:03:17 DEBUG unit.etcd/1.install logger.go:60 Selecting previously unselected package libisl22:amd64. 2024-09-14 07:03:17 DEBUG unit.etcd/1.install logger.go:60 Preparing to unpack .../05-libisl22_0.22.1-1_amd64.deb ... 2024-09-14 07:03:17 DEBUG unit.etcd/1.install logger.go:60 Unpacking libisl22:amd64 (0.22.1-1) ... 2024-09-14 07:03:17 DEBUG unit.etcd/1.install logger.go:60 Selecting previously unselected package libmpc3:amd64. 2024-09-14 07:03:18 DEBUG unit.etcd/1.install logger.go:60 Preparing to unpack .../06-libmpc3_1.1.0-1_amd64.deb ... 2024-09-14 07:03:18 DEBUG unit.etcd/1.install logger.go:60 Unpacking libmpc3:amd64 (1.1.0-1) ... 2024-09-14 07:03:18 DEBUG unit.etcd/1.install logger.go:60 Selecting previously unselected package cpp-9. 2024-09-14 07:03:18 DEBUG unit.etcd/1.install logger.go:60 Preparing to unpack .../07-cpp-9_9.4.0-1ubuntu1~20.04.3_amd64.deb ... 2024-09-14 07:03:18 DEBUG unit.etcd/1.install logger.go:60 Unpacking cpp-9 (9.4.0-1ubuntu1~20.04.3) ... 2024-09-14 07:03:20 DEBUG unit.etcd/1.install logger.go:60 Selecting previously unselected package cpp. 2024-09-14 07:03:20 DEBUG unit.etcd/1.install logger.go:60 Preparing to unpack .../08-cpp_4%3a9.3.0-1ubuntu2_amd64.deb ... 2024-09-14 07:03:20 DEBUG unit.etcd/1.install logger.go:60 Unpacking cpp (4:9.3.0-1ubuntu2) ... 2024-09-14 07:03:20 DEBUG unit.etcd/1.install logger.go:60 Selecting previously unselected package libcc1-0:amd64. 2024-09-14 07:03:20 DEBUG unit.etcd/1.install logger.go:60 Preparing to unpack .../09-libcc1-0_10.5.0-1ubuntu1~20.04_amd64.deb ... 2024-09-14 07:03:20 DEBUG unit.etcd/1.install logger.go:60 Unpacking libcc1-0:amd64 (10.5.0-1ubuntu1~20.04) ... 2024-09-14 07:03:20 DEBUG unit.etcd/1.install logger.go:60 Selecting previously unselected package libgomp1:amd64. 2024-09-14 07:03:20 DEBUG unit.etcd/1.install logger.go:60 Preparing to unpack .../10-libgomp1_10.5.0-1ubuntu1~20.04_amd64.deb ... 2024-09-14 07:03:20 DEBUG unit.etcd/1.install logger.go:60 Unpacking libgomp1:amd64 (10.5.0-1ubuntu1~20.04) ... 2024-09-14 07:03:20 DEBUG unit.etcd/1.install logger.go:60 Selecting previously unselected package libitm1:amd64. 2024-09-14 07:03:20 DEBUG unit.etcd/1.install logger.go:60 Preparing to unpack .../11-libitm1_10.5.0-1ubuntu1~20.04_amd64.deb ... 2024-09-14 07:03:20 DEBUG unit.etcd/1.install logger.go:60 Unpacking libitm1:amd64 (10.5.0-1ubuntu1~20.04) ... 2024-09-14 07:03:21 DEBUG unit.etcd/1.install logger.go:60 Selecting previously unselected package libatomic1:amd64. 2024-09-14 07:03:21 DEBUG unit.etcd/1.install logger.go:60 Preparing to unpack .../12-libatomic1_10.5.0-1ubuntu1~20.04_amd64.deb ... 2024-09-14 07:03:21 DEBUG unit.etcd/1.install logger.go:60 Unpacking libatomic1:amd64 (10.5.0-1ubuntu1~20.04) ... 2024-09-14 07:03:21 DEBUG unit.etcd/1.install logger.go:60 Selecting previously unselected package libasan5:amd64. 2024-09-14 07:03:21 DEBUG unit.etcd/1.install logger.go:60 Preparing to unpack .../13-libasan5_9.4.0-1ubuntu1~20.04.3_amd64.deb ... 2024-09-14 07:03:21 DEBUG unit.etcd/1.install logger.go:60 Unpacking libasan5:amd64 (9.4.0-1ubuntu1~20.04.3) ... 2024-09-14 07:03:22 DEBUG unit.etcd/1.install logger.go:60 Selecting previously unselected package liblsan0:amd64. 2024-09-14 07:03:22 DEBUG unit.etcd/1.install logger.go:60 Preparing to unpack .../14-liblsan0_10.5.0-1ubuntu1~20.04_amd64.deb ... 2024-09-14 07:03:22 DEBUG unit.etcd/1.install logger.go:60 Unpacking liblsan0:amd64 (10.5.0-1ubuntu1~20.04) ... 2024-09-14 07:03:22 DEBUG unit.etcd/1.install logger.go:60 Selecting previously unselected package libtsan0:amd64. 2024-09-14 07:03:22 DEBUG unit.etcd/1.install logger.go:60 Preparing to unpack .../15-libtsan0_10.5.0-1ubuntu1~20.04_amd64.deb ... 2024-09-14 07:03:22 DEBUG unit.etcd/1.install logger.go:60 Unpacking libtsan0:amd64 (10.5.0-1ubuntu1~20.04) ... 2024-09-14 07:03:22 DEBUG unit.etcd/1.install logger.go:60 Selecting previously unselected package libubsan1:amd64. 2024-09-14 07:03:22 DEBUG unit.etcd/1.install logger.go:60 Preparing to unpack .../16-libubsan1_10.5.0-1ubuntu1~20.04_amd64.deb ... 2024-09-14 07:03:22 DEBUG unit.etcd/1.install logger.go:60 Unpacking libubsan1:amd64 (10.5.0-1ubuntu1~20.04) ... 2024-09-14 07:03:22 DEBUG unit.etcd/1.install logger.go:60 Selecting previously unselected package libquadmath0:amd64. 2024-09-14 07:03:22 DEBUG unit.etcd/1.install logger.go:60 Preparing to unpack .../17-libquadmath0_10.5.0-1ubuntu1~20.04_amd64.deb ... 2024-09-14 07:03:22 DEBUG unit.etcd/1.install logger.go:60 Unpacking libquadmath0:amd64 (10.5.0-1ubuntu1~20.04) ... 2024-09-14 07:03:22 DEBUG unit.etcd/1.install logger.go:60 Selecting previously unselected package libgcc-9-dev:amd64. 2024-09-14 07:03:22 DEBUG unit.etcd/1.install logger.go:60 Preparing to unpack .../18-libgcc-9-dev_9.4.0-1ubuntu1~20.04.3_amd64.deb ... 2024-09-14 07:03:22 DEBUG unit.etcd/1.install logger.go:60 Unpacking libgcc-9-dev:amd64 (9.4.0-1ubuntu1~20.04.3) ... 2024-09-14 07:03:23 DEBUG unit.etcd/1.install logger.go:60 Selecting previously unselected package gcc-9. 2024-09-14 07:03:23 DEBUG unit.etcd/1.install logger.go:60 Preparing to unpack .../19-gcc-9_9.4.0-1ubuntu1~20.04.3_amd64.deb ... 2024-09-14 07:03:23 DEBUG unit.etcd/1.install logger.go:60 Unpacking gcc-9 (9.4.0-1ubuntu1~20.04.3) ... 2024-09-14 07:03:23 DEBUG unit.etcd/1.install logger.go:60 Selecting previously unselected package gcc. 2024-09-14 07:03:23 DEBUG unit.etcd/1.install logger.go:60 Preparing to unpack .../20-gcc_4%3a9.3.0-1ubuntu2_amd64.deb ... 2024-09-14 07:03:23 DEBUG unit.etcd/1.install logger.go:60 Unpacking gcc (4:9.3.0-1ubuntu2) ... 2024-09-14 07:03:24 DEBUG unit.etcd/1.install logger.go:60 Selecting previously unselected package libstdc++-9-dev:amd64. 2024-09-14 07:03:24 DEBUG unit.etcd/1.install logger.go:60 Preparing to unpack .../21-libstdc++-9-dev_9.4.0-1ubuntu1~20.04.3_amd64.deb ... 2024-09-14 07:03:24 DEBUG unit.etcd/1.install logger.go:60 Unpacking libstdc++-9-dev:amd64 (9.4.0-1ubuntu1~20.04.3) ... 2024-09-14 07:03:24 DEBUG unit.etcd/1.install logger.go:60 Selecting previously unselected package g++-9. 2024-09-14 07:03:24 DEBUG unit.etcd/1.install logger.go:60 Preparing to unpack .../22-g++-9_9.4.0-1ubuntu1~20.04.3_amd64.deb ... 2024-09-14 07:03:24 DEBUG unit.etcd/1.install logger.go:60 Unpacking g++-9 (9.4.0-1ubuntu1~20.04.3) ... 2024-09-14 07:03:25 DEBUG unit.etcd/1.install logger.go:60 Selecting previously unselected package g++. 2024-09-14 07:03:25 DEBUG unit.etcd/1.install logger.go:60 Preparing to unpack .../23-g++_4%3a9.3.0-1ubuntu2_amd64.deb ... 2024-09-14 07:03:25 DEBUG unit.etcd/1.install logger.go:60 Unpacking g++ (4:9.3.0-1ubuntu2) ... 2024-09-14 07:03:25 DEBUG unit.etcd/1.install logger.go:60 Selecting previously unselected package make. 2024-09-14 07:03:25 DEBUG unit.etcd/1.install logger.go:60 Preparing to unpack .../24-make_4.2.1-1.2_amd64.deb ... 2024-09-14 07:03:25 DEBUG unit.etcd/1.install logger.go:60 Unpacking make (4.2.1-1.2) ... 2024-09-14 07:03:25 DEBUG unit.etcd/1.install logger.go:60 Selecting previously unselected package libdpkg-perl. 2024-09-14 07:03:25 DEBUG unit.etcd/1.install logger.go:60 Preparing to unpack .../25-libdpkg-perl_1.19.7ubuntu3.2_all.deb ... 2024-09-14 07:03:25 DEBUG unit.etcd/1.install logger.go:60 Unpacking libdpkg-perl (1.19.7ubuntu3.2) ... 2024-09-14 07:03:25 DEBUG unit.etcd/1.install logger.go:60 Selecting previously unselected package dpkg-dev. 2024-09-14 07:03:25 DEBUG unit.etcd/1.install logger.go:60 Preparing to unpack .../26-dpkg-dev_1.19.7ubuntu3.2_all.deb ... 2024-09-14 07:03:25 DEBUG unit.etcd/1.install logger.go:60 Unpacking dpkg-dev (1.19.7ubuntu3.2) ... 2024-09-14 07:03:25 DEBUG unit.etcd/1.install logger.go:60 Selecting previously unselected package build-essential. 2024-09-14 07:03:25 DEBUG unit.etcd/1.install logger.go:60 Preparing to unpack .../27-build-essential_12.8ubuntu1.1_amd64.deb ... 2024-09-14 07:03:25 DEBUG unit.etcd/1.install logger.go:60 Unpacking build-essential (12.8ubuntu1.1) ... 2024-09-14 07:03:25 DEBUG unit.etcd/1.install logger.go:60 Selecting previously unselected package libfakeroot:amd64. 2024-09-14 07:03:26 DEBUG unit.etcd/1.install logger.go:60 Preparing to unpack .../28-libfakeroot_1.24-1_amd64.deb ... 2024-09-14 07:03:26 DEBUG unit.etcd/1.install logger.go:60 Unpacking libfakeroot:amd64 (1.24-1) ... 2024-09-14 07:03:26 DEBUG unit.etcd/1.install logger.go:60 Selecting previously unselected package fakeroot. 2024-09-14 07:03:26 DEBUG unit.etcd/1.install logger.go:60 Preparing to unpack .../29-fakeroot_1.24-1_amd64.deb ... 2024-09-14 07:03:26 DEBUG unit.etcd/1.install logger.go:60 Unpacking fakeroot (1.24-1) ... 2024-09-14 07:03:26 DEBUG unit.etcd/1.install logger.go:60 Selecting previously unselected package libalgorithm-diff-perl. 2024-09-14 07:03:26 DEBUG unit.etcd/1.install logger.go:60 Preparing to unpack .../30-libalgorithm-diff-perl_1.19.03-2_all.deb ... 2024-09-14 07:03:26 DEBUG unit.etcd/1.install logger.go:60 Unpacking libalgorithm-diff-perl (1.19.03-2) ... 2024-09-14 07:03:26 DEBUG unit.etcd/1.install logger.go:60 Selecting previously unselected package libalgorithm-diff-xs-perl. 2024-09-14 07:03:26 DEBUG unit.etcd/1.install logger.go:60 Preparing to unpack .../31-libalgorithm-diff-xs-perl_0.04-6_amd64.deb ... 2024-09-14 07:03:26 DEBUG unit.etcd/1.install logger.go:60 Unpacking libalgorithm-diff-xs-perl (0.04-6) ... 2024-09-14 07:03:26 DEBUG unit.etcd/1.install logger.go:60 Selecting previously unselected package libalgorithm-merge-perl. 2024-09-14 07:03:26 DEBUG unit.etcd/1.install logger.go:60 Preparing to unpack .../32-libalgorithm-merge-perl_0.08-3_all.deb ... 2024-09-14 07:03:26 DEBUG unit.etcd/1.install logger.go:60 Unpacking libalgorithm-merge-perl (0.08-3) ... 2024-09-14 07:03:26 DEBUG unit.etcd/1.install logger.go:60 Selecting previously unselected package libexpat1-dev:amd64. 2024-09-14 07:03:26 DEBUG unit.etcd/1.install logger.go:60 Preparing to unpack .../33-libexpat1-dev_2.2.9-1ubuntu0.6_amd64.deb ... 2024-09-14 07:03:26 DEBUG unit.etcd/1.install logger.go:60 Unpacking libexpat1-dev:amd64 (2.2.9-1ubuntu0.6) ... 2024-09-14 07:03:26 DEBUG unit.etcd/1.install logger.go:60 Selecting previously unselected package libfile-fcntllock-perl. 2024-09-14 07:03:26 DEBUG unit.etcd/1.install logger.go:60 Preparing to unpack .../34-libfile-fcntllock-perl_0.22-3build4_amd64.deb ... 2024-09-14 07:03:26 DEBUG unit.etcd/1.install logger.go:60 Unpacking libfile-fcntllock-perl (0.22-3build4) ... 2024-09-14 07:03:26 DEBUG unit.etcd/1.install logger.go:60 Selecting previously unselected package libpython3.8-dev:amd64. 2024-09-14 07:03:26 DEBUG unit.etcd/1.install logger.go:60 Preparing to unpack .../35-libpython3.8-dev_3.8.10-0ubuntu1~20.04.9_amd64.deb ... 2024-09-14 07:03:26 DEBUG unit.etcd/1.install logger.go:60 Unpacking libpython3.8-dev:amd64 (3.8.10-0ubuntu1~20.04.9) ... 2024-09-14 07:03:26 DEBUG unit.etcd/1.install logger.go:60 Selecting previously unselected package libpython3-dev:amd64. 2024-09-14 07:03:26 DEBUG unit.etcd/1.install logger.go:60 Preparing to unpack .../36-libpython3-dev_3.8.2-0ubuntu2_amd64.deb ... 2024-09-14 07:03:26 DEBUG unit.etcd/1.install logger.go:60 Unpacking libpython3-dev:amd64 (3.8.2-0ubuntu2) ... 2024-09-14 07:03:26 DEBUG unit.etcd/1.install logger.go:60 Selecting previously unselected package manpages-dev. 2024-09-14 07:03:27 DEBUG unit.etcd/1.install logger.go:60 Preparing to unpack .../37-manpages-dev_5.05-1_all.deb ... 2024-09-14 07:03:27 DEBUG unit.etcd/1.install logger.go:60 Unpacking manpages-dev (5.05-1) ... 2024-09-14 07:03:27 DEBUG unit.etcd/1.install logger.go:60 Selecting previously unselected package python-pip-whl. 2024-09-14 07:03:27 DEBUG unit.etcd/1.install logger.go:60 Preparing to unpack .../38-python-pip-whl_20.0.2-5ubuntu1.10_all.deb ... 2024-09-14 07:03:27 DEBUG unit.etcd/1.install logger.go:60 Unpacking python-pip-whl (20.0.2-5ubuntu1.10) ... 2024-09-14 07:03:28 DEBUG unit.etcd/1.install logger.go:60 Selecting previously unselected package zlib1g-dev:amd64. 2024-09-14 07:03:28 DEBUG unit.etcd/1.install logger.go:60 Preparing to unpack .../39-zlib1g-dev_1%3a1.2.11.dfsg-2ubuntu1.5_amd64.deb ... 2024-09-14 07:03:28 DEBUG unit.etcd/1.install logger.go:60 Unpacking zlib1g-dev:amd64 (1:1.2.11.dfsg-2ubuntu1.5) ... 2024-09-14 07:03:28 DEBUG unit.etcd/1.install logger.go:60 Selecting previously unselected package python3.8-dev. 2024-09-14 07:03:28 DEBUG unit.etcd/1.install logger.go:60 Preparing to unpack .../40-python3.8-dev_3.8.10-0ubuntu1~20.04.9_amd64.deb ... 2024-09-14 07:03:28 DEBUG unit.etcd/1.install logger.go:60 Unpacking python3.8-dev (3.8.10-0ubuntu1~20.04.9) ... 2024-09-14 07:03:28 DEBUG unit.etcd/1.install logger.go:60 Selecting previously unselected package python3-dev. 2024-09-14 07:03:28 DEBUG unit.etcd/1.install logger.go:60 Preparing to unpack .../41-python3-dev_3.8.2-0ubuntu2_amd64.deb ... 2024-09-14 07:03:28 DEBUG unit.etcd/1.install logger.go:60 Unpacking python3-dev (3.8.2-0ubuntu2) ... 2024-09-14 07:03:28 DEBUG unit.etcd/1.install logger.go:60 Selecting previously unselected package python3-wheel. 2024-09-14 07:03:28 DEBUG unit.etcd/1.install logger.go:60 Preparing to unpack .../42-python3-wheel_0.34.2-1ubuntu0.1_all.deb ... 2024-09-14 07:03:28 DEBUG unit.etcd/1.install logger.go:60 Unpacking python3-wheel (0.34.2-1ubuntu0.1) ... 2024-09-14 07:03:28 DEBUG unit.etcd/1.install logger.go:60 Selecting previously unselected package python3-pip. 2024-09-14 07:03:28 DEBUG unit.etcd/1.install logger.go:60 Preparing to unpack .../43-python3-pip_20.0.2-5ubuntu1.10_all.deb ... 2024-09-14 07:03:28 DEBUG unit.etcd/1.install logger.go:60 Unpacking python3-pip (20.0.2-5ubuntu1.10) ... 2024-09-14 07:03:28 DEBUG unit.etcd/1.install logger.go:60 Setting up manpages-dev (5.05-1) ... 2024-09-14 07:03:28 DEBUG unit.etcd/1.install logger.go:60 Setting up libfile-fcntllock-perl (0.22-3build4) ... 2024-09-14 07:03:28 DEBUG unit.etcd/1.install logger.go:60 Setting up libalgorithm-diff-perl (1.19.03-2) ... 2024-09-14 07:03:28 DEBUG unit.etcd/1.install logger.go:60 Setting up linux-libc-dev:amd64 (5.4.0-181.201) ... 2024-09-14 07:03:28 DEBUG unit.etcd/1.install logger.go:60 Setting up libgomp1:amd64 (10.5.0-1ubuntu1~20.04) ... 2024-09-14 07:03:28 DEBUG unit.etcd/1.install logger.go:60 Setting up python3-wheel (0.34.2-1ubuntu0.1) ... 2024-09-14 07:03:28 DEBUG unit.etcd/1.install logger.go:60 Setting up libfakeroot:amd64 (1.24-1) ... 2024-09-14 07:03:28 DEBUG unit.etcd/1.install logger.go:60 Setting up fakeroot (1.24-1) ... 2024-09-14 07:03:28 DEBUG unit.etcd/1.install logger.go:60 update-alternatives: using /usr/bin/fakeroot-sysv to provide /usr/bin/fakeroot (fakeroot) in auto mode 2024-09-14 07:03:28 DEBUG unit.etcd/1.install logger.go:60 Setting up make (4.2.1-1.2) ... 2024-09-14 07:03:28 DEBUG unit.etcd/1.install logger.go:60 Setting up libquadmath0:amd64 (10.5.0-1ubuntu1~20.04) ... 2024-09-14 07:03:28 DEBUG unit.etcd/1.install logger.go:60 Setting up libmpc3:amd64 (1.1.0-1) ... 2024-09-14 07:03:28 DEBUG unit.etcd/1.install logger.go:60 Setting up libatomic1:amd64 (10.5.0-1ubuntu1~20.04) ... 2024-09-14 07:03:28 DEBUG unit.etcd/1.install logger.go:60 Setting up libdpkg-perl (1.19.7ubuntu3.2) ... 2024-09-14 07:03:28 DEBUG unit.etcd/1.install logger.go:60 Setting up libubsan1:amd64 (10.5.0-1ubuntu1~20.04) ... 2024-09-14 07:03:28 DEBUG unit.etcd/1.install logger.go:60 Setting up libcrypt-dev:amd64 (1:4.4.10-10ubuntu4) ... 2024-09-14 07:03:28 DEBUG unit.etcd/1.install logger.go:60 Setting up libisl22:amd64 (0.22.1-1) ... 2024-09-14 07:03:28 DEBUG unit.etcd/1.install logger.go:60 Setting up python-pip-whl (20.0.2-5ubuntu1.10) ... 2024-09-14 07:03:28 DEBUG unit.etcd/1.install logger.go:60 Setting up libc-dev-bin (2.31-0ubuntu9.15) ... 2024-09-14 07:03:28 DEBUG unit.etcd/1.install logger.go:60 Setting up libalgorithm-diff-xs-perl (0.04-6) ... 2024-09-14 07:03:28 DEBUG unit.etcd/1.install logger.go:60 Setting up libcc1-0:amd64 (10.5.0-1ubuntu1~20.04) ... 2024-09-14 07:03:28 DEBUG unit.etcd/1.install logger.go:60 Setting up liblsan0:amd64 (10.5.0-1ubuntu1~20.04) ... 2024-09-14 07:03:28 DEBUG unit.etcd/1.install logger.go:60 Setting up libitm1:amd64 (10.5.0-1ubuntu1~20.04) ... 2024-09-14 07:03:28 DEBUG unit.etcd/1.install logger.go:60 Setting up gcc-9-base:amd64 (9.4.0-1ubuntu1~20.04.3) ... 2024-09-14 07:03:28 DEBUG unit.etcd/1.install logger.go:60 Setting up libalgorithm-merge-perl (0.08-3) ... 2024-09-14 07:03:28 DEBUG unit.etcd/1.install logger.go:60 Setting up libtsan0:amd64 (10.5.0-1ubuntu1~20.04) ... 2024-09-14 07:03:28 DEBUG unit.etcd/1.install logger.go:60 Setting up dpkg-dev (1.19.7ubuntu3.2) ... 2024-09-14 07:03:28 DEBUG unit.etcd/1.install logger.go:60 Setting up libasan5:amd64 (9.4.0-1ubuntu1~20.04.3) ... 2024-09-14 07:03:28 DEBUG unit.etcd/1.install logger.go:60 Setting up python3-pip (20.0.2-5ubuntu1.10) ... 2024-09-14 07:03:29 DEBUG unit.etcd/1.install logger.go:60 Setting up cpp-9 (9.4.0-1ubuntu1~20.04.3) ... 2024-09-14 07:03:29 DEBUG unit.etcd/1.install logger.go:60 Setting up libc6-dev:amd64 (2.31-0ubuntu9.15) ... 2024-09-14 07:03:29 DEBUG unit.etcd/1.install logger.go:60 Setting up libgcc-9-dev:amd64 (9.4.0-1ubuntu1~20.04.3) ... 2024-09-14 07:03:29 DEBUG unit.etcd/1.install logger.go:60 Setting up libexpat1-dev:amd64 (2.2.9-1ubuntu0.6) ... 2024-09-14 07:03:29 DEBUG unit.etcd/1.install logger.go:60 Setting up libpython3.8-dev:amd64 (3.8.10-0ubuntu1~20.04.9) ... 2024-09-14 07:03:29 DEBUG unit.etcd/1.install logger.go:60 Setting up zlib1g-dev:amd64 (1:1.2.11.dfsg-2ubuntu1.5) ... 2024-09-14 07:03:29 DEBUG unit.etcd/1.install logger.go:60 Setting up cpp (4:9.3.0-1ubuntu2) ... 2024-09-14 07:03:29 DEBUG unit.etcd/1.install logger.go:60 Setting up gcc-9 (9.4.0-1ubuntu1~20.04.3) ... 2024-09-14 07:03:29 DEBUG unit.etcd/1.install logger.go:60 Setting up libpython3-dev:amd64 (3.8.2-0ubuntu2) ... 2024-09-14 07:03:29 DEBUG unit.etcd/1.install logger.go:60 Setting up libstdc++-9-dev:amd64 (9.4.0-1ubuntu1~20.04.3) ... 2024-09-14 07:03:29 DEBUG unit.etcd/1.install logger.go:60 Setting up gcc (4:9.3.0-1ubuntu2) ... 2024-09-14 07:03:29 DEBUG unit.etcd/1.install logger.go:60 Setting up g++-9 (9.4.0-1ubuntu1~20.04.3) ... 2024-09-14 07:03:29 DEBUG unit.etcd/1.install logger.go:60 Setting up python3.8-dev (3.8.10-0ubuntu1~20.04.9) ... 2024-09-14 07:03:29 DEBUG unit.etcd/1.install logger.go:60 Setting up g++ (4:9.3.0-1ubuntu2) ... 2024-09-14 07:03:29 DEBUG unit.etcd/1.install logger.go:60 update-alternatives: using /usr/bin/g++ to provide /usr/bin/c++ (c++) in auto mode 2024-09-14 07:03:29 DEBUG unit.etcd/1.install logger.go:60 Setting up build-essential (12.8ubuntu1.1) ... 2024-09-14 07:03:29 DEBUG unit.etcd/1.install logger.go:60 Setting up python3-dev (3.8.2-0ubuntu2) ... 2024-09-14 07:03:29 DEBUG unit.etcd/1.install logger.go:60 Processing triggers for man-db (2.9.1-1) ... 2024-09-14 07:03:39 DEBUG unit.etcd/1.install logger.go:60 Processing triggers for libc-bin (2.31-0ubuntu9.15) ... 2024-09-14 07:03:41 DEBUG unit.etcd/1.install logger.go:60 Reading package lists... 2024-09-14 07:03:42 DEBUG unit.etcd/1.install logger.go:60 Building dependency tree... 2024-09-14 07:03:42 DEBUG unit.etcd/1.install logger.go:60 Reading state information... 2024-09-14 07:03:42 DEBUG unit.etcd/1.install logger.go:60 rsync is already the newest version (3.1.3-8ubuntu0.7). 2024-09-14 07:03:42 DEBUG unit.etcd/1.install logger.go:60 rsync set to manually installed. 2024-09-14 07:03:42 DEBUG unit.etcd/1.install logger.go:60 0 upgraded, 0 newly installed, 0 to remove and 7 not upgraded. 2024-09-14 07:03:42 DEBUG unit.etcd/1.install logger.go:60 Reading package lists... 2024-09-14 07:03:42 DEBUG unit.etcd/1.install logger.go:60 Building dependency tree... 2024-09-14 07:03:42 DEBUG unit.etcd/1.install logger.go:60 Reading state information... 2024-09-14 07:03:42 DEBUG unit.etcd/1.install logger.go:60 The following additional packages will be installed: 2024-09-14 07:03:42 DEBUG unit.etcd/1.install logger.go:60 python3-appdirs python3-distlib python3-filelock python3-virtualenv 2024-09-14 07:03:42 DEBUG unit.etcd/1.install logger.go:60 The following NEW packages will be installed: 2024-09-14 07:03:42 DEBUG unit.etcd/1.install logger.go:60 python3-appdirs python3-distlib python3-filelock python3-virtualenv 2024-09-14 07:03:42 DEBUG unit.etcd/1.install logger.go:60 virtualenv 2024-09-14 07:03:42 DEBUG unit.etcd/1.install logger.go:60 0 upgraded, 5 newly installed, 0 to remove and 7 not upgraded. 2024-09-14 07:03:42 DEBUG unit.etcd/1.install logger.go:60 Need to get 199 kB of archives. 2024-09-14 07:03:42 DEBUG unit.etcd/1.install logger.go:60 After this operation, 1056 kB of additional disk space will be used. 2024-09-14 07:03:42 DEBUG unit.etcd/1.install logger.go:60 Get:1 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal/main amd64 python3-appdirs all 1.4.3-2.1 [10.8 kB] 2024-09-14 07:03:42 DEBUG unit.etcd/1.install logger.go:60 Get:2 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal/universe amd64 python3-distlib all 0.3.0-1 [116 kB] 2024-09-14 07:03:42 DEBUG unit.etcd/1.install logger.go:60 Get:3 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal/universe amd64 python3-filelock all 3.0.12-2 [7948 B] 2024-09-14 07:03:42 DEBUG unit.etcd/1.install logger.go:60 Get:4 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security/universe amd64 python3-virtualenv all 20.0.17-1ubuntu0.4 [62.7 kB] 2024-09-14 07:03:42 DEBUG unit.etcd/1.install logger.go:60 Get:5 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security/universe amd64 virtualenv all 20.0.17-1ubuntu0.4 [2144 B] 2024-09-14 07:03:43 DEBUG unit.etcd/1.install logger.go:60 Fetched 199 kB in 0s (9825 kB/s) 2024-09-14 07:03:43 DEBUG unit.etcd/1.install logger.go:60 Selecting previously unselected package python3-appdirs. 2024-09-14 07:03:43 DEBUG unit.etcd/1.install logger.go:60 (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 70670 files and directories currently installed.) 2024-09-14 07:03:43 DEBUG unit.etcd/1.install logger.go:60 Preparing to unpack .../python3-appdirs_1.4.3-2.1_all.deb ... 2024-09-14 07:03:43 DEBUG unit.etcd/1.install logger.go:60 Unpacking python3-appdirs (1.4.3-2.1) ... 2024-09-14 07:03:43 DEBUG unit.etcd/1.install logger.go:60 Selecting previously unselected package python3-distlib. 2024-09-14 07:03:43 DEBUG unit.etcd/1.install logger.go:60 Preparing to unpack .../python3-distlib_0.3.0-1_all.deb ... 2024-09-14 07:03:43 DEBUG unit.etcd/1.install logger.go:60 Unpacking python3-distlib (0.3.0-1) ... 2024-09-14 07:03:43 DEBUG unit.etcd/1.install logger.go:60 Selecting previously unselected package python3-filelock. 2024-09-14 07:03:43 DEBUG unit.etcd/1.install logger.go:60 Preparing to unpack .../python3-filelock_3.0.12-2_all.deb ... 2024-09-14 07:03:43 DEBUG unit.etcd/1.install logger.go:60 Unpacking python3-filelock (3.0.12-2) ... 2024-09-14 07:03:43 DEBUG unit.etcd/1.install logger.go:60 Selecting previously unselected package python3-virtualenv. 2024-09-14 07:03:43 DEBUG unit.etcd/1.install logger.go:60 Preparing to unpack .../python3-virtualenv_20.0.17-1ubuntu0.4_all.deb ... 2024-09-14 07:03:43 DEBUG unit.etcd/1.install logger.go:60 Unpacking python3-virtualenv (20.0.17-1ubuntu0.4) ... 2024-09-14 07:03:43 DEBUG unit.etcd/1.install logger.go:60 Selecting previously unselected package virtualenv. 2024-09-14 07:03:43 DEBUG unit.etcd/1.install logger.go:60 Preparing to unpack .../virtualenv_20.0.17-1ubuntu0.4_all.deb ... 2024-09-14 07:03:43 DEBUG unit.etcd/1.install logger.go:60 Unpacking virtualenv (20.0.17-1ubuntu0.4) ... 2024-09-14 07:03:43 DEBUG unit.etcd/1.install logger.go:60 Setting up python3-filelock (3.0.12-2) ... 2024-09-14 07:03:43 DEBUG unit.etcd/1.install logger.go:60 Setting up python3-distlib (0.3.0-1) ... 2024-09-14 07:03:43 DEBUG unit.etcd/1.install logger.go:60 Setting up python3-appdirs (1.4.3-2.1) ... 2024-09-14 07:03:44 DEBUG unit.etcd/1.install logger.go:60 Setting up python3-virtualenv (20.0.17-1ubuntu0.4) ... 2024-09-14 07:03:44 DEBUG unit.etcd/1.install logger.go:60 Setting up virtualenv (20.0.17-1ubuntu0.4) ... 2024-09-14 07:03:44 DEBUG unit.etcd/1.install logger.go:60 Processing triggers for man-db (2.9.1-1) ... 2024-09-14 07:03:46 DEBUG unit.etcd/1.install logger.go:60 created virtual environment CPython3.8.10.final.0-64 in 159ms 2024-09-14 07:03:46 DEBUG unit.etcd/1.install logger.go:60 creator CPython3Posix(dest=/var/lib/juju/agents/unit-etcd-1/.venv, clear=False, global=False) 2024-09-14 07:03:46 DEBUG unit.etcd/1.install logger.go:60 seeder FromAppData(download=False, pip=latest, setuptools=latest, wheel=latest, pkg_resources=latest, via=copy, app_data_dir=/root/.local/share/virtualenv/seed-app-data/v1.0.1.debian.1) 2024-09-14 07:03:46 DEBUG unit.etcd/1.install logger.go:60 activators BashActivator,CShellActivator,FishActivator,PowerShellActivator,PythonActivator,XonshActivator 2024-09-14 07:03:48 DEBUG unit.etcd/1.install logger.go:60 Looking in links: wheelhouse 2024-09-14 07:03:48 DEBUG unit.etcd/1.install logger.go:60 Requirement already up-to-date: pip in /var/lib/juju/agents/unit-etcd-1/.venv/lib/python3.8/site-packages (20.0.2) 2024-09-14 07:03:49 DEBUG unit.etcd/1.install logger.go:60 Looking in links: wheelhouse 2024-09-14 07:03:49 DEBUG unit.etcd/1.install logger.go:60 Requirement already up-to-date: setuptools in /var/lib/juju/agents/unit-etcd-1/.venv/lib/python3.8/site-packages (44.0.0) 2024-09-14 07:03:50 DEBUG unit.etcd/1.install logger.go:60 Looking in links: wheelhouse 2024-09-14 07:03:50 DEBUG unit.etcd/1.install logger.go:60 Processing ./wheelhouse/setuptools_scm-1.17.0.tar.gz 2024-09-14 07:03:50 DEBUG unit.etcd/1.install logger.go:60 Building wheels for collected packages: setuptools-scm 2024-09-14 07:03:50 DEBUG unit.etcd/1.install logger.go:60 Building wheel for setuptools-scm (setup.py): started 2024-09-14 07:03:50 DEBUG unit.etcd/1.install logger.go:60 Building wheel for setuptools-scm (setup.py): finished with status 'done' 2024-09-14 07:03:50 DEBUG unit.etcd/1.install logger.go:60 Created wheel for setuptools-scm: filename=setuptools_scm-1.17.0-py2.py3-none-any.whl size=17696 sha256=9105e1eb7b54b967fadfdddc6987f859f21432958719cfa7aec209e46ed90679 2024-09-14 07:03:50 DEBUG unit.etcd/1.install logger.go:60 Stored in directory: /root/.cache/pip/wheels/8a/8b/89/78175deb43cc8af2c5870d00362aedc1d4f1b39a5513707cce 2024-09-14 07:03:50 DEBUG unit.etcd/1.install logger.go:60 Successfully built setuptools-scm 2024-09-14 07:03:50 DEBUG unit.etcd/1.install logger.go:60 Installing collected packages: setuptools-scm 2024-09-14 07:03:51 DEBUG unit.etcd/1.install logger.go:60 Successfully installed setuptools-scm-1.17.0 2024-09-14 07:03:52 DEBUG unit.etcd/1.install logger.go:60 Looking in links: wheelhouse 2024-09-14 07:03:52 DEBUG unit.etcd/1.install logger.go:60 Processing ./wheelhouse/tenacity-5.0.3.tar.gz 2024-09-14 07:03:54 DEBUG unit.etcd/1.install logger.go:60 Processing ./wheelhouse/charmhelpers-0.20.22.tar.gz 2024-09-14 07:03:55 DEBUG unit.etcd/1.install logger.go:60 Processing ./wheelhouse/pbr-5.6.0.tar.gz 2024-09-14 07:03:55 DEBUG unit.etcd/1.install logger.go:60 Processing ./wheelhouse/netaddr-0.7.19.tar.gz 2024-09-14 07:03:56 DEBUG unit.etcd/1.install logger.go:60 Processing ./wheelhouse/wheel-0.33.6.tar.gz 2024-09-14 07:03:56 DEBUG unit.etcd/1.install logger.go:60 Processing ./wheelhouse/MarkupSafe-1.1.1.tar.gz 2024-09-14 07:03:56 DEBUG unit.etcd/1.install logger.go:60 Processing ./wheelhouse/pyaml-21.8.3.tar.gz 2024-09-14 07:03:56 DEBUG unit.etcd/1.install logger.go:60 Processing ./wheelhouse/Tempita-0.5.2.tar.gz 2024-09-14 07:03:56 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for etcd/1 : {10 {map[easyrsa/0:{0}] map[] []}} 2024-09-14 07:03:56 DEBUG unit.etcd/1.install logger.go:60 Processing ./wheelhouse/charms.reactive-1.4.1.tar.gz 2024-09-14 07:03:57 DEBUG unit.etcd/1.install logger.go:60 Processing ./wheelhouse/charms.templating.jinja2-1.0.2.tar.gz 2024-09-14 07:03:57 DEBUG unit.etcd/1.install logger.go:60 Processing ./wheelhouse/six-1.16.0.tar.gz 2024-09-14 07:03:57 DEBUG unit.etcd/1.install logger.go:60 Processing ./wheelhouse/Jinja2-2.10.1.tar.gz 2024-09-14 07:03:57 DEBUG unit.etcd/1.install logger.go:60 Processing ./wheelhouse/PyYAML-5.2.tar.gz 2024-09-14 07:03:58 DEBUG unit.etcd/1.install logger.go:60 Building wheels for collected packages: tenacity, charmhelpers, pbr, netaddr, wheel, MarkupSafe, pyaml, Tempita, charms.reactive, charms.templating.jinja2, six, Jinja2, PyYAML 2024-09-14 07:03:58 DEBUG unit.etcd/1.install logger.go:60 Building wheel for tenacity (setup.py): started 2024-09-14 07:03:58 DEBUG unit.etcd/1.install logger.go:60 Building wheel for tenacity (setup.py): finished with status 'done' 2024-09-14 07:03:58 DEBUG unit.etcd/1.install logger.go:60 Created wheel for tenacity: filename=tenacity-5.0.3-py2.py3-none-any.whl size=38871 sha256=d0cb0083cde3026a0843774947a7af5980039183d1aa891c927deaa435f8c87f 2024-09-14 07:03:58 DEBUG unit.etcd/1.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-054z0zt5/wheels/79/cd/08/10f43450ddfbf002469c49a6d9361574cf137c7f9557292d52 2024-09-14 07:03:58 DEBUG unit.etcd/1.install logger.go:60 Building wheel for charmhelpers (setup.py): started 2024-09-14 07:03:58 DEBUG unit.etcd/1.install logger.go:60 Building wheel for charmhelpers (setup.py): finished with status 'done' 2024-09-14 07:03:58 DEBUG unit.etcd/1.install logger.go:60 Created wheel for charmhelpers: filename=charmhelpers-0.20.22-py3-none-any.whl size=432838 sha256=52b941d063effbb8ea0986c40cc7e0d76f786eb75c1d8deb10eed116e7777620 2024-09-14 07:03:58 DEBUG unit.etcd/1.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-054z0zt5/wheels/43/51/d1/dbbbd1d895722c76aa8a4d1618e75dd90a4051fba4e34ec2cf 2024-09-14 07:03:58 DEBUG unit.etcd/1.install logger.go:60 Building wheel for pbr (setup.py): started 2024-09-14 07:03:58 DEBUG unit.etcd/1.install logger.go:60 Building wheel for pbr (setup.py): finished with status 'done' 2024-09-14 07:03:58 DEBUG unit.etcd/1.install logger.go:60 Created wheel for pbr: filename=pbr-5.6.0-py2.py3-none-any.whl size=111309 sha256=274c4642edfc5e0f85cce7d0f2a813b14779ee0c51665d4e575f3fdbbab77b09 2024-09-14 07:03:58 DEBUG unit.etcd/1.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-054z0zt5/wheels/87/a2/64/d8fa08b636e7570cc6620cee4ca030dd2316e84fdd2702d09b 2024-09-14 07:03:58 DEBUG unit.etcd/1.install logger.go:60 Building wheel for netaddr (setup.py): started 2024-09-14 07:03:59 DEBUG unit.etcd/1.install logger.go:60 Building wheel for netaddr (setup.py): finished with status 'done' 2024-09-14 07:03:59 DEBUG unit.etcd/1.install logger.go:60 Created wheel for netaddr: filename=netaddr-0.7.19-py3-none-any.whl size=1627892 sha256=38341d39253cd4a64e2ba52e9c962a315cd282ddadc01fbe0e21ee5cd4abd09d 2024-09-14 07:03:59 DEBUG unit.etcd/1.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-054z0zt5/wheels/89/2b/40/6b186bb4084fdeba3cffec001c67281148edebf1d3ba90c6b7 2024-09-14 07:03:59 DEBUG unit.etcd/1.install logger.go:60 Building wheel for wheel (setup.py): started 2024-09-14 07:03:59 DEBUG unit.etcd/1.install logger.go:60 Building wheel for wheel (setup.py): finished with status 'done' 2024-09-14 07:03:59 DEBUG unit.etcd/1.install logger.go:60 Created wheel for wheel: filename=wheel-0.33.6-py2.py3-none-any.whl size=21555 sha256=3e6ba4f653fa97fc42aedd322e6a7441cb3bd60e6ca3aa38b6bd257eeb23aee7 2024-09-14 07:03:59 DEBUG unit.etcd/1.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-054z0zt5/wheels/5e/10/c8/ebff41132c9fce7a0c0776fdce4a8e22ac503a9f9ddbf94548 2024-09-14 07:03:59 DEBUG unit.etcd/1.install logger.go:60 Building wheel for MarkupSafe (setup.py): started 2024-09-14 07:04:00 DEBUG unit.etcd/1.install logger.go:60 Building wheel for MarkupSafe (setup.py): finished with status 'done' 2024-09-14 07:04:00 DEBUG unit.etcd/1.install logger.go:60 Created wheel for MarkupSafe: filename=MarkupSafe-1.1.1-cp38-cp38-linux_x86_64.whl size=32946 sha256=a7e352fa22571b01a65ab4d66bd633aa412999fa21c54fb85d69f36cc7c7f95e 2024-09-14 07:04:00 DEBUG unit.etcd/1.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-054z0zt5/wheels/a2/95/f3/bdfe36e2742fb1129713efe7fa67e306be30d556ef419fb69a 2024-09-14 07:04:00 DEBUG unit.etcd/1.install logger.go:60 Building wheel for pyaml (setup.py): started 2024-09-14 07:04:00 DEBUG unit.etcd/1.install logger.go:60 Building wheel for pyaml (setup.py): finished with status 'done' 2024-09-14 07:04:00 DEBUG unit.etcd/1.install logger.go:60 Created wheel for pyaml: filename=pyaml-21.8.3-py2.py3-none-any.whl size=17425 sha256=d74841da948e44c8ef557fea8e5f1359628aa705d19ba49cadfbfaa92b2de1a9 2024-09-14 07:04:00 DEBUG unit.etcd/1.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-054z0zt5/wheels/45/21/3b/69e46f2c356be3e20b17969430cefdf86608283c5a6de57120 2024-09-14 07:04:00 DEBUG unit.etcd/1.install logger.go:60 Building wheel for Tempita (setup.py): started 2024-09-14 07:04:01 DEBUG unit.etcd/1.install logger.go:60 Building wheel for Tempita (setup.py): finished with status 'done' 2024-09-14 07:04:01 DEBUG unit.etcd/1.install logger.go:60 Created wheel for Tempita: filename=Tempita-0.5.2-py3-none-any.whl size=12880 sha256=e53a3c8b3b4e4c1b5af2435d4eedc2be55f11a6ebba46171a05f91a90a3284e4 2024-09-14 07:04:01 DEBUG unit.etcd/1.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-054z0zt5/wheels/10/d7/c3/7b351989ea3d61f1e7d2d66b627124704509fc7cff246bf4b9 2024-09-14 07:04:01 DEBUG unit.etcd/1.install logger.go:60 Building wheel for charms.reactive (setup.py): started 2024-09-14 07:04:01 DEBUG unit.etcd/1.install logger.go:60 Building wheel for charms.reactive (setup.py): finished with status 'done' 2024-09-14 07:04:01 DEBUG unit.etcd/1.install logger.go:60 Created wheel for charms.reactive: filename=charms.reactive-1.4.1-py3-none-any.whl size=43697 sha256=741859877841e227b65242985bf7ea2112f3ec5aa8ac0434819dbfef8f6023d1 2024-09-14 07:04:01 DEBUG unit.etcd/1.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-054z0zt5/wheels/df/df/c1/67f0dc86dc8c84cac7d037470cac05d4add40320280f69a2f8 2024-09-14 07:04:01 DEBUG unit.etcd/1.install logger.go:60 Building wheel for charms.templating.jinja2 (setup.py): started 2024-09-14 07:04:01 DEBUG unit.etcd/1.install logger.go:60 Building wheel for charms.templating.jinja2 (setup.py): finished with status 'done' 2024-09-14 07:04:01 DEBUG unit.etcd/1.install logger.go:60 Created wheel for charms.templating.jinja2: filename=charms.templating.jinja2-1.0.2-py3-none-any.whl size=4020 sha256=41822252f232082b6977852d047d6e23c9e5d202037336057bb967952efc3149 2024-09-14 07:04:01 DEBUG unit.etcd/1.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-054z0zt5/wheels/78/1f/10/25f6b4fa18e9393602804b2bfbf727178d61d1985285319c49 2024-09-14 07:04:01 DEBUG unit.etcd/1.install logger.go:60 Building wheel for six (setup.py): started 2024-09-14 07:04:02 DEBUG unit.etcd/1.install logger.go:60 Building wheel for six (setup.py): finished with status 'done' 2024-09-14 07:04:02 DEBUG unit.etcd/1.install logger.go:60 Created wheel for six: filename=six-1.16.0-py2.py3-none-any.whl size=11053 sha256=6f5ce58e0f0bd81e8adb2f0709940e0071f3b16561331b0e9473bbb6c22209ce 2024-09-14 07:04:02 DEBUG unit.etcd/1.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-054z0zt5/wheels/3e/b3/92/bf03c877c09da795dea58c9eb468f441ca07af688937ccf50a 2024-09-14 07:04:02 DEBUG unit.etcd/1.install logger.go:60 Building wheel for Jinja2 (setup.py): started 2024-09-14 07:04:02 DEBUG unit.etcd/1.install logger.go:60 Building wheel for Jinja2 (setup.py): finished with status 'done' 2024-09-14 07:04:02 DEBUG unit.etcd/1.install logger.go:60 Created wheel for Jinja2: filename=Jinja2-2.10.1-py2.py3-none-any.whl size=124884 sha256=5a039335a9b6ef2d2a2627739f328ad2fbb14a35e789357ab929d3ce557c185b 2024-09-14 07:04:02 DEBUG unit.etcd/1.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-054z0zt5/wheels/2d/a0/b2/0036dae48e6b13d201977531503fe70d73a57a37c977874dc2 2024-09-14 07:04:02 DEBUG unit.etcd/1.install logger.go:60 Building wheel for PyYAML (setup.py): started 2024-09-14 07:04:02 DEBUG unit.etcd/1.install logger.go:60 Building wheel for PyYAML (setup.py): finished with status 'done' 2024-09-14 07:04:02 DEBUG unit.etcd/1.install logger.go:60 Created wheel for PyYAML: filename=PyYAML-5.2-cp38-cp38-linux_x86_64.whl size=44208 sha256=9d0784f0280164f0887213d863fb4228f1361a62cc86f5605ba4c3a39d56211f 2024-09-14 07:04:02 DEBUG unit.etcd/1.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-054z0zt5/wheels/7e/5d/63/61616b7e1ceace9e2529a13ea7df7b6e70646d14edf7cd266b 2024-09-14 07:04:02 DEBUG unit.etcd/1.install logger.go:60 Successfully built tenacity charmhelpers pbr netaddr wheel MarkupSafe pyaml Tempita charms.reactive charms.templating.jinja2 six Jinja2 PyYAML 2024-09-14 07:04:02 DEBUG unit.etcd/1.install logger.go:60 Installing collected packages: six, tenacity, MarkupSafe, Jinja2, PyYAML, Tempita, netaddr, pbr, charmhelpers, wheel, pyaml, charms.reactive, charms.templating.jinja2 2024-09-14 07:04:03 DEBUG unit.etcd/1.install logger.go:60 Attempting uninstall: wheel 2024-09-14 07:04:03 DEBUG unit.etcd/1.install logger.go:60 Found existing installation: wheel 0.34.2 2024-09-14 07:04:03 DEBUG unit.etcd/1.install logger.go:60 Uninstalling wheel-0.34.2: 2024-09-14 07:04:03 DEBUG unit.etcd/1.install logger.go:60 Successfully uninstalled wheel-0.34.2 2024-09-14 07:04:03 DEBUG unit.etcd/1.install logger.go:60 Successfully installed Jinja2-2.10.1 MarkupSafe-1.1.1 PyYAML-5.2 Tempita-0.5.2 charmhelpers-0.20.22 charms.reactive-1.4.1 charms.templating.jinja2-1.0.2 netaddr-0.7.19 pbr-5.6.0 pyaml-21.8.3 six-1.16.0 tenacity-5.0.3 wheel-0.33.6 2024-09-14 07:04:03 INFO unit.etcd/1.juju-log server.go:316 Reactive main running for hook install 2024-09-14 07:04:03 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.changed 2024-09-14 07:04:03 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.changed.nagios_context 2024-09-14 07:04:03 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.nagios_context 2024-09-14 07:04:03 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.nagios_context 2024-09-14 07:04:03 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.changed.nagios_servicegroups 2024-09-14 07:04:03 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2024-09-14 07:04:03 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.changed.snapd_refresh 2024-09-14 07:04:03 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.snapd_refresh 2024-09-14 07:04:03 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.snapd_refresh 2024-09-14 07:04:03 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.changed.port 2024-09-14 07:04:03 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.port 2024-09-14 07:04:03 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.port 2024-09-14 07:04:03 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.changed.management_port 2024-09-14 07:04:03 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.management_port 2024-09-14 07:04:03 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.management_port 2024-09-14 07:04:03 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.changed.channel 2024-09-14 07:04:03 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.channel 2024-09-14 07:04:03 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.channel 2024-09-14 07:04:03 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.changed.bind_to_all_interfaces 2024-09-14 07:04:03 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.bind_to_all_interfaces 2024-09-14 07:04:03 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.bind_to_all_interfaces 2024-09-14 07:04:03 INFO unit.etcd/1.juju-log server.go:316 Initializing Leadership Layer (is leader) 2024-09-14 07:04:03 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag leadership.is_leader 2024-09-14 07:04:03 INFO unit.etcd/1.juju-log server.go:316 Initializing Snap Layer 2024-09-14 07:04:03 DEBUG unit.etcd/1.install logger.go:60 none 2024-09-14 07:04:03 DEBUG unit.etcd/1.juju-log server.go:316 tracer> tracer: starting handler dispatch, 22 flags set tracer: set flag config.changed tracer: set flag config.changed.bind_to_all_interfaces tracer: set flag config.changed.channel tracer: set flag config.changed.management_port tracer: set flag config.changed.nagios_context tracer: set flag config.changed.nagios_servicegroups tracer: set flag config.changed.port tracer: set flag config.changed.snapd_refresh tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag leadership.is_leader 2024-09-14 07:04:03 DEBUG unit.etcd/1.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-09-14 07:04:03 DEBUG unit.etcd/1.juju-log server.go:316 tracer> tracer: main dispatch loop, 6 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/cdk_service_kicker.py:13:install_cdk_service_kicker tracer: ++ queue handler reactive/etcd.py:131:missing_relation_notice tracer: ++ queue handler reactive/etcd.py:332:channel_changed tracer: ++ queue handler reactive/etcd.py:338:snap_install tracer: ++ queue handler reactive/etcd.py:748:force_update_nrpe_config 2024-09-14 07:04:03 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/cdk_service_kicker.py:13:install_cdk_service_kicker 2024-09-14 07:04:03 DEBUG unit.etcd/1.juju-log server.go:316 Writing file /usr/bin/cdk-service-kicker root:root 444 2024-09-14 07:04:03 DEBUG unit.etcd/1.juju-log server.go:316 Writing file /etc/systemd/system/cdk-service-kicker.service root:root 444 2024-09-14 07:04:03 WARNING unit.etcd/1.install logger.go:60 Created symlink /etc/systemd/system/multi-user.target.wants/cdk-service-kicker.service → /etc/systemd/system/cdk-service-kicker.service. 2024-09-14 07:04:04 DEBUG unit.etcd/1.juju-log server.go:316 tracer> tracer: set flag cdk-service-kicker.installed tracer: -- dequeue handler reactive/cdk_service_kicker.py:13:install_cdk_service_kicker 2024-09-14 07:04:04 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:131:missing_relation_notice 2024-09-14 07:04:04 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:332:channel_changed 2024-09-14 07:04:04 DEBUG unit.etcd/1.juju-log server.go:316 tracer> tracer: set flag etcd.rerender-config tracer: ++ queue handler reactive/etcd.py:235:rerender_config 2024-09-14 07:04:04 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:338:snap_install 2024-09-14 07:04:05 INFO unit.etcd/1.juju-log server.go:316 Installing core from store 2024-09-14 07:04:12 DEBUG unit.etcd/1.juju-log server.go:316 Installation successful cmd="['snap', 'install', '--channel=stable', 'core']" output="b'core 16-2.61.4-20240607 from Canonical** installed\n'" 2024-09-14 07:04:12 DEBUG unit.etcd/1.juju-log server.go:316 tracer> tracer: set flag snap.installed.core tracer: ++ queue handler reactive/snap.py:329:change_snapd_refresh 2024-09-14 07:04:13 INFO unit.etcd/1.juju-log server.go:316 Installing etcd from store 2024-09-14 07:04:23 DEBUG unit.etcd/1.juju-log server.go:316 Installation successful cmd="['snap', 'install', '--channel=3.4/stable', 'etcd']" output="b'etcd (3.4/stable) 3.4.22 from Canonical** installed\n'" 2024-09-14 07:04:23 DEBUG unit.etcd/1.juju-log server.go:316 tracer> tracer: set flag snap.installed.etcd tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:180:leader_config_changed tracer: ++ queue handler reactive/etcd.py:228:bind_to_all_interfaces_changed tracer: ++ queue handler reactive/etcd.py:367:add_systemd_restart_always tracer: ++ queue handler reactive/etcd.py:570:render_default_user_ssl_exports 2024-09-14 07:04:23 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:748:force_update_nrpe_config 2024-09-14 07:04:23 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-09-14 07:04:23 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-14 07:04:23 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:180:leader_config_changed 2024-09-14 07:04:23 INFO unit.etcd/1.juju-log server.go:316 Previous port: None 2024-09-14 07:04:23 INFO unit.etcd/1.juju-log server.go:316 Previous management port: None 2024-09-14 07:04:23 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:228:bind_to_all_interfaces_changed 2024-09-14 07:04:23 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:235:rerender_config 2024-09-14 07:04:23 INFO unit.etcd/1.juju-log server.go:316 Rendering config file for etcd1 2024-09-14 07:04:23 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for etcd/1: ok=true 2024-09-14 07:04:23 DEBUG unit.etcd/1.juju-log server.go:316 Writing file /var/snap/etcd/common/etcd.conf.yml root:root 444 2024-09-14 07:04:23 DEBUG unit.etcd/1.juju-log server.go:316 tracer> tracer: cleared flag etcd.rerender-config tracer: -- dequeue handler reactive/etcd.py:235:rerender_config 2024-09-14 07:04:23 DEBUG unit.etcd/1.install logger.go:60 inactive 2024-09-14 07:04:24 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:367:add_systemd_restart_always 2024-09-14 07:04:24 DEBUG unit.etcd/1.juju-log server.go:316 tracer> tracer: set flag etcd.service-restart.configured tracer: -- dequeue handler reactive/etcd.py:367:add_systemd_restart_always 2024-09-14 07:04:24 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:570:render_default_user_ssl_exports 2024-09-14 07:04:24 DEBUG unit.etcd/1.juju-log server.go:316 tracer> tracer: set flag etcd.ssl.exported tracer: -- dequeue handler reactive/etcd.py:570:render_default_user_ssl_exports 2024-09-14 07:04:24 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/snap.py:329:change_snapd_refresh 2024-09-14 07:04:24 INFO unit.etcd/1.juju-log server.go:316 Set config refresh.timer=fri2 for snap core 2024-09-14 07:04:27 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag snap.refresh.was-set 2024-09-14 07:04:27 DEBUG unit.etcd/1.juju-log server.go:316 tracer> tracer: set flag snap.refresh.set tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: -- dequeue handler reactive/snap.py:329:change_snapd_refresh 2024-09-14 07:04:27 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:488:process_snapd_timer 2024-09-14 07:04:27 INFO unit.etcd/1.juju-log server.go:316 Get config refresh.timer for snap core 2024-09-14 07:04:27 INFO unit.etcd/1.juju-log server.go:316 setting snapd_refresh timer to: fri2 2024-09-14 07:04:27 INFO unit.etcd/1.juju-log server.go:316 status-set: blocked: Missing relation to certificate authority. 2024-09-14 07:04:27 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for etcd/1: ok=true 2024-09-14 07:04:28 INFO juju.worker.uniter.operation runhook.go:159 ran "install" hook (via explicit, bespoke hook script) 2024-09-14 07:04:28 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run install hook" for etcd/1 2024-09-14 07:04:28 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-14 07:04:28 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/1 uniter (run install hook) 2024-09-14 07:04:28 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/1 2024-09-14 07:04:28 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "etcd/1" (leader=true) entered scope for relation "etcd:cluster" 2024-09-14 07:04:28 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "etcd/1" (leader=true) entered scope for relation "kubernetes-master:etcd etcd:db" 2024-09-14 07:04:28 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "etcd/1" (leader=true) entered scope for relation "etcd:certificates easyrsa:client" 2024-09-14 07:04:28 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-created (10; app: easyrsa) hook for etcd/1 2024-09-14 07:04:28 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/1 uniter (run relation-created (10; app: easyrsa) hook) 2024-09-14 07:04:38 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for etcd/1 : {0 {map[etcd/0:{0}] map[] []}} 2024-09-14 07:04:50 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for etcd/1 : {0 {map[etcd/2:{0}] map[] []}} 2024-09-14 07:06:32 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/1 uniter (run relation-created (10; app: easyrsa) hook) 2024-09-14 07:06:32 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-created (10; app: easyrsa) hook" for etcd/1 2024-09-14 07:06:32 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-created (10; app: easyrsa) hook" for etcd/1 2024-09-14 07:06:32 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running certificates-relation-created hook 2024-09-14 07:06:32 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-1/agent.socket } 2024-09-14 07:06:33 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Reactive main running for hook certificates-relation-created 2024-09-14 07:06:33 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:131:missing_relation_notice tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer 2024-09-14 07:06:33 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.default.nagios_context 2024-09-14 07:06:33 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for etcd/1 : {8 {map[kubernetes-master/1:{0}] map[] []}} 2024-09-14 07:06:33 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.default.nagios_servicegroups 2024-09-14 07:06:33 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.set.snapd_refresh 2024-09-14 07:06:33 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.default.snapd_refresh 2024-09-14 07:06:33 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.set.port 2024-09-14 07:06:33 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.default.port 2024-09-14 07:06:33 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.set.management_port 2024-09-14 07:06:33 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.default.management_port 2024-09-14 07:06:33 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.set.channel 2024-09-14 07:06:33 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.default.channel 2024-09-14 07:06:33 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.set.bind_to_all_interfaces 2024-09-14 07:06:33 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.default.bind_to_all_interfaces 2024-09-14 07:06:33 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Initializing Leadership Layer (is leader) 2024-09-14 07:06:33 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag leadership.changed.snapd_refresh 2024-09-14 07:06:33 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag leadership.set.snapd_refresh 2024-09-14 07:06:33 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag leadership.changed.token 2024-09-14 07:06:33 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag leadership.set.token 2024-09-14 07:06:33 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag leadership.changed 2024-09-14 07:06:33 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Initializing Snap Layer 2024-09-14 07:06:33 DEBUG unit.etcd/1.certificates-relation-created logger.go:60 none 2024-09-14 07:06:33 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer> tracer: starting handler dispatch, 26 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag leadership.changed tracer: set flag leadership.changed.snapd_refresh tracer: set flag leadership.changed.token tracer: set flag leadership.is_leader tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set 2024-09-14 07:06:33 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: hooks phase, 0 handlers queued 2024-09-14 07:06:33 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer> tracer: main dispatch loop, 4 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:131:missing_relation_notice tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer 2024-09-14 07:06:33 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-14 07:06:33 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/etcd.py:131:missing_relation_notice 2024-09-14 07:06:33 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/etcd.py:488:process_snapd_timer 2024-09-14 07:06:33 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Get config refresh.timer for snap core 2024-09-14 07:06:33 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-09-14 07:06:33 INFO unit.etcd/1.juju-log server.go:316 certificates:10: status-set: blocked: Missing relation to certificate authority. 2024-09-14 07:06:34 INFO juju.worker.uniter.operation runhook.go:159 ran "certificates-relation-created" hook (via explicit, bespoke hook script) 2024-09-14 07:06:34 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-created (10; app: easyrsa) hook" for etcd/1 2024-09-14 07:06:34 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-14 07:06:34 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/1 uniter (run relation-created (10; app: easyrsa) hook) 2024-09-14 07:06:34 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/1 2024-09-14 07:06:34 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-created (0; app: etcd) hook for etcd/1 2024-09-14 07:06:34 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/1 uniter (run relation-created (0; app: etcd) hook) 2024-09-14 07:06:45 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for etcd/1 : {8 {map[kubernetes-master/0:{0}] map[] []}} 2024-09-14 07:07:01 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for etcd/1 : {8 {map[kubernetes-master/2:{0}] map[] []}} 2024-09-14 07:07:19 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/1 uniter (run relation-created (0; app: etcd) hook) 2024-09-14 07:07:19 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-created (0; app: etcd) hook" for etcd/1 2024-09-14 07:07:19 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-created (0; app: etcd) hook" for etcd/1 2024-09-14 07:07:19 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running cluster-relation-created hook 2024-09-14 07:07:19 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-1/agent.socket } 2024-09-14 07:07:19 INFO unit.etcd/1.juju-log server.go:316 cluster:0: Reactive main running for hook cluster-relation-created 2024-09-14 07:07:19 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:131:missing_relation_notice tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer 2024-09-14 07:07:19 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: set flag config.default.nagios_context 2024-09-14 07:07:19 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: set flag config.default.nagios_servicegroups 2024-09-14 07:07:19 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: set flag config.set.snapd_refresh 2024-09-14 07:07:19 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: set flag config.default.snapd_refresh 2024-09-14 07:07:19 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: set flag config.set.port 2024-09-14 07:07:19 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: set flag config.default.port 2024-09-14 07:07:19 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: set flag config.set.management_port 2024-09-14 07:07:19 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: set flag config.default.management_port 2024-09-14 07:07:19 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: set flag config.set.channel 2024-09-14 07:07:19 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: set flag config.default.channel 2024-09-14 07:07:19 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: set flag config.set.bind_to_all_interfaces 2024-09-14 07:07:19 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: set flag config.default.bind_to_all_interfaces 2024-09-14 07:07:19 INFO unit.etcd/1.juju-log server.go:316 cluster:0: Initializing Leadership Layer (is leader) 2024-09-14 07:07:19 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: cleared flag leadership.changed.snapd_refresh 2024-09-14 07:07:19 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: cleared flag leadership.changed.token 2024-09-14 07:07:19 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: cleared flag leadership.changed 2024-09-14 07:07:19 INFO unit.etcd/1.juju-log server.go:316 cluster:0: Initializing Snap Layer 2024-09-14 07:07:19 DEBUG unit.etcd/1.cluster-relation-created logger.go:60 none 2024-09-14 07:07:19 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer> tracer: starting handler dispatch, 23 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag leadership.is_leader tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set 2024-09-14 07:07:19 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: hooks phase, 0 handlers queued 2024-09-14 07:07:19 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer> tracer: main dispatch loop, 4 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:131:missing_relation_notice tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer 2024-09-14 07:07:19 INFO unit.etcd/1.juju-log server.go:316 cluster:0: Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-14 07:07:19 INFO unit.etcd/1.juju-log server.go:316 cluster:0: Invoking reactive handler: reactive/etcd.py:131:missing_relation_notice 2024-09-14 07:07:19 INFO unit.etcd/1.juju-log server.go:316 cluster:0: Invoking reactive handler: reactive/etcd.py:488:process_snapd_timer 2024-09-14 07:07:19 INFO unit.etcd/1.juju-log server.go:316 cluster:0: Get config refresh.timer for snap core 2024-09-14 07:07:20 INFO unit.etcd/1.juju-log server.go:316 cluster:0: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-09-14 07:07:20 INFO unit.etcd/1.juju-log server.go:316 cluster:0: status-set: blocked: Missing relation to certificate authority. 2024-09-14 07:07:24 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for etcd/1 2024-09-14 07:07:24 INFO juju.worker.uniter.operation runhook.go:159 ran "cluster-relation-created" hook (via explicit, bespoke hook script) 2024-09-14 07:07:24 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-created (0; app: etcd) hook" for etcd/1 2024-09-14 07:07:24 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-14 07:07:24 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/1 uniter (run relation-created (0; app: etcd) hook) 2024-09-14 07:07:24 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/1 2024-09-14 07:07:24 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-created (8; app: kubernetes-master) hook for etcd/1 2024-09-14 07:07:24 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/1 uniter (run relation-created (8; app: kubernetes-master) hook) 2024-09-14 07:08:00 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/1 uniter (run relation-created (8; app: kubernetes-master) hook) 2024-09-14 07:08:00 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-created (8; app: kubernetes-master) hook" for etcd/1 2024-09-14 07:08:00 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-created (8; app: kubernetes-master) hook" for etcd/1 2024-09-14 07:08:00 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running db-relation-created hook 2024-09-14 07:08:00 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-1/agent.socket } 2024-09-14 07:08:01 INFO unit.etcd/1.juju-log server.go:316 db:8: Reactive main running for hook db-relation-created 2024-09-14 07:08:01 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:131:missing_relation_notice tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer 2024-09-14 07:08:01 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer: set flag config.default.nagios_context 2024-09-14 07:08:01 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer: set flag config.default.nagios_servicegroups 2024-09-14 07:08:01 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer: set flag config.set.snapd_refresh 2024-09-14 07:08:01 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer: set flag config.default.snapd_refresh 2024-09-14 07:08:01 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer: set flag config.set.port 2024-09-14 07:08:01 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer: set flag config.default.port 2024-09-14 07:08:01 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer: set flag config.set.management_port 2024-09-14 07:08:01 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer: set flag config.default.management_port 2024-09-14 07:08:01 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer: set flag config.set.channel 2024-09-14 07:08:01 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer: set flag config.default.channel 2024-09-14 07:08:01 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer: set flag config.set.bind_to_all_interfaces 2024-09-14 07:08:01 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer: set flag config.default.bind_to_all_interfaces 2024-09-14 07:08:01 INFO unit.etcd/1.juju-log server.go:316 db:8: Initializing Leadership Layer (is leader) 2024-09-14 07:08:01 INFO unit.etcd/1.juju-log server.go:316 db:8: Initializing Snap Layer 2024-09-14 07:08:01 DEBUG unit.etcd/1.db-relation-created logger.go:60 none 2024-09-14 07:08:01 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer> tracer: starting handler dispatch, 23 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag leadership.is_leader tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set 2024-09-14 07:08:01 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer: hooks phase, 0 handlers queued 2024-09-14 07:08:01 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer> tracer: main dispatch loop, 4 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:131:missing_relation_notice tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer 2024-09-14 07:08:01 INFO unit.etcd/1.juju-log server.go:316 db:8: Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-14 07:08:01 INFO unit.etcd/1.juju-log server.go:316 db:8: Invoking reactive handler: reactive/etcd.py:131:missing_relation_notice 2024-09-14 07:08:01 INFO unit.etcd/1.juju-log server.go:316 db:8: Invoking reactive handler: reactive/etcd.py:488:process_snapd_timer 2024-09-14 07:08:01 INFO unit.etcd/1.juju-log server.go:316 db:8: Get config refresh.timer for snap core 2024-09-14 07:08:01 INFO unit.etcd/1.juju-log server.go:316 db:8: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-09-14 07:08:01 INFO unit.etcd/1.juju-log server.go:316 db:8: status-set: blocked: Missing relation to certificate authority. 2024-09-14 07:08:01 INFO juju.worker.uniter.operation runhook.go:159 ran "db-relation-created" hook (via explicit, bespoke hook script) 2024-09-14 07:08:01 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-created (8; app: kubernetes-master) hook" for etcd/1 2024-09-14 07:08:01 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-14 07:08:01 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/1 uniter (run relation-created (8; app: kubernetes-master) hook) 2024-09-14 07:08:01 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/1 2024-09-14 07:08:01 DEBUG juju.worker.uniter.operation executor.go:85 running operation accept leadership for etcd/1 2024-09-14 07:08:01 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "accept leadership" for etcd/1 2024-09-14 07:08:01 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "accept leadership" for etcd/1 2024-09-14 07:08:02 INFO juju.worker.uniter resolver.go:159 found queued "leader-elected" hook 2024-09-14 07:08:02 DEBUG juju.worker.uniter.operation executor.go:85 running operation run leader-elected hook for etcd/1 2024-09-14 07:08:02 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/1 uniter (run leader-elected hook) 2024-09-14 07:08:07 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/1 uniter (run leader-elected hook) 2024-09-14 07:08:07 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run leader-elected hook" for etcd/1 2024-09-14 07:08:07 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run leader-elected hook" for etcd/1 2024-09-14 07:08:07 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running leader-elected hook 2024-09-14 07:08:07 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-1/agent.socket } 2024-09-14 07:08:08 INFO unit.etcd/1.juju-log server.go:316 Reactive main running for hook leader-elected 2024-09-14 07:08:08 DEBUG unit.etcd/1.juju-log server.go:316 tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:131:missing_relation_notice tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer 2024-09-14 07:08:08 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.nagios_context 2024-09-14 07:08:08 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2024-09-14 07:08:08 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.snapd_refresh 2024-09-14 07:08:08 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.snapd_refresh 2024-09-14 07:08:08 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.port 2024-09-14 07:08:08 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.port 2024-09-14 07:08:08 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.management_port 2024-09-14 07:08:08 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.management_port 2024-09-14 07:08:08 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.channel 2024-09-14 07:08:08 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.channel 2024-09-14 07:08:08 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.bind_to_all_interfaces 2024-09-14 07:08:08 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.bind_to_all_interfaces 2024-09-14 07:08:08 INFO unit.etcd/1.juju-log server.go:316 Initializing Leadership Layer (is leader) 2024-09-14 07:08:08 INFO unit.etcd/1.juju-log server.go:316 Initializing Snap Layer 2024-09-14 07:08:08 DEBUG unit.etcd/1.leader-elected logger.go:60 none 2024-09-14 07:08:08 DEBUG unit.etcd/1.juju-log server.go:316 tracer> tracer: starting handler dispatch, 23 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag leadership.is_leader tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set 2024-09-14 07:08:08 DEBUG unit.etcd/1.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-09-14 07:08:08 DEBUG unit.etcd/1.juju-log server.go:316 tracer> tracer: main dispatch loop, 4 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:131:missing_relation_notice tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer 2024-09-14 07:08:08 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-14 07:08:08 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:131:missing_relation_notice 2024-09-14 07:08:08 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:488:process_snapd_timer 2024-09-14 07:08:08 INFO unit.etcd/1.juju-log server.go:316 Get config refresh.timer for snap core 2024-09-14 07:08:08 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-09-14 07:08:08 INFO unit.etcd/1.juju-log server.go:316 status-set: blocked: Missing relation to certificate authority. 2024-09-14 07:08:08 INFO juju.worker.uniter.operation runhook.go:159 ran "leader-elected" hook (via explicit, bespoke hook script) 2024-09-14 07:08:08 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run leader-elected hook" for etcd/1 2024-09-14 07:08:08 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-14 07:08:08 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/1 uniter (run leader-elected hook) 2024-09-14 07:08:08 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/1 2024-09-14 07:08:08 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-14 07:08:08 DEBUG juju.worker.uniter.operation executor.go:85 running operation run config-changed hook for etcd/1 2024-09-14 07:08:08 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/1 uniter (run config-changed hook) 2024-09-14 07:08:14 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/1 uniter (run config-changed hook) 2024-09-14 07:08:14 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run config-changed hook" for etcd/1 2024-09-14 07:08:14 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run config-changed hook" for etcd/1 2024-09-14 07:08:14 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running config-changed hook 2024-09-14 07:08:15 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-1/agent.socket } 2024-09-14 07:08:15 INFO unit.etcd/1.juju-log server.go:316 Reactive main running for hook config-changed 2024-09-14 07:08:15 DEBUG unit.etcd/1.juju-log server.go:316 tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:131:missing_relation_notice tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer 2024-09-14 07:08:15 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.nagios_context 2024-09-14 07:08:15 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2024-09-14 07:08:15 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.snapd_refresh 2024-09-14 07:08:15 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.snapd_refresh 2024-09-14 07:08:15 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.port 2024-09-14 07:08:15 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.port 2024-09-14 07:08:15 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.management_port 2024-09-14 07:08:15 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.management_port 2024-09-14 07:08:15 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.channel 2024-09-14 07:08:15 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.channel 2024-09-14 07:08:15 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.bind_to_all_interfaces 2024-09-14 07:08:15 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.bind_to_all_interfaces 2024-09-14 07:08:15 INFO unit.etcd/1.juju-log server.go:316 Initializing Leadership Layer (is leader) 2024-09-14 07:08:15 INFO unit.etcd/1.juju-log server.go:316 Initializing Snap Layer 2024-09-14 07:08:15 DEBUG unit.etcd/1.config-changed logger.go:60 none 2024-09-14 07:08:15 DEBUG unit.etcd/1.juju-log server.go:316 tracer> tracer: starting handler dispatch, 23 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag leadership.is_leader tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set 2024-09-14 07:08:15 DEBUG unit.etcd/1.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-09-14 07:08:15 DEBUG unit.etcd/1.juju-log server.go:316 tracer> tracer: main dispatch loop, 4 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:131:missing_relation_notice tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer 2024-09-14 07:08:15 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-14 07:08:15 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:131:missing_relation_notice 2024-09-14 07:08:15 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:488:process_snapd_timer 2024-09-14 07:08:15 INFO unit.etcd/1.juju-log server.go:316 Get config refresh.timer for snap core 2024-09-14 07:08:15 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-09-14 07:08:15 INFO unit.etcd/1.juju-log server.go:316 status-set: blocked: Missing relation to certificate authority. 2024-09-14 07:08:16 INFO juju.worker.uniter.operation runhook.go:159 ran "config-changed" hook (via explicit, bespoke hook script) 2024-09-14 07:08:16 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run config-changed hook" for etcd/1 2024-09-14 07:08:16 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-14 07:08:16 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/1 uniter (run config-changed hook) 2024-09-14 07:08:16 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/1 2024-09-14 07:08:16 INFO juju.worker.uniter resolver.go:159 found queued "start" hook 2024-09-14 07:08:16 DEBUG juju.worker.uniter.operation executor.go:85 running operation run start hook for etcd/1 2024-09-14 07:08:16 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/1 uniter (run start hook) 2024-09-14 07:08:21 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/1 uniter (run start hook) 2024-09-14 07:08:21 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run start hook" for etcd/1 2024-09-14 07:08:21 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run start hook" for etcd/1 2024-09-14 07:08:21 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running start hook 2024-09-14 07:08:21 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-1/agent.socket } 2024-09-14 07:08:22 INFO unit.etcd/1.juju-log server.go:316 Reactive main running for hook start 2024-09-14 07:08:22 DEBUG unit.etcd/1.juju-log server.go:316 tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:131:missing_relation_notice tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer 2024-09-14 07:08:22 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.nagios_context 2024-09-14 07:08:22 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2024-09-14 07:08:22 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.snapd_refresh 2024-09-14 07:08:22 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.snapd_refresh 2024-09-14 07:08:22 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.port 2024-09-14 07:08:22 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.port 2024-09-14 07:08:22 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.management_port 2024-09-14 07:08:22 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.management_port 2024-09-14 07:08:22 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.channel 2024-09-14 07:08:22 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.channel 2024-09-14 07:08:22 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.bind_to_all_interfaces 2024-09-14 07:08:22 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.bind_to_all_interfaces 2024-09-14 07:08:22 INFO unit.etcd/1.juju-log server.go:316 Initializing Leadership Layer (is leader) 2024-09-14 07:08:22 INFO unit.etcd/1.juju-log server.go:316 Initializing Snap Layer 2024-09-14 07:08:22 DEBUG unit.etcd/1.start logger.go:60 none 2024-09-14 07:08:22 DEBUG unit.etcd/1.juju-log server.go:316 tracer> tracer: starting handler dispatch, 23 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag leadership.is_leader tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set 2024-09-14 07:08:22 DEBUG unit.etcd/1.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-09-14 07:08:22 DEBUG unit.etcd/1.juju-log server.go:316 tracer> tracer: main dispatch loop, 4 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:131:missing_relation_notice tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer 2024-09-14 07:08:22 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-14 07:08:22 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:131:missing_relation_notice 2024-09-14 07:08:22 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:488:process_snapd_timer 2024-09-14 07:08:22 INFO unit.etcd/1.juju-log server.go:316 Get config refresh.timer for snap core 2024-09-14 07:08:22 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-09-14 07:08:22 INFO unit.etcd/1.juju-log server.go:316 status-set: blocked: Missing relation to certificate authority. 2024-09-14 07:08:22 INFO juju.worker.uniter.operation runhook.go:159 ran "start" hook (via explicit, bespoke hook script) 2024-09-14 07:08:22 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run start hook" for etcd/1 2024-09-14 07:08:22 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-14 07:08:22 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/1 uniter (run start hook) 2024-09-14 07:08:22 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/1 2024-09-14 07:08:22 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-14 07:08:22 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-joined (0; unit: etcd/0) hook for etcd/1 2024-09-14 07:08:22 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/1 uniter (run relation-joined (0; unit: etcd/0) hook) 2024-09-14 07:08:22 DEBUG juju.worker.dependency engine.go:580 "metric-collect" manifold worker started at 2024-09-14 07:08:22.955130479 +0000 UTC 2024-09-14 07:08:28 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/1 uniter (run relation-joined (0; unit: etcd/0) hook) 2024-09-14 07:08:28 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-joined (0; unit: etcd/0) hook" for etcd/1 2024-09-14 07:08:29 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-joined (0; unit: etcd/0) hook" for etcd/1 2024-09-14 07:08:29 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running cluster-relation-joined hook for etcd/0 2024-09-14 07:08:29 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-1/agent.socket } 2024-09-14 07:08:29 INFO unit.etcd/1.juju-log server.go:316 cluster:0: Reactive main running for hook cluster-relation-joined 2024-09-14 07:08:29 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:131:missing_relation_notice tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer 2024-09-14 07:08:29 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: set flag config.default.nagios_context 2024-09-14 07:08:29 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: set flag config.default.nagios_servicegroups 2024-09-14 07:08:29 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: set flag config.set.snapd_refresh 2024-09-14 07:08:29 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: set flag config.default.snapd_refresh 2024-09-14 07:08:29 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: set flag config.set.port 2024-09-14 07:08:29 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: set flag config.default.port 2024-09-14 07:08:29 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: set flag config.set.management_port 2024-09-14 07:08:29 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: set flag config.default.management_port 2024-09-14 07:08:29 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: set flag config.set.channel 2024-09-14 07:08:29 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: set flag config.default.channel 2024-09-14 07:08:29 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: set flag config.set.bind_to_all_interfaces 2024-09-14 07:08:29 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: set flag config.default.bind_to_all_interfaces 2024-09-14 07:08:29 INFO unit.etcd/1.juju-log server.go:316 cluster:0: Initializing Leadership Layer (is leader) 2024-09-14 07:08:29 INFO unit.etcd/1.juju-log server.go:316 cluster:0: Initializing Snap Layer 2024-09-14 07:08:29 DEBUG unit.etcd/1.cluster-relation-joined logger.go:60 none 2024-09-14 07:08:29 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer> tracer: starting handler dispatch, 23 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag leadership.is_leader tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set 2024-09-14 07:08:29 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler hooks/relations/etcd/peers.py:25:peer_joined 2024-09-14 07:08:29 INFO unit.etcd/1.juju-log server.go:316 cluster:0: Invoking reactive handler: hooks/relations/etcd/peers.py:25:peer_joined 2024-09-14 07:08:29 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: set flag cluster.joined 2024-09-14 07:08:29 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer> tracer: main dispatch loop, 5 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:131:missing_relation_notice tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer 2024-09-14 07:08:29 INFO unit.etcd/1.juju-log server.go:316 cluster:0: Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-14 07:08:29 INFO unit.etcd/1.juju-log server.go:316 cluster:0: Invoking reactive handler: reactive/etcd.py:131:missing_relation_notice 2024-09-14 07:08:29 INFO unit.etcd/1.juju-log server.go:316 cluster:0: Invoking reactive handler: reactive/etcd.py:247:set_db_ingress_address 2024-09-14 07:08:29 INFO unit.etcd/1.juju-log server.go:316 cluster:0: Invoking reactive handler: reactive/etcd.py:488:process_snapd_timer 2024-09-14 07:08:29 INFO unit.etcd/1.juju-log server.go:316 cluster:0: Get config refresh.timer for snap core 2024-09-14 07:08:29 INFO unit.etcd/1.juju-log server.go:316 cluster:0: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-09-14 07:08:29 INFO unit.etcd/1.juju-log server.go:316 cluster:0: status-set: blocked: Missing relation to certificate authority. 2024-09-14 07:08:30 INFO juju.worker.uniter.operation runhook.go:159 ran "cluster-relation-joined" hook (via explicit, bespoke hook script) 2024-09-14 07:08:30 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-joined (0; unit: etcd/0) hook" for etcd/1 2024-09-14 07:08:30 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-14 07:08:30 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/1 uniter (run relation-joined (0; unit: etcd/0) hook) 2024-09-14 07:08:30 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/1 2024-09-14 07:08:30 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-14 07:08:30 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (0; unit: etcd/0) hook for etcd/1 2024-09-14 07:08:30 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/1 uniter (run relation-changed (0; unit: etcd/0) hook) 2024-09-14 07:08:36 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/1 uniter (run relation-changed (0; unit: etcd/0) hook) 2024-09-14 07:08:36 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (0; unit: etcd/0) hook" for etcd/1 2024-09-14 07:08:36 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (0; unit: etcd/0) hook" for etcd/1 2024-09-14 07:08:36 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running cluster-relation-changed hook for etcd/0 2024-09-14 07:08:37 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-1/agent.socket } 2024-09-14 07:08:37 INFO unit.etcd/1.juju-log server.go:316 cluster:0: Reactive main running for hook cluster-relation-changed 2024-09-14 07:08:37 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:131:missing_relation_notice tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer 2024-09-14 07:08:37 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: set flag config.default.nagios_context 2024-09-14 07:08:37 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: set flag config.default.nagios_servicegroups 2024-09-14 07:08:37 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: set flag config.set.snapd_refresh 2024-09-14 07:08:37 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: set flag config.default.snapd_refresh 2024-09-14 07:08:37 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: set flag config.set.port 2024-09-14 07:08:37 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: set flag config.default.port 2024-09-14 07:08:37 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: set flag config.set.management_port 2024-09-14 07:08:37 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: set flag config.default.management_port 2024-09-14 07:08:37 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: set flag config.set.channel 2024-09-14 07:08:37 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: set flag config.default.channel 2024-09-14 07:08:37 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: set flag config.set.bind_to_all_interfaces 2024-09-14 07:08:37 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: set flag config.default.bind_to_all_interfaces 2024-09-14 07:08:37 INFO unit.etcd/1.juju-log server.go:316 cluster:0: Initializing Leadership Layer (is leader) 2024-09-14 07:08:37 INFO unit.etcd/1.juju-log server.go:316 cluster:0: Initializing Snap Layer 2024-09-14 07:08:37 DEBUG unit.etcd/1.cluster-relation-changed logger.go:60 none 2024-09-14 07:08:37 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer> tracer: starting handler dispatch, 24 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag cluster.joined tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag leadership.is_leader tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set 2024-09-14 07:08:37 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: hooks phase, 0 handlers queued 2024-09-14 07:08:37 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer> tracer: main dispatch loop, 5 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:131:missing_relation_notice tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer 2024-09-14 07:08:37 INFO unit.etcd/1.juju-log server.go:316 cluster:0: Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-14 07:08:37 INFO unit.etcd/1.juju-log server.go:316 cluster:0: Invoking reactive handler: reactive/etcd.py:131:missing_relation_notice 2024-09-14 07:08:37 INFO unit.etcd/1.juju-log server.go:316 cluster:0: Invoking reactive handler: reactive/etcd.py:247:set_db_ingress_address 2024-09-14 07:08:37 INFO unit.etcd/1.juju-log server.go:316 cluster:0: Invoking reactive handler: reactive/etcd.py:488:process_snapd_timer 2024-09-14 07:08:37 INFO unit.etcd/1.juju-log server.go:316 cluster:0: Get config refresh.timer for snap core 2024-09-14 07:08:37 INFO unit.etcd/1.juju-log server.go:316 cluster:0: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-09-14 07:08:37 INFO unit.etcd/1.juju-log server.go:316 cluster:0: status-set: blocked: Missing relation to certificate authority. 2024-09-14 07:08:38 INFO juju.worker.uniter.operation runhook.go:159 ran "cluster-relation-changed" hook (via explicit, bespoke hook script) 2024-09-14 07:08:38 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (0; unit: etcd/0) hook" for etcd/1 2024-09-14 07:08:38 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-14 07:08:38 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/1 uniter (run relation-changed (0; unit: etcd/0) hook) 2024-09-14 07:08:38 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/1 2024-09-14 07:08:38 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-14 07:08:38 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-joined (8; unit: kubernetes-master/0) hook for etcd/1 2024-09-14 07:08:38 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/1 uniter (run relation-joined (8; unit: kubernetes-master/0) hook) 2024-09-14 07:08:42 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/1 uniter (run relation-joined (8; unit: kubernetes-master/0) hook) 2024-09-14 07:08:42 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-joined (8; unit: kubernetes-master/0) hook" for etcd/1 2024-09-14 07:08:42 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-joined (8; unit: kubernetes-master/0) hook" for etcd/1 2024-09-14 07:08:42 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running db-relation-joined hook for kubernetes-master/0 2024-09-14 07:08:42 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-1/agent.socket } 2024-09-14 07:08:42 INFO unit.etcd/1.juju-log server.go:316 db:8: Reactive main running for hook db-relation-joined 2024-09-14 07:08:42 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:131:missing_relation_notice tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer 2024-09-14 07:08:42 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer: set flag config.default.nagios_context 2024-09-14 07:08:42 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer: set flag config.default.nagios_servicegroups 2024-09-14 07:08:42 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer: set flag config.set.snapd_refresh 2024-09-14 07:08:42 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer: set flag config.default.snapd_refresh 2024-09-14 07:08:42 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer: set flag config.set.port 2024-09-14 07:08:42 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer: set flag config.default.port 2024-09-14 07:08:42 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer: set flag config.set.management_port 2024-09-14 07:08:42 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer: set flag config.default.management_port 2024-09-14 07:08:42 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer: set flag config.set.channel 2024-09-14 07:08:42 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer: set flag config.default.channel 2024-09-14 07:08:42 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer: set flag config.set.bind_to_all_interfaces 2024-09-14 07:08:42 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer: set flag config.default.bind_to_all_interfaces 2024-09-14 07:08:42 INFO unit.etcd/1.juju-log server.go:316 db:8: Initializing Leadership Layer (is leader) 2024-09-14 07:08:42 INFO unit.etcd/1.juju-log server.go:316 db:8: Initializing Snap Layer 2024-09-14 07:08:42 DEBUG unit.etcd/1.db-relation-joined logger.go:60 none 2024-09-14 07:08:42 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer> tracer: starting handler dispatch, 24 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag cluster.joined tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag leadership.is_leader tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set 2024-09-14 07:08:42 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler hooks/relations/etcd/provides.py:22:joined_or_changed 2024-09-14 07:08:42 INFO unit.etcd/1.juju-log server.go:316 db:8: Invoking reactive handler: hooks/relations/etcd/provides.py:22:joined_or_changed 2024-09-14 07:08:42 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer: set flag db.connected 2024-09-14 07:08:42 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer> tracer: main dispatch loop, 5 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:131:missing_relation_notice tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer 2024-09-14 07:08:42 INFO unit.etcd/1.juju-log server.go:316 db:8: Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-14 07:08:43 INFO unit.etcd/1.juju-log server.go:316 db:8: Invoking reactive handler: reactive/etcd.py:131:missing_relation_notice 2024-09-14 07:08:43 INFO unit.etcd/1.juju-log server.go:316 db:8: Invoking reactive handler: reactive/etcd.py:247:set_db_ingress_address 2024-09-14 07:08:43 INFO unit.etcd/1.juju-log server.go:316 db:8: Invoking reactive handler: reactive/etcd.py:488:process_snapd_timer 2024-09-14 07:08:43 INFO unit.etcd/1.juju-log server.go:316 db:8: Get config refresh.timer for snap core 2024-09-14 07:08:43 INFO unit.etcd/1.juju-log server.go:316 db:8: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-09-14 07:08:43 INFO unit.etcd/1.juju-log server.go:316 db:8: status-set: blocked: Missing relation to certificate authority. 2024-09-14 07:08:43 INFO juju.worker.uniter.operation runhook.go:159 ran "db-relation-joined" hook (via explicit, bespoke hook script) 2024-09-14 07:08:43 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-joined (8; unit: kubernetes-master/0) hook" for etcd/1 2024-09-14 07:08:43 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-14 07:08:43 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/1 uniter (run relation-joined (8; unit: kubernetes-master/0) hook) 2024-09-14 07:08:43 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/1 2024-09-14 07:08:43 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-14 07:08:43 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-joined (10; unit: easyrsa/0) hook for etcd/1 2024-09-14 07:08:43 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/1 uniter (run relation-joined (10; unit: easyrsa/0) hook) 2024-09-14 07:08:49 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/1 uniter (run relation-joined (10; unit: easyrsa/0) hook) 2024-09-14 07:08:49 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-joined (10; unit: easyrsa/0) hook" for etcd/1 2024-09-14 07:08:49 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-joined (10; unit: easyrsa/0) hook" for etcd/1 2024-09-14 07:08:49 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running certificates-relation-joined hook for easyrsa/0 2024-09-14 07:08:49 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-1/agent.socket } 2024-09-14 07:08:49 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Reactive main running for hook certificates-relation-joined 2024-09-14 07:08:49 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer> tracer: set flag endpoint.certificates.joined tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:131:missing_relation_notice tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer 2024-09-14 07:08:49 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag endpoint.certificates.changed 2024-09-14 07:08:49 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag endpoint.certificates.changed.egress-subnets 2024-09-14 07:08:49 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag endpoint.certificates.changed.ingress-address 2024-09-14 07:08:49 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag endpoint.certificates.changed.private-address 2024-09-14 07:08:49 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.set.nagios_context 2024-09-14 07:08:49 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.default.nagios_context 2024-09-14 07:08:49 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.default.nagios_servicegroups 2024-09-14 07:08:49 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.set.snapd_refresh 2024-09-14 07:08:49 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.default.snapd_refresh 2024-09-14 07:08:49 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.set.port 2024-09-14 07:08:49 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.default.port 2024-09-14 07:08:49 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.set.management_port 2024-09-14 07:08:50 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.default.management_port 2024-09-14 07:08:50 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.set.channel 2024-09-14 07:08:50 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.default.channel 2024-09-14 07:08:50 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.set.bind_to_all_interfaces 2024-09-14 07:08:50 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.default.bind_to_all_interfaces 2024-09-14 07:08:50 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Initializing Leadership Layer (is leader) 2024-09-14 07:08:50 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Initializing Snap Layer 2024-09-14 07:08:50 DEBUG unit.etcd/1.certificates-relation-joined logger.go:60 none 2024-09-14 07:08:50 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer> tracer: starting handler dispatch, 30 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag cluster.joined tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag leadership.is_leader tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set 2024-09-14 07:08:50 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: hooks phase, 0 handlers queued 2024-09-14 07:08:50 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer> tracer: main dispatch loop, 5 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:131:missing_relation_notice tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer 2024-09-14 07:08:50 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-14 07:08:50 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/etcd.py:131:missing_relation_notice 2024-09-14 07:08:50 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/etcd.py:247:set_db_ingress_address 2024-09-14 07:08:50 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/etcd.py:488:process_snapd_timer 2024-09-14 07:08:50 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Get config refresh.timer for snap core 2024-09-14 07:08:50 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-14 07:08:50 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer> tracer: set flag certificates.available tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: -- dequeue handler reactive/etcd.py:131:missing_relation_notice 2024-09-14 07:08:50 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer> tracer: set flag certificates.client.cert.available tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-14 07:08:50 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-14 07:08:50 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-14 07:08:50 INFO unit.etcd/1.juju-log server.go:316 certificates:10: status-set: blocked: Missing relation to certificate authority. 2024-09-14 07:08:50 INFO juju.worker.uniter.operation runhook.go:159 ran "certificates-relation-joined" hook (via explicit, bespoke hook script) 2024-09-14 07:08:50 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-joined (10; unit: easyrsa/0) hook" for etcd/1 2024-09-14 07:08:50 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-14 07:08:50 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/1 uniter (run relation-joined (10; unit: easyrsa/0) hook) 2024-09-14 07:08:50 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/1 2024-09-14 07:08:50 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-14 07:08:50 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-14 07:08:50 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-joined (0; unit: etcd/2) hook for etcd/1 2024-09-14 07:08:50 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/1 uniter (run relation-joined (0; unit: etcd/2) hook) 2024-09-14 07:08:54 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for etcd/1 : {10 {map[easyrsa/0:{1}] map[] []}} 2024-09-14 07:08:55 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/1 uniter (run relation-joined (0; unit: etcd/2) hook) 2024-09-14 07:08:55 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-joined (0; unit: etcd/2) hook" for etcd/1 2024-09-14 07:08:55 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-joined (0; unit: etcd/2) hook" for etcd/1 2024-09-14 07:08:55 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running cluster-relation-joined hook for etcd/2 2024-09-14 07:08:55 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-1/agent.socket } 2024-09-14 07:08:55 INFO unit.etcd/1.juju-log server.go:316 cluster:0: Reactive main running for hook cluster-relation-joined 2024-09-14 07:08:56 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-14 07:08:56 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: set flag config.default.nagios_context 2024-09-14 07:08:56 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: set flag config.default.nagios_servicegroups 2024-09-14 07:08:56 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: set flag config.set.snapd_refresh 2024-09-14 07:08:56 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: set flag config.default.snapd_refresh 2024-09-14 07:08:56 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: set flag config.set.port 2024-09-14 07:08:56 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: set flag config.default.port 2024-09-14 07:08:56 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: set flag config.set.management_port 2024-09-14 07:08:56 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: set flag config.default.management_port 2024-09-14 07:08:56 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: set flag config.set.channel 2024-09-14 07:08:56 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: set flag config.default.channel 2024-09-14 07:08:56 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: set flag config.set.bind_to_all_interfaces 2024-09-14 07:08:56 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: set flag config.default.bind_to_all_interfaces 2024-09-14 07:08:56 INFO unit.etcd/1.juju-log server.go:316 cluster:0: Initializing Leadership Layer (is leader) 2024-09-14 07:08:56 INFO unit.etcd/1.juju-log server.go:316 cluster:0: Initializing Snap Layer 2024-09-14 07:08:56 DEBUG unit.etcd/1.cluster-relation-joined logger.go:60 none 2024-09-14 07:08:56 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer> tracer: starting handler dispatch, 32 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.client.cert.available tracer: set flag cluster.joined tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag leadership.is_leader tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set 2024-09-14 07:08:56 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler hooks/relations/etcd/peers.py:25:peer_joined 2024-09-14 07:08:56 INFO unit.etcd/1.juju-log server.go:316 cluster:0: Invoking reactive handler: hooks/relations/etcd/peers.py:25:peer_joined 2024-09-14 07:08:56 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer> tracer: main dispatch loop, 6 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-14 07:08:56 INFO unit.etcd/1.juju-log server.go:316 cluster:0: Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-14 07:08:56 INFO unit.etcd/1.juju-log server.go:316 cluster:0: Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-14 07:08:56 INFO unit.etcd/1.juju-log server.go:316 cluster:0: Invoking reactive handler: reactive/etcd.py:247:set_db_ingress_address 2024-09-14 07:08:56 INFO unit.etcd/1.juju-log server.go:316 cluster:0: Invoking reactive handler: reactive/etcd.py:488:process_snapd_timer 2024-09-14 07:08:56 INFO unit.etcd/1.juju-log server.go:316 cluster:0: Get config refresh.timer for snap core 2024-09-14 07:08:56 INFO unit.etcd/1.juju-log server.go:316 cluster:0: Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-14 07:08:56 INFO unit.etcd/1.juju-log server.go:316 cluster:0: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-14 07:08:56 INFO juju.worker.uniter.operation runhook.go:159 ran "cluster-relation-joined" hook (via explicit, bespoke hook script) 2024-09-14 07:08:56 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-joined (0; unit: etcd/2) hook" for etcd/1 2024-09-14 07:08:57 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-14 07:08:57 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/1 uniter (run relation-joined (0; unit: etcd/2) hook) 2024-09-14 07:08:57 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/1 2024-09-14 07:08:57 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-14 07:08:57 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (0; unit: etcd/2) hook for etcd/1 2024-09-14 07:08:57 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/1 uniter (run relation-changed (0; unit: etcd/2) hook) 2024-09-14 07:08:58 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for etcd/1 : {0 {map[etcd/0:{1}] map[] []}} 2024-09-14 07:09:04 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/1 uniter (run relation-changed (0; unit: etcd/2) hook) 2024-09-14 07:09:04 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (0; unit: etcd/2) hook" for etcd/1 2024-09-14 07:09:04 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (0; unit: etcd/2) hook" for etcd/1 2024-09-14 07:09:04 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running cluster-relation-changed hook for etcd/2 2024-09-14 07:09:04 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-1/agent.socket } 2024-09-14 07:09:05 INFO unit.etcd/1.juju-log server.go:316 cluster:0: Reactive main running for hook cluster-relation-changed 2024-09-14 07:09:05 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-14 07:09:05 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: set flag config.default.nagios_context 2024-09-14 07:09:05 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: set flag config.default.nagios_servicegroups 2024-09-14 07:09:05 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: set flag config.set.snapd_refresh 2024-09-14 07:09:05 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: set flag config.default.snapd_refresh 2024-09-14 07:09:05 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: set flag config.set.port 2024-09-14 07:09:05 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: set flag config.default.port 2024-09-14 07:09:05 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: set flag config.set.management_port 2024-09-14 07:09:05 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: set flag config.default.management_port 2024-09-14 07:09:05 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: set flag config.set.channel 2024-09-14 07:09:05 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: set flag config.default.channel 2024-09-14 07:09:05 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: set flag config.set.bind_to_all_interfaces 2024-09-14 07:09:05 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: set flag config.default.bind_to_all_interfaces 2024-09-14 07:09:05 INFO unit.etcd/1.juju-log server.go:316 cluster:0: Initializing Leadership Layer (is leader) 2024-09-14 07:09:05 INFO unit.etcd/1.juju-log server.go:316 cluster:0: Initializing Snap Layer 2024-09-14 07:09:05 DEBUG unit.etcd/1.cluster-relation-changed logger.go:60 none 2024-09-14 07:09:05 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer> tracer: starting handler dispatch, 32 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.client.cert.available tracer: set flag cluster.joined tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag leadership.is_leader tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set 2024-09-14 07:09:05 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: hooks phase, 0 handlers queued 2024-09-14 07:09:05 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer> tracer: main dispatch loop, 6 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-14 07:09:05 INFO unit.etcd/1.juju-log server.go:316 cluster:0: Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-14 07:09:05 INFO unit.etcd/1.juju-log server.go:316 cluster:0: Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-14 07:09:05 INFO unit.etcd/1.juju-log server.go:316 cluster:0: Invoking reactive handler: reactive/etcd.py:247:set_db_ingress_address 2024-09-14 07:09:05 INFO unit.etcd/1.juju-log server.go:316 cluster:0: Invoking reactive handler: reactive/etcd.py:488:process_snapd_timer 2024-09-14 07:09:05 INFO unit.etcd/1.juju-log server.go:316 cluster:0: Get config refresh.timer for snap core 2024-09-14 07:09:05 INFO unit.etcd/1.juju-log server.go:316 cluster:0: Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-14 07:09:05 INFO unit.etcd/1.juju-log server.go:316 cluster:0: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-14 07:09:05 INFO juju.worker.uniter.operation runhook.go:159 ran "cluster-relation-changed" hook (via explicit, bespoke hook script) 2024-09-14 07:09:06 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (0; unit: etcd/2) hook" for etcd/1 2024-09-14 07:09:06 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-14 07:09:06 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/1 uniter (run relation-changed (0; unit: etcd/2) hook) 2024-09-14 07:09:06 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/1 2024-09-14 07:09:06 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-14 07:09:06 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (10; unit: easyrsa/0) hook for etcd/1 2024-09-14 07:09:06 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/1 uniter (run relation-changed (10; unit: easyrsa/0) hook) 2024-09-14 07:09:11 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/1 uniter (run relation-changed (10; unit: easyrsa/0) hook) 2024-09-14 07:09:11 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (10; unit: easyrsa/0) hook" for etcd/1 2024-09-14 07:09:11 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (10; unit: easyrsa/0) hook" for etcd/1 2024-09-14 07:09:11 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running certificates-relation-changed hook for easyrsa/0 2024-09-14 07:09:11 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-1/agent.socket } 2024-09-14 07:09:11 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Reactive main running for hook certificates-relation-changed 2024-09-14 07:09:11 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer> tracer: set flag endpoint.certificates.changed.ca tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-14 07:09:11 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag endpoint.certificates.changed.client.cert 2024-09-14 07:09:11 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag endpoint.certificates.changed.client.key 2024-09-14 07:09:11 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.set.nagios_context 2024-09-14 07:09:11 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.default.nagios_context 2024-09-14 07:09:11 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.default.nagios_servicegroups 2024-09-14 07:09:11 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.set.snapd_refresh 2024-09-14 07:09:11 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.default.snapd_refresh 2024-09-14 07:09:11 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.set.port 2024-09-14 07:09:11 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.default.port 2024-09-14 07:09:11 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.set.management_port 2024-09-14 07:09:11 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.default.management_port 2024-09-14 07:09:11 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.set.channel 2024-09-14 07:09:11 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.default.channel 2024-09-14 07:09:11 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.set.bind_to_all_interfaces 2024-09-14 07:09:11 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.default.bind_to_all_interfaces 2024-09-14 07:09:11 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Initializing Leadership Layer (is leader) 2024-09-14 07:09:11 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Initializing Snap Layer 2024-09-14 07:09:11 DEBUG unit.etcd/1.certificates-relation-changed logger.go:60 none 2024-09-14 07:09:11 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer> tracer: starting handler dispatch, 35 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.client.cert.available tracer: set flag cluster.joined tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag leadership.is_leader tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set 2024-09-14 07:09:11 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: hooks phase, 0 handlers queued 2024-09-14 07:09:11 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer> tracer: main dispatch loop, 6 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-14 07:09:11 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-14 07:09:11 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-14 07:09:12 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/etcd.py:247:set_db_ingress_address 2024-09-14 07:09:12 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/etcd.py:488:process_snapd_timer 2024-09-14 07:09:12 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Get config refresh.timer for snap core 2024-09-14 07:09:12 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-14 07:09:12 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Writing client certificate to /var/snap/etcd/common/client.crt 2024-09-14 07:09:12 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag tls_client.client.certificate.written 2024-09-14 07:09:12 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag tls_client.client.certificate.saved 2024-09-14 07:09:12 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Writing client key to /var/snap/etcd/common/client.key 2024-09-14 07:09:12 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag tls_client.client.key.saved 2024-09-14 07:09:12 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-14 07:09:12 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer> tracer: set flag certificates.ca.available tracer: ++ queue handler reactive/tls_client.py:18:store_ca 2024-09-14 07:09:12 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag certificates.ca.changed 2024-09-14 07:09:12 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/tls_client.py:18:store_ca 2024-09-14 07:09:12 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Writing CA certificate to /var/snap/etcd/common/ca.crt 2024-09-14 07:09:12 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag tls_client.ca.written 2024-09-14 07:09:12 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag tls_client.ca.saved 2024-09-14 07:09:12 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Writing CA certificate to /usr/local/share/ca-certificates/etcd.crt 2024-09-14 07:09:12 DEBUG unit.etcd/1.certificates-relation-changed logger.go:60 Updating certificates in /etc/ssl/certs... 2024-09-14 07:09:12 WARNING unit.etcd/1.certificates-relation-changed logger.go:60 rehash: warning: skipping ca-certificates.crt,it does not contain exactly one certificate or CRL 2024-09-14 07:09:12 DEBUG unit.etcd/1.certificates-relation-changed logger.go:60 1 added, 0 removed; done. 2024-09-14 07:09:12 DEBUG unit.etcd/1.certificates-relation-changed logger.go:60 Running hooks in /etc/ca-certificates/update.d... 2024-09-14 07:09:12 DEBUG unit.etcd/1.certificates-relation-changed logger.go:60 done. 2024-09-14 07:09:12 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Generated ca-certificates.crt for etcd 2024-09-14 07:09:12 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag tls_client.ca_installed 2024-09-14 07:09:13 INFO juju.worker.uniter.operation runhook.go:159 ran "certificates-relation-changed" hook (via explicit, bespoke hook script) 2024-09-14 07:09:13 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (10; unit: easyrsa/0) hook" for etcd/1 2024-09-14 07:09:13 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-14 07:09:13 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/1 uniter (run relation-changed (10; unit: easyrsa/0) hook) 2024-09-14 07:09:13 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/1 2024-09-14 07:09:13 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-14 07:09:13 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-14 07:09:13 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/2" already joined relation 0 2024-09-14 07:09:13 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (0; unit: etcd/0) hook for etcd/1 2024-09-14 07:09:13 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/1 uniter (run relation-changed (0; unit: etcd/0) hook) 2024-09-14 07:09:18 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/1 uniter (run relation-changed (0; unit: etcd/0) hook) 2024-09-14 07:09:18 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (0; unit: etcd/0) hook" for etcd/1 2024-09-14 07:09:18 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (0; unit: etcd/0) hook" for etcd/1 2024-09-14 07:09:18 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running cluster-relation-changed hook for etcd/0 2024-09-14 07:09:18 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-1/agent.socket } 2024-09-14 07:09:18 INFO unit.etcd/1.juju-log server.go:316 cluster:0: Reactive main running for hook cluster-relation-changed 2024-09-14 07:09:18 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-14 07:09:18 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: set flag config.default.nagios_context 2024-09-14 07:09:18 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: set flag config.default.nagios_servicegroups 2024-09-14 07:09:18 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: set flag config.set.snapd_refresh 2024-09-14 07:09:18 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: set flag config.default.snapd_refresh 2024-09-14 07:09:18 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: set flag config.set.port 2024-09-14 07:09:18 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: set flag config.default.port 2024-09-14 07:09:18 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: set flag config.set.management_port 2024-09-14 07:09:19 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: set flag config.default.management_port 2024-09-14 07:09:19 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: set flag config.set.channel 2024-09-14 07:09:19 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: set flag config.default.channel 2024-09-14 07:09:19 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: set flag config.set.bind_to_all_interfaces 2024-09-14 07:09:19 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: set flag config.default.bind_to_all_interfaces 2024-09-14 07:09:19 INFO unit.etcd/1.juju-log server.go:316 cluster:0: Initializing Leadership Layer (is leader) 2024-09-14 07:09:19 INFO unit.etcd/1.juju-log server.go:316 cluster:0: Initializing Snap Layer 2024-09-14 07:09:19 DEBUG unit.etcd/1.cluster-relation-changed logger.go:60 none 2024-09-14 07:09:19 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer> tracer: starting handler dispatch, 43 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.ca.available tracer: set flag certificates.ca.changed tracer: set flag certificates.client.cert.available tracer: set flag cluster.joined tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag leadership.is_leader tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca.written tracer: set flag tls_client.ca_installed tracer: set flag tls_client.client.certificate.saved tracer: set flag tls_client.client.certificate.written tracer: set flag tls_client.client.key.saved 2024-09-14 07:09:19 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: hooks phase, 0 handlers queued 2024-09-14 07:09:19 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-14 07:09:19 INFO unit.etcd/1.juju-log server.go:316 cluster:0: Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-14 07:09:19 INFO unit.etcd/1.juju-log server.go:316 cluster:0: Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-14 07:09:19 INFO unit.etcd/1.juju-log server.go:316 cluster:0: Invoking reactive handler: reactive/etcd.py:247:set_db_ingress_address 2024-09-14 07:09:19 INFO unit.etcd/1.juju-log server.go:316 cluster:0: Invoking reactive handler: reactive/etcd.py:488:process_snapd_timer 2024-09-14 07:09:19 INFO unit.etcd/1.juju-log server.go:316 cluster:0: Get config refresh.timer for snap core 2024-09-14 07:09:19 INFO unit.etcd/1.juju-log server.go:316 cluster:0: Invoking reactive handler: reactive/tls_client.py:18:store_ca 2024-09-14 07:09:19 INFO unit.etcd/1.juju-log server.go:316 cluster:0: Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-14 07:09:19 INFO unit.etcd/1.juju-log server.go:316 cluster:0: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-14 07:09:19 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: cleared flag certificates.ca.changed 2024-09-14 07:09:19 INFO juju.worker.uniter.operation runhook.go:159 ran "cluster-relation-changed" hook (via explicit, bespoke hook script) 2024-09-14 07:09:19 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (0; unit: etcd/0) hook" for etcd/1 2024-09-14 07:09:19 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-14 07:09:19 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/1 uniter (run relation-changed (0; unit: etcd/0) hook) 2024-09-14 07:09:19 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/1 2024-09-14 07:09:19 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-14 07:09:19 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (8; unit: kubernetes-master/0) hook for etcd/1 2024-09-14 07:09:19 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/1 uniter (run relation-changed (8; unit: kubernetes-master/0) hook) 2024-09-14 07:09:22 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/1 uniter (run relation-changed (8; unit: kubernetes-master/0) hook) 2024-09-14 07:09:22 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (8; unit: kubernetes-master/0) hook" for etcd/1 2024-09-14 07:09:22 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (8; unit: kubernetes-master/0) hook" for etcd/1 2024-09-14 07:09:22 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running db-relation-changed hook for kubernetes-master/0 2024-09-14 07:09:23 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-1/agent.socket } 2024-09-14 07:09:23 INFO unit.etcd/1.juju-log server.go:316 db:8: Reactive main running for hook db-relation-changed 2024-09-14 07:09:23 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-14 07:09:23 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer: set flag config.default.nagios_context 2024-09-14 07:09:23 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer: set flag config.default.nagios_servicegroups 2024-09-14 07:09:23 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer: set flag config.set.snapd_refresh 2024-09-14 07:09:23 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer: set flag config.default.snapd_refresh 2024-09-14 07:09:23 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer: set flag config.set.port 2024-09-14 07:09:23 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer: set flag config.default.port 2024-09-14 07:09:23 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer: set flag config.set.management_port 2024-09-14 07:09:23 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer: set flag config.default.management_port 2024-09-14 07:09:23 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer: set flag config.set.channel 2024-09-14 07:09:23 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer: set flag config.default.channel 2024-09-14 07:09:23 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer: set flag config.set.bind_to_all_interfaces 2024-09-14 07:09:23 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer: set flag config.default.bind_to_all_interfaces 2024-09-14 07:09:23 INFO unit.etcd/1.juju-log server.go:316 db:8: Initializing Leadership Layer (is leader) 2024-09-14 07:09:23 INFO unit.etcd/1.juju-log server.go:316 db:8: Initializing Snap Layer 2024-09-14 07:09:23 DEBUG unit.etcd/1.db-relation-changed logger.go:60 none 2024-09-14 07:09:23 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer> tracer: starting handler dispatch, 42 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.ca.available tracer: set flag certificates.client.cert.available tracer: set flag cluster.joined tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag leadership.is_leader tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca.written tracer: set flag tls_client.ca_installed tracer: set flag tls_client.client.certificate.saved tracer: set flag tls_client.client.certificate.written tracer: set flag tls_client.client.key.saved 2024-09-14 07:09:23 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler hooks/relations/etcd/provides.py:22:joined_or_changed 2024-09-14 07:09:23 INFO unit.etcd/1.juju-log server.go:316 db:8: Invoking reactive handler: hooks/relations/etcd/provides.py:22:joined_or_changed 2024-09-14 07:09:23 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-14 07:09:23 INFO unit.etcd/1.juju-log server.go:316 db:8: Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-14 07:09:23 INFO unit.etcd/1.juju-log server.go:316 db:8: Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-14 07:09:23 INFO unit.etcd/1.juju-log server.go:316 db:8: Invoking reactive handler: reactive/etcd.py:247:set_db_ingress_address 2024-09-14 07:09:23 INFO unit.etcd/1.juju-log server.go:316 db:8: Invoking reactive handler: reactive/etcd.py:488:process_snapd_timer 2024-09-14 07:09:23 INFO unit.etcd/1.juju-log server.go:316 db:8: Get config refresh.timer for snap core 2024-09-14 07:09:23 INFO unit.etcd/1.juju-log server.go:316 db:8: Invoking reactive handler: reactive/tls_client.py:18:store_ca 2024-09-14 07:09:23 INFO unit.etcd/1.juju-log server.go:316 db:8: Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-14 07:09:23 INFO unit.etcd/1.juju-log server.go:316 db:8: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-14 07:09:24 INFO juju.worker.uniter.operation runhook.go:159 ran "db-relation-changed" hook (via explicit, bespoke hook script) 2024-09-14 07:09:24 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (8; unit: kubernetes-master/0) hook" for etcd/1 2024-09-14 07:09:24 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-14 07:09:24 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/1 uniter (run relation-changed (8; unit: kubernetes-master/0) hook) 2024-09-14 07:09:24 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/1 2024-09-14 07:09:24 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-14 07:09:24 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-14 07:09:24 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-joined (8; unit: kubernetes-master/1) hook for etcd/1 2024-09-14 07:09:24 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/1 uniter (run relation-joined (8; unit: kubernetes-master/1) hook) 2024-09-14 07:09:29 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/1 uniter (run relation-joined (8; unit: kubernetes-master/1) hook) 2024-09-14 07:09:29 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-joined (8; unit: kubernetes-master/1) hook" for etcd/1 2024-09-14 07:09:29 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-joined (8; unit: kubernetes-master/1) hook" for etcd/1 2024-09-14 07:09:29 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running db-relation-joined hook for kubernetes-master/1 2024-09-14 07:09:29 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-1/agent.socket } 2024-09-14 07:09:29 INFO unit.etcd/1.juju-log server.go:316 db:8: Reactive main running for hook db-relation-joined 2024-09-14 07:09:29 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-14 07:09:29 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer: set flag config.default.nagios_context 2024-09-14 07:09:29 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer: set flag config.default.nagios_servicegroups 2024-09-14 07:09:29 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer: set flag config.set.snapd_refresh 2024-09-14 07:09:30 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer: set flag config.default.snapd_refresh 2024-09-14 07:09:30 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer: set flag config.set.port 2024-09-14 07:09:30 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer: set flag config.default.port 2024-09-14 07:09:30 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer: set flag config.set.management_port 2024-09-14 07:09:30 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer: set flag config.default.management_port 2024-09-14 07:09:30 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer: set flag config.set.channel 2024-09-14 07:09:30 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer: set flag config.default.channel 2024-09-14 07:09:30 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer: set flag config.set.bind_to_all_interfaces 2024-09-14 07:09:30 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer: set flag config.default.bind_to_all_interfaces 2024-09-14 07:09:30 INFO unit.etcd/1.juju-log server.go:316 db:8: Initializing Leadership Layer (is leader) 2024-09-14 07:09:30 INFO unit.etcd/1.juju-log server.go:316 db:8: Initializing Snap Layer 2024-09-14 07:09:30 DEBUG unit.etcd/1.db-relation-joined logger.go:60 none 2024-09-14 07:09:30 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer> tracer: starting handler dispatch, 42 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.ca.available tracer: set flag certificates.client.cert.available tracer: set flag cluster.joined tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag leadership.is_leader tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca.written tracer: set flag tls_client.ca_installed tracer: set flag tls_client.client.certificate.saved tracer: set flag tls_client.client.certificate.written tracer: set flag tls_client.client.key.saved 2024-09-14 07:09:30 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler hooks/relations/etcd/provides.py:22:joined_or_changed 2024-09-14 07:09:30 INFO unit.etcd/1.juju-log server.go:316 db:8: Invoking reactive handler: hooks/relations/etcd/provides.py:22:joined_or_changed 2024-09-14 07:09:30 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-14 07:09:30 INFO unit.etcd/1.juju-log server.go:316 db:8: Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-14 07:09:30 INFO unit.etcd/1.juju-log server.go:316 db:8: Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-14 07:09:30 INFO unit.etcd/1.juju-log server.go:316 db:8: Invoking reactive handler: reactive/etcd.py:247:set_db_ingress_address 2024-09-14 07:09:30 INFO unit.etcd/1.juju-log server.go:316 db:8: Invoking reactive handler: reactive/etcd.py:488:process_snapd_timer 2024-09-14 07:09:30 INFO unit.etcd/1.juju-log server.go:316 db:8: Get config refresh.timer for snap core 2024-09-14 07:09:30 INFO unit.etcd/1.juju-log server.go:316 db:8: Invoking reactive handler: reactive/tls_client.py:18:store_ca 2024-09-14 07:09:30 INFO unit.etcd/1.juju-log server.go:316 db:8: Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-14 07:09:30 INFO unit.etcd/1.juju-log server.go:316 db:8: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-14 07:09:30 INFO juju.worker.uniter.operation runhook.go:159 ran "db-relation-joined" hook (via explicit, bespoke hook script) 2024-09-14 07:09:30 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-joined (8; unit: kubernetes-master/1) hook" for etcd/1 2024-09-14 07:09:30 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-14 07:09:30 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/1 uniter (run relation-joined (8; unit: kubernetes-master/1) hook) 2024-09-14 07:09:30 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/1 2024-09-14 07:09:30 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-14 07:09:30 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-14 07:09:30 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/2" already joined relation 0 2024-09-14 07:09:30 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (8; unit: kubernetes-master/1) hook for etcd/1 2024-09-14 07:09:30 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/1 uniter (run relation-changed (8; unit: kubernetes-master/1) hook) 2024-09-14 07:09:37 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/1 uniter (run relation-changed (8; unit: kubernetes-master/1) hook) 2024-09-14 07:09:37 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (8; unit: kubernetes-master/1) hook" for etcd/1 2024-09-14 07:09:37 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (8; unit: kubernetes-master/1) hook" for etcd/1 2024-09-14 07:09:37 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running db-relation-changed hook for kubernetes-master/1 2024-09-14 07:09:37 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-1/agent.socket } 2024-09-14 07:09:37 INFO unit.etcd/1.juju-log server.go:316 db:8: Reactive main running for hook db-relation-changed 2024-09-14 07:09:38 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-14 07:09:38 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer: set flag config.default.nagios_context 2024-09-14 07:09:38 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer: set flag config.default.nagios_servicegroups 2024-09-14 07:09:38 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer: set flag config.set.snapd_refresh 2024-09-14 07:09:38 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer: set flag config.default.snapd_refresh 2024-09-14 07:09:38 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer: set flag config.set.port 2024-09-14 07:09:38 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer: set flag config.default.port 2024-09-14 07:09:38 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer: set flag config.set.management_port 2024-09-14 07:09:38 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer: set flag config.default.management_port 2024-09-14 07:09:38 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer: set flag config.set.channel 2024-09-14 07:09:38 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer: set flag config.default.channel 2024-09-14 07:09:38 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer: set flag config.set.bind_to_all_interfaces 2024-09-14 07:09:38 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer: set flag config.default.bind_to_all_interfaces 2024-09-14 07:09:38 INFO unit.etcd/1.juju-log server.go:316 db:8: Initializing Leadership Layer (is leader) 2024-09-14 07:09:38 INFO unit.etcd/1.juju-log server.go:316 db:8: Initializing Snap Layer 2024-09-14 07:09:38 DEBUG unit.etcd/1.db-relation-changed logger.go:60 none 2024-09-14 07:09:38 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer> tracer: starting handler dispatch, 42 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.ca.available tracer: set flag certificates.client.cert.available tracer: set flag cluster.joined tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag leadership.is_leader tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca.written tracer: set flag tls_client.ca_installed tracer: set flag tls_client.client.certificate.saved tracer: set flag tls_client.client.certificate.written tracer: set flag tls_client.client.key.saved 2024-09-14 07:09:38 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler hooks/relations/etcd/provides.py:22:joined_or_changed 2024-09-14 07:09:38 INFO unit.etcd/1.juju-log server.go:316 db:8: Invoking reactive handler: hooks/relations/etcd/provides.py:22:joined_or_changed 2024-09-14 07:09:38 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-14 07:09:38 INFO unit.etcd/1.juju-log server.go:316 db:8: Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-14 07:09:38 INFO unit.etcd/1.juju-log server.go:316 db:8: Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-14 07:09:38 INFO unit.etcd/1.juju-log server.go:316 db:8: Invoking reactive handler: reactive/etcd.py:247:set_db_ingress_address 2024-09-14 07:09:38 INFO unit.etcd/1.juju-log server.go:316 db:8: Invoking reactive handler: reactive/etcd.py:488:process_snapd_timer 2024-09-14 07:09:38 INFO unit.etcd/1.juju-log server.go:316 db:8: Get config refresh.timer for snap core 2024-09-14 07:09:38 INFO unit.etcd/1.juju-log server.go:316 db:8: Invoking reactive handler: reactive/tls_client.py:18:store_ca 2024-09-14 07:09:38 INFO unit.etcd/1.juju-log server.go:316 db:8: Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-14 07:09:38 INFO unit.etcd/1.juju-log server.go:316 db:8: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-14 07:09:38 INFO juju.worker.uniter.operation runhook.go:159 ran "db-relation-changed" hook (via explicit, bespoke hook script) 2024-09-14 07:09:38 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (8; unit: kubernetes-master/1) hook" for etcd/1 2024-09-14 07:09:38 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-14 07:09:38 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/1 uniter (run relation-changed (8; unit: kubernetes-master/1) hook) 2024-09-14 07:09:38 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/1 2024-09-14 07:09:38 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-14 07:09:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-14 07:09:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/2" already joined relation 0 2024-09-14 07:09:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-14 07:09:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/1" already joined relation 8 2024-09-14 07:09:38 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-joined (8; unit: kubernetes-master/2) hook for etcd/1 2024-09-14 07:09:38 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/1 uniter (run relation-joined (8; unit: kubernetes-master/2) hook) 2024-09-14 07:09:46 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for etcd/1 : {0 {map[etcd/2:{1}] map[] []}} 2024-09-14 07:09:47 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/1 uniter (run relation-joined (8; unit: kubernetes-master/2) hook) 2024-09-14 07:09:47 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-joined (8; unit: kubernetes-master/2) hook" for etcd/1 2024-09-14 07:09:47 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-joined (8; unit: kubernetes-master/2) hook" for etcd/1 2024-09-14 07:09:47 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running db-relation-joined hook for kubernetes-master/2 2024-09-14 07:09:47 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-1/agent.socket } 2024-09-14 07:09:48 INFO unit.etcd/1.juju-log server.go:316 db:8: Reactive main running for hook db-relation-joined 2024-09-14 07:09:48 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-14 07:09:48 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer: set flag config.default.nagios_context 2024-09-14 07:09:48 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer: set flag config.default.nagios_servicegroups 2024-09-14 07:09:48 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer: set flag config.set.snapd_refresh 2024-09-14 07:09:48 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer: set flag config.default.snapd_refresh 2024-09-14 07:09:48 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer: set flag config.set.port 2024-09-14 07:09:48 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer: set flag config.default.port 2024-09-14 07:09:48 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer: set flag config.set.management_port 2024-09-14 07:09:48 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer: set flag config.default.management_port 2024-09-14 07:09:48 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer: set flag config.set.channel 2024-09-14 07:09:48 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer: set flag config.default.channel 2024-09-14 07:09:48 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer: set flag config.set.bind_to_all_interfaces 2024-09-14 07:09:48 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer: set flag config.default.bind_to_all_interfaces 2024-09-14 07:09:48 INFO unit.etcd/1.juju-log server.go:316 db:8: Initializing Leadership Layer (is leader) 2024-09-14 07:09:48 INFO unit.etcd/1.juju-log server.go:316 db:8: Initializing Snap Layer 2024-09-14 07:09:48 DEBUG unit.etcd/1.db-relation-joined logger.go:60 none 2024-09-14 07:09:48 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer> tracer: starting handler dispatch, 42 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.ca.available tracer: set flag certificates.client.cert.available tracer: set flag cluster.joined tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag leadership.is_leader tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca.written tracer: set flag tls_client.ca_installed tracer: set flag tls_client.client.certificate.saved tracer: set flag tls_client.client.certificate.written tracer: set flag tls_client.client.key.saved 2024-09-14 07:09:48 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler hooks/relations/etcd/provides.py:22:joined_or_changed 2024-09-14 07:09:48 INFO unit.etcd/1.juju-log server.go:316 db:8: Invoking reactive handler: hooks/relations/etcd/provides.py:22:joined_or_changed 2024-09-14 07:09:48 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-14 07:09:48 INFO unit.etcd/1.juju-log server.go:316 db:8: Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-14 07:09:48 INFO unit.etcd/1.juju-log server.go:316 db:8: Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-14 07:09:48 INFO unit.etcd/1.juju-log server.go:316 db:8: Invoking reactive handler: reactive/etcd.py:247:set_db_ingress_address 2024-09-14 07:09:48 INFO unit.etcd/1.juju-log server.go:316 db:8: Invoking reactive handler: reactive/etcd.py:488:process_snapd_timer 2024-09-14 07:09:48 INFO unit.etcd/1.juju-log server.go:316 db:8: Get config refresh.timer for snap core 2024-09-14 07:09:48 INFO unit.etcd/1.juju-log server.go:316 db:8: Invoking reactive handler: reactive/tls_client.py:18:store_ca 2024-09-14 07:09:48 INFO unit.etcd/1.juju-log server.go:316 db:8: Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-14 07:09:48 INFO unit.etcd/1.juju-log server.go:316 db:8: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-14 07:09:49 INFO juju.worker.uniter.operation runhook.go:159 ran "db-relation-joined" hook (via explicit, bespoke hook script) 2024-09-14 07:09:49 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-joined (8; unit: kubernetes-master/2) hook" for etcd/1 2024-09-14 07:09:49 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-14 07:09:49 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/1 uniter (run relation-joined (8; unit: kubernetes-master/2) hook) 2024-09-14 07:09:49 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/1 2024-09-14 07:09:49 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-14 07:09:49 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-14 07:09:49 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/2" already joined relation 0 2024-09-14 07:09:49 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (0; unit: etcd/2) hook for etcd/1 2024-09-14 07:09:49 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/1 uniter (run relation-changed (0; unit: etcd/2) hook) 2024-09-14 07:09:59 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for etcd/1 : {10 {map[easyrsa/0:{2}] map[] []}} 2024-09-14 07:09:59 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/1 uniter (run relation-changed (0; unit: etcd/2) hook) 2024-09-14 07:09:59 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (0; unit: etcd/2) hook" for etcd/1 2024-09-14 07:10:00 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (0; unit: etcd/2) hook" for etcd/1 2024-09-14 07:10:00 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running cluster-relation-changed hook for etcd/2 2024-09-14 07:10:00 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-1/agent.socket } 2024-09-14 07:10:00 INFO unit.etcd/1.juju-log server.go:316 cluster:0: Reactive main running for hook cluster-relation-changed 2024-09-14 07:10:00 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-14 07:10:00 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: set flag config.default.nagios_context 2024-09-14 07:10:00 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: set flag config.default.nagios_servicegroups 2024-09-14 07:10:00 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: set flag config.set.snapd_refresh 2024-09-14 07:10:00 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: set flag config.default.snapd_refresh 2024-09-14 07:10:00 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: set flag config.set.port 2024-09-14 07:10:00 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: set flag config.default.port 2024-09-14 07:10:00 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: set flag config.set.management_port 2024-09-14 07:10:00 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: set flag config.default.management_port 2024-09-14 07:10:00 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: set flag config.set.channel 2024-09-14 07:10:00 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: set flag config.default.channel 2024-09-14 07:10:00 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: set flag config.set.bind_to_all_interfaces 2024-09-14 07:10:00 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: set flag config.default.bind_to_all_interfaces 2024-09-14 07:10:00 INFO unit.etcd/1.juju-log server.go:316 cluster:0: Initializing Leadership Layer (is leader) 2024-09-14 07:10:00 INFO unit.etcd/1.juju-log server.go:316 cluster:0: Initializing Snap Layer 2024-09-14 07:10:00 DEBUG unit.etcd/1.cluster-relation-changed logger.go:60 none 2024-09-14 07:10:00 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer> tracer: starting handler dispatch, 42 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.ca.available tracer: set flag certificates.client.cert.available tracer: set flag cluster.joined tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag leadership.is_leader tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca.written tracer: set flag tls_client.ca_installed tracer: set flag tls_client.client.certificate.saved tracer: set flag tls_client.client.certificate.written tracer: set flag tls_client.client.key.saved 2024-09-14 07:10:00 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer: hooks phase, 0 handlers queued 2024-09-14 07:10:00 DEBUG unit.etcd/1.juju-log server.go:316 cluster:0: tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-14 07:10:00 INFO unit.etcd/1.juju-log server.go:316 cluster:0: Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-14 07:10:00 INFO unit.etcd/1.juju-log server.go:316 cluster:0: Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-14 07:10:00 INFO unit.etcd/1.juju-log server.go:316 cluster:0: Invoking reactive handler: reactive/etcd.py:247:set_db_ingress_address 2024-09-14 07:10:01 INFO unit.etcd/1.juju-log server.go:316 cluster:0: Invoking reactive handler: reactive/etcd.py:488:process_snapd_timer 2024-09-14 07:10:01 INFO unit.etcd/1.juju-log server.go:316 cluster:0: Get config refresh.timer for snap core 2024-09-14 07:10:01 INFO unit.etcd/1.juju-log server.go:316 cluster:0: Invoking reactive handler: reactive/tls_client.py:18:store_ca 2024-09-14 07:10:01 INFO unit.etcd/1.juju-log server.go:316 cluster:0: Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-14 07:10:01 INFO unit.etcd/1.juju-log server.go:316 cluster:0: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-14 07:10:01 INFO juju.worker.uniter.operation runhook.go:159 ran "cluster-relation-changed" hook (via explicit, bespoke hook script) 2024-09-14 07:10:01 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (0; unit: etcd/2) hook" for etcd/1 2024-09-14 07:10:01 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-14 07:10:01 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/1 uniter (run relation-changed (0; unit: etcd/2) hook) 2024-09-14 07:10:01 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/1 2024-09-14 07:10:01 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-14 07:10:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-14 07:10:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/2" already joined relation 0 2024-09-14 07:10:01 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (8; unit: kubernetes-master/2) hook for etcd/1 2024-09-14 07:10:01 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/1 uniter (run relation-changed (8; unit: kubernetes-master/2) hook) 2024-09-14 07:10:12 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/1 uniter (run relation-changed (8; unit: kubernetes-master/2) hook) 2024-09-14 07:10:12 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (8; unit: kubernetes-master/2) hook" for etcd/1 2024-09-14 07:10:12 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (8; unit: kubernetes-master/2) hook" for etcd/1 2024-09-14 07:10:12 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running db-relation-changed hook for kubernetes-master/2 2024-09-14 07:10:12 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-1/agent.socket } 2024-09-14 07:10:12 INFO unit.etcd/1.juju-log server.go:316 db:8: Reactive main running for hook db-relation-changed 2024-09-14 07:10:12 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-14 07:10:12 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer: set flag config.default.nagios_context 2024-09-14 07:10:12 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer: set flag config.default.nagios_servicegroups 2024-09-14 07:10:12 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer: set flag config.set.snapd_refresh 2024-09-14 07:10:12 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer: set flag config.default.snapd_refresh 2024-09-14 07:10:12 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer: set flag config.set.port 2024-09-14 07:10:12 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer: set flag config.default.port 2024-09-14 07:10:12 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer: set flag config.set.management_port 2024-09-14 07:10:13 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer: set flag config.default.management_port 2024-09-14 07:10:13 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer: set flag config.set.channel 2024-09-14 07:10:13 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer: set flag config.default.channel 2024-09-14 07:10:13 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer: set flag config.set.bind_to_all_interfaces 2024-09-14 07:10:13 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer: set flag config.default.bind_to_all_interfaces 2024-09-14 07:10:13 INFO unit.etcd/1.juju-log server.go:316 db:8: Initializing Leadership Layer (is leader) 2024-09-14 07:10:13 INFO unit.etcd/1.juju-log server.go:316 db:8: Initializing Snap Layer 2024-09-14 07:10:13 DEBUG unit.etcd/1.db-relation-changed logger.go:60 none 2024-09-14 07:10:13 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer> tracer: starting handler dispatch, 42 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.ca.available tracer: set flag certificates.client.cert.available tracer: set flag cluster.joined tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag leadership.is_leader tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca.written tracer: set flag tls_client.ca_installed tracer: set flag tls_client.client.certificate.saved tracer: set flag tls_client.client.certificate.written tracer: set flag tls_client.client.key.saved 2024-09-14 07:10:13 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler hooks/relations/etcd/provides.py:22:joined_or_changed 2024-09-14 07:10:13 INFO unit.etcd/1.juju-log server.go:316 db:8: Invoking reactive handler: hooks/relations/etcd/provides.py:22:joined_or_changed 2024-09-14 07:10:13 DEBUG unit.etcd/1.juju-log server.go:316 db:8: tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-14 07:10:13 INFO unit.etcd/1.juju-log server.go:316 db:8: Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-14 07:10:13 INFO unit.etcd/1.juju-log server.go:316 db:8: Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-14 07:10:13 INFO unit.etcd/1.juju-log server.go:316 db:8: Invoking reactive handler: reactive/etcd.py:247:set_db_ingress_address 2024-09-14 07:10:13 INFO unit.etcd/1.juju-log server.go:316 db:8: Invoking reactive handler: reactive/etcd.py:488:process_snapd_timer 2024-09-14 07:10:13 INFO unit.etcd/1.juju-log server.go:316 db:8: Get config refresh.timer for snap core 2024-09-14 07:10:13 INFO unit.etcd/1.juju-log server.go:316 db:8: Invoking reactive handler: reactive/tls_client.py:18:store_ca 2024-09-14 07:10:13 INFO unit.etcd/1.juju-log server.go:316 db:8: Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-14 07:10:13 INFO unit.etcd/1.juju-log server.go:316 db:8: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-14 07:10:13 INFO juju.worker.uniter.operation runhook.go:159 ran "db-relation-changed" hook (via explicit, bespoke hook script) 2024-09-14 07:10:13 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (8; unit: kubernetes-master/2) hook" for etcd/1 2024-09-14 07:10:13 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-14 07:10:13 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/1 uniter (run relation-changed (8; unit: kubernetes-master/2) hook) 2024-09-14 07:10:13 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/1 2024-09-14 07:10:13 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-14 07:10:13 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-14 07:10:13 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/2" already joined relation 0 2024-09-14 07:10:13 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-14 07:10:13 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/1" already joined relation 8 2024-09-14 07:10:13 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 8 2024-09-14 07:10:13 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-14 07:10:13 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (10; unit: easyrsa/0) hook for etcd/1 2024-09-14 07:10:13 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/1 uniter (run relation-changed (10; unit: easyrsa/0) hook) 2024-09-14 07:10:21 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/1 uniter (run relation-changed (10; unit: easyrsa/0) hook) 2024-09-14 07:10:21 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (10; unit: easyrsa/0) hook" for etcd/1 2024-09-14 07:10:21 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (10; unit: easyrsa/0) hook" for etcd/1 2024-09-14 07:10:21 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running certificates-relation-changed hook for easyrsa/0 2024-09-14 07:10:21 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-1/agent.socket } 2024-09-14 07:10:21 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Reactive main running for hook certificates-relation-changed 2024-09-14 07:10:21 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer> tracer: set flag endpoint.certificates.changed.etcd_0.server.cert tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-14 07:10:21 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag endpoint.certificates.changed.etcd_0.server.key 2024-09-14 07:10:21 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.set.nagios_context 2024-09-14 07:10:21 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.default.nagios_context 2024-09-14 07:10:21 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.default.nagios_servicegroups 2024-09-14 07:10:21 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.set.snapd_refresh 2024-09-14 07:10:21 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.default.snapd_refresh 2024-09-14 07:10:21 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.set.port 2024-09-14 07:10:21 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.default.port 2024-09-14 07:10:21 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.set.management_port 2024-09-14 07:10:21 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.default.management_port 2024-09-14 07:10:21 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.set.channel 2024-09-14 07:10:21 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.default.channel 2024-09-14 07:10:21 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.set.bind_to_all_interfaces 2024-09-14 07:10:21 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.default.bind_to_all_interfaces 2024-09-14 07:10:21 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Initializing Leadership Layer (is leader) 2024-09-14 07:10:21 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Initializing Snap Layer 2024-09-14 07:10:21 DEBUG unit.etcd/1.certificates-relation-changed logger.go:60 none 2024-09-14 07:10:21 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer> tracer: starting handler dispatch, 44 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.ca.available tracer: set flag certificates.client.cert.available tracer: set flag cluster.joined tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.etcd_0.server.cert tracer: set flag endpoint.certificates.changed.etcd_0.server.key tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag leadership.is_leader tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca.written tracer: set flag tls_client.ca_installed tracer: set flag tls_client.client.certificate.saved tracer: set flag tls_client.client.certificate.written tracer: set flag tls_client.client.key.saved 2024-09-14 07:10:21 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: hooks phase, 0 handlers queued 2024-09-14 07:10:21 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-14 07:10:21 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-14 07:10:21 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-14 07:10:22 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/etcd.py:247:set_db_ingress_address 2024-09-14 07:10:22 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/etcd.py:488:process_snapd_timer 2024-09-14 07:10:22 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Get config refresh.timer for snap core 2024-09-14 07:10:22 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/tls_client.py:18:store_ca 2024-09-14 07:10:22 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-14 07:10:22 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-14 07:10:22 INFO juju.worker.uniter.operation runhook.go:159 ran "certificates-relation-changed" hook (via explicit, bespoke hook script) 2024-09-14 07:10:22 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (10; unit: easyrsa/0) hook" for etcd/1 2024-09-14 07:10:22 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-14 07:10:22 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/1 uniter (run relation-changed (10; unit: easyrsa/0) hook) 2024-09-14 07:10:22 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/1 2024-09-14 07:10:22 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-14 07:10:22 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-14 07:10:22 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/2" already joined relation 0 2024-09-14 07:10:22 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-14 07:10:22 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/1" already joined relation 8 2024-09-14 07:10:22 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 8 2024-09-14 07:10:22 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-14 07:10:22 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 2024-09-14 07:10:22 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-14 07:10:22 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-14 07:10:22 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/2" already joined relation 0 2024-09-14 07:10:22 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-14 07:10:22 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/1" already joined relation 8 2024-09-14 07:10:22 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 8 2024-09-14 07:10:22 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-14 07:10:25 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for etcd/1 : {10 {map[easyrsa/0:{3}] map[] []}} 2024-09-14 07:10:25 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-14 07:10:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-14 07:10:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/1" already joined relation 8 2024-09-14 07:10:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 8 2024-09-14 07:10:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-14 07:10:25 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (10; unit: easyrsa/0) hook for etcd/1 2024-09-14 07:10:25 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/1 uniter (run relation-changed (10; unit: easyrsa/0) hook) 2024-09-14 07:10:29 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/1 uniter (run relation-changed (10; unit: easyrsa/0) hook) 2024-09-14 07:10:29 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (10; unit: easyrsa/0) hook" for etcd/1 2024-09-14 07:10:29 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (10; unit: easyrsa/0) hook" for etcd/1 2024-09-14 07:10:29 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running certificates-relation-changed hook for easyrsa/0 2024-09-14 07:10:29 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-1/agent.socket } 2024-09-14 07:10:30 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Reactive main running for hook certificates-relation-changed 2024-09-14 07:10:30 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer> tracer: set flag endpoint.certificates.changed.etcd_1.server.cert tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-14 07:10:30 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag endpoint.certificates.changed.etcd_1.server.key 2024-09-14 07:10:30 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.set.nagios_context 2024-09-14 07:10:30 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.default.nagios_context 2024-09-14 07:10:30 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.default.nagios_servicegroups 2024-09-14 07:10:30 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.set.snapd_refresh 2024-09-14 07:10:30 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.default.snapd_refresh 2024-09-14 07:10:30 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.set.port 2024-09-14 07:10:30 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.default.port 2024-09-14 07:10:30 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.set.management_port 2024-09-14 07:10:30 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.default.management_port 2024-09-14 07:10:30 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.set.channel 2024-09-14 07:10:30 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.default.channel 2024-09-14 07:10:30 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.set.bind_to_all_interfaces 2024-09-14 07:10:30 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.default.bind_to_all_interfaces 2024-09-14 07:10:30 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Initializing Leadership Layer (is leader) 2024-09-14 07:10:30 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Initializing Snap Layer 2024-09-14 07:10:30 DEBUG unit.etcd/1.certificates-relation-changed logger.go:60 none 2024-09-14 07:10:30 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer> tracer: starting handler dispatch, 46 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.ca.available tracer: set flag certificates.client.cert.available tracer: set flag cluster.joined tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.etcd_0.server.cert tracer: set flag endpoint.certificates.changed.etcd_0.server.key tracer: set flag endpoint.certificates.changed.etcd_1.server.cert tracer: set flag endpoint.certificates.changed.etcd_1.server.key tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag leadership.is_leader tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca.written tracer: set flag tls_client.ca_installed tracer: set flag tls_client.client.certificate.saved tracer: set flag tls_client.client.certificate.written tracer: set flag tls_client.client.key.saved 2024-09-14 07:10:30 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: hooks phase, 0 handlers queued 2024-09-14 07:10:30 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-14 07:10:30 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-14 07:10:30 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-14 07:10:30 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/etcd.py:247:set_db_ingress_address 2024-09-14 07:10:30 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/etcd.py:488:process_snapd_timer 2024-09-14 07:10:30 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Get config refresh.timer for snap core 2024-09-14 07:10:30 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/tls_client.py:18:store_ca 2024-09-14 07:10:30 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-14 07:10:30 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-14 07:10:30 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag certificates.server.certs.available 2024-09-14 07:10:30 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag certificates.server.certs.changed 2024-09-14 07:10:30 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag certificates.certs.available 2024-09-14 07:10:30 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer> tracer: set flag certificates.certs.changed tracer: ++ queue handler reactive/tls_client.py:98:update_certs 2024-09-14 07:10:30 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer> tracer: set flag certificates.server.cert.available tracer: ++ queue handler reactive/tls_client.py:44:store_server 2024-09-14 07:10:30 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag certificates.batch.cert.available 2024-09-14 07:10:30 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/tls_client.py:44:store_server 2024-09-14 07:10:30 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Writing server certificate to /var/snap/etcd/common/server.crt 2024-09-14 07:10:30 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag tls_client.server.certificate.written 2024-09-14 07:10:30 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag tls_client.server.certificate.saved 2024-09-14 07:10:30 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Writing server key to /var/snap/etcd/common/server.key 2024-09-14 07:10:30 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag tls_client.server.key.saved 2024-09-14 07:10:30 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/tls_client.py:98:update_certs 2024-09-14 07:10:30 WARNING unit.etcd/1.juju-log server.go:316 certificates:10: No client certs found using maps. Checking for global client certificates. 2024-09-14 07:10:30 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag tls_client.certs.saved 2024-09-14 07:10:30 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer> tracer: cleared flag certificates.certs.changed tracer: -- dequeue handler reactive/tls_client.py:98:update_certs 2024-09-14 07:10:30 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/etcd.py:530:tls_state_control 2024-09-14 07:10:30 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer> tracer: set flag etcd.ssl.placed tracer: ++ queue handler reactive/etcd.py:549:tls_update tracer: -- dequeue handler reactive/etcd.py:530:tls_state_control 2024-09-14 07:10:30 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/etcd.py:254:send_cluster_connection_details 2024-09-14 07:10:31 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/etcd.py:445:initialize_new_leader 2024-09-14 07:10:31 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: Writing file /var/snap/etcd/common/etcd.conf.yml root:root 444 2024-09-14 07:10:33 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag etcd.registered 2024-09-14 07:10:33 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer> tracer: set flag etcd.leader.configured tracer: -- dequeue handler reactive/etcd.py:445:initialize_new_leader 2024-09-14 07:10:33 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/etcd.py:549:tls_update 2024-09-14 07:10:33 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: Changing permissions on existing content: 33060 -> 292 2024-09-14 07:10:33 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer> tracer: cleared flag etcd.ssl.placed tracer: ++ queue handler reactive/etcd.py:530:tls_state_control tracer: -- dequeue handler reactive/etcd.py:254:send_cluster_connection_details tracer: -- dequeue handler reactive/etcd.py:549:tls_update 2024-09-14 07:10:33 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: cleared flag tls_client.ca.written 2024-09-14 07:10:33 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for etcd/1: ok=true 2024-09-14 07:10:33 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: cleared flag tls_client.server.certificate.written 2024-09-14 07:10:33 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: cleared flag tls_client.client.certificate.written 2024-09-14 07:10:33 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/etcd.py:95:check_cluster_health 2024-09-14 07:10:35 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/etcd.py:530:tls_state_control 2024-09-14 07:10:35 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer> tracer: set flag etcd.ssl.placed tracer: ++ queue handler reactive/etcd.py:254:send_cluster_connection_details tracer: -- dequeue handler reactive/etcd.py:530:tls_state_control 2024-09-14 07:10:35 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/etcd.py:254:send_cluster_connection_details 2024-09-14 07:10:35 INFO unit.etcd/1.juju-log server.go:316 certificates:10: status-set: active: Healthy with 1 known peer 2024-09-14 07:10:36 INFO juju.worker.uniter.operation runhook.go:159 ran "certificates-relation-changed" hook (via explicit, bespoke hook script) 2024-09-14 07:10:36 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (10; unit: easyrsa/0) hook" for etcd/1 2024-09-14 07:10:36 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-14 07:10:36 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/1 uniter (run relation-changed (10; unit: easyrsa/0) hook) 2024-09-14 07:10:36 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/1 2024-09-14 07:10:36 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-14 07:10:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-14 07:10:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/2" already joined relation 0 2024-09-14 07:10:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-14 07:10:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/1" already joined relation 8 2024-09-14 07:10:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 8 2024-09-14 07:10:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-14 07:10:36 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 2024-09-14 07:10:36 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-14 07:10:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-14 07:10:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/1" already joined relation 8 2024-09-14 07:10:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 8 2024-09-14 07:10:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-14 07:10:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-14 07:10:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/2" already joined relation 0 2024-09-14 07:12:14 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for etcd/1 : {10 {map[easyrsa/0:{4}] map[] []}} 2024-09-14 07:12:14 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-14 07:12:14 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-14 07:12:14 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/2" already joined relation 0 2024-09-14 07:12:14 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-14 07:12:14 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/1" already joined relation 8 2024-09-14 07:12:14 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 8 2024-09-14 07:12:14 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-14 07:12:14 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (10; unit: easyrsa/0) hook for etcd/1 2024-09-14 07:12:14 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/1 uniter (run relation-changed (10; unit: easyrsa/0) hook) 2024-09-14 07:12:16 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/1 uniter (run relation-changed (10; unit: easyrsa/0) hook) 2024-09-14 07:12:16 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (10; unit: easyrsa/0) hook" for etcd/1 2024-09-14 07:12:16 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (10; unit: easyrsa/0) hook" for etcd/1 2024-09-14 07:12:16 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running certificates-relation-changed hook for easyrsa/0 2024-09-14 07:12:16 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-1/agent.socket } 2024-09-14 07:12:16 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Reactive main running for hook certificates-relation-changed 2024-09-14 07:12:16 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer> tracer: set flag endpoint.certificates.changed.etcd_2.server.cert tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:254:send_cluster_connection_details tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-14 07:12:16 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag endpoint.certificates.changed.etcd_2.server.key 2024-09-14 07:12:16 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.set.nagios_context 2024-09-14 07:12:16 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.default.nagios_context 2024-09-14 07:12:16 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.default.nagios_servicegroups 2024-09-14 07:12:16 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.set.snapd_refresh 2024-09-14 07:12:16 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.default.snapd_refresh 2024-09-14 07:12:16 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.set.port 2024-09-14 07:12:16 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.default.port 2024-09-14 07:12:16 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.set.management_port 2024-09-14 07:12:16 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.default.management_port 2024-09-14 07:12:16 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.set.channel 2024-09-14 07:12:16 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.default.channel 2024-09-14 07:12:16 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.set.bind_to_all_interfaces 2024-09-14 07:12:16 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.default.bind_to_all_interfaces 2024-09-14 07:12:16 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Initializing Leadership Layer (is leader) 2024-09-14 07:12:17 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag leadership.changed.cluster 2024-09-14 07:12:17 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag leadership.set.cluster 2024-09-14 07:12:17 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag leadership.changed.leader_address 2024-09-14 07:12:17 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag leadership.set.leader_address 2024-09-14 07:12:17 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag leadership.changed 2024-09-14 07:12:17 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Initializing Snap Layer 2024-09-14 07:12:17 DEBUG unit.etcd/1.certificates-relation-changed logger.go:60 none 2024-09-14 07:12:17 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer> tracer: starting handler dispatch, 62 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.batch.cert.available tracer: set flag certificates.ca.available tracer: set flag certificates.certs.available tracer: set flag certificates.client.cert.available tracer: set flag certificates.server.cert.available tracer: set flag certificates.server.certs.available tracer: set flag certificates.server.certs.changed tracer: set flag cluster.joined tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.etcd_0.server.cert tracer: set flag endpoint.certificates.changed.etcd_0.server.key tracer: set flag endpoint.certificates.changed.etcd_1.server.cert tracer: set flag endpoint.certificates.changed.etcd_1.server.key tracer: set flag endpoint.certificates.changed.etcd_2.server.cert tracer: set flag endpoint.certificates.changed.etcd_2.server.key tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.leader.configured tracer: set flag etcd.registered tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag etcd.ssl.placed tracer: set flag leadership.changed tracer: set flag leadership.changed.cluster tracer: set flag leadership.changed.leader_address tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster tracer: set flag leadership.set.leader_address tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca_installed tracer: set flag tls_client.certs.saved tracer: set flag tls_client.client.certificate.saved tracer: set flag tls_client.client.key.saved tracer: set flag tls_client.server.certificate.saved tracer: set flag tls_client.server.key.saved 2024-09-14 07:12:17 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: hooks phase, 0 handlers queued 2024-09-14 07:12:17 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer> tracer: main dispatch loop, 10 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:254:send_cluster_connection_details tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-14 07:12:17 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/etcd.py:95:check_cluster_health 2024-09-14 07:12:17 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-14 07:12:17 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-14 07:12:17 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/etcd.py:247:set_db_ingress_address 2024-09-14 07:12:17 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/etcd.py:254:send_cluster_connection_details 2024-09-14 07:12:17 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/etcd.py:488:process_snapd_timer 2024-09-14 07:12:17 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Get config refresh.timer for snap core 2024-09-14 07:12:17 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/tls_client.py:18:store_ca 2024-09-14 07:12:17 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/tls_client.py:44:store_server 2024-09-14 07:12:17 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-14 07:12:17 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-14 07:12:17 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: cleared flag certificates.server.certs.changed 2024-09-14 07:12:17 INFO unit.etcd/1.juju-log server.go:316 certificates:10: status-set: active: Healthy with 2 known peers 2024-09-14 07:12:18 INFO juju.worker.uniter.operation runhook.go:159 ran "certificates-relation-changed" hook (via explicit, bespoke hook script) 2024-09-14 07:12:18 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (10; unit: easyrsa/0) hook" for etcd/1 2024-09-14 07:12:18 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-14 07:12:18 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/1 uniter (run relation-changed (10; unit: easyrsa/0) hook) 2024-09-14 07:12:18 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/1 2024-09-14 07:12:18 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-14 07:12:18 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-14 07:12:18 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/1" already joined relation 8 2024-09-14 07:12:18 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 8 2024-09-14 07:12:18 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-14 07:12:18 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-14 07:12:18 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/2" already joined relation 0 2024-09-14 07:12:18 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 2024-09-14 07:12:21 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for etcd/1 2024-09-14 07:12:21 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-14 07:12:21 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-14 07:12:21 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-14 07:12:21 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/2" already joined relation 0 2024-09-14 07:12:21 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-14 07:12:21 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/1" already joined relation 8 2024-09-14 07:12:21 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 8 2024-09-14 07:12:21 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for etcd/1 2024-09-14 07:12:21 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/1 uniter (run update-status hook) 2024-09-14 07:12:27 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/1 uniter (run update-status hook) 2024-09-14 07:12:27 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for etcd/1 2024-09-14 07:12:27 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for etcd/1 2024-09-14 07:12:27 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-1/agent.socket } 2024-09-14 07:12:27 INFO unit.etcd/1.juju-log server.go:316 Reactive main running for hook update-status 2024-09-14 07:12:27 DEBUG unit.etcd/1.juju-log server.go:316 tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:254:send_cluster_connection_details tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-14 07:12:27 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.nagios_context 2024-09-14 07:12:27 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2024-09-14 07:12:27 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.snapd_refresh 2024-09-14 07:12:27 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.snapd_refresh 2024-09-14 07:12:27 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.port 2024-09-14 07:12:27 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.port 2024-09-14 07:12:27 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.management_port 2024-09-14 07:12:27 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.management_port 2024-09-14 07:12:27 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.channel 2024-09-14 07:12:27 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.channel 2024-09-14 07:12:27 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.bind_to_all_interfaces 2024-09-14 07:12:27 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.bind_to_all_interfaces 2024-09-14 07:12:27 INFO unit.etcd/1.juju-log server.go:316 Initializing Leadership Layer (is leader) 2024-09-14 07:12:27 DEBUG unit.etcd/1.juju-log server.go:316 tracer: cleared flag leadership.changed.cluster 2024-09-14 07:12:27 DEBUG unit.etcd/1.juju-log server.go:316 tracer: cleared flag leadership.changed.leader_address 2024-09-14 07:12:27 DEBUG unit.etcd/1.juju-log server.go:316 tracer: cleared flag leadership.changed 2024-09-14 07:12:27 INFO unit.etcd/1.juju-log server.go:316 Initializing Snap Layer 2024-09-14 07:12:28 DEBUG unit.etcd/1.update-status logger.go:60 none 2024-09-14 07:12:28 DEBUG unit.etcd/1.juju-log server.go:316 tracer> tracer: starting handler dispatch, 58 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.batch.cert.available tracer: set flag certificates.ca.available tracer: set flag certificates.certs.available tracer: set flag certificates.client.cert.available tracer: set flag certificates.server.cert.available tracer: set flag certificates.server.certs.available tracer: set flag cluster.joined tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.etcd_0.server.cert tracer: set flag endpoint.certificates.changed.etcd_0.server.key tracer: set flag endpoint.certificates.changed.etcd_1.server.cert tracer: set flag endpoint.certificates.changed.etcd_1.server.key tracer: set flag endpoint.certificates.changed.etcd_2.server.cert tracer: set flag endpoint.certificates.changed.etcd_2.server.key tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.leader.configured tracer: set flag etcd.registered tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag etcd.ssl.placed tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster tracer: set flag leadership.set.leader_address tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca_installed tracer: set flag tls_client.certs.saved tracer: set flag tls_client.client.certificate.saved tracer: set flag tls_client.client.key.saved tracer: set flag tls_client.server.certificate.saved tracer: set flag tls_client.server.key.saved 2024-09-14 07:12:28 DEBUG unit.etcd/1.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-09-14 07:12:28 DEBUG unit.etcd/1.juju-log server.go:316 tracer> tracer: main dispatch loop, 10 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:254:send_cluster_connection_details tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-14 07:12:28 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:95:check_cluster_health 2024-09-14 07:12:28 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-14 07:12:28 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-14 07:12:28 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:247:set_db_ingress_address 2024-09-14 07:12:28 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:254:send_cluster_connection_details 2024-09-14 07:12:28 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:488:process_snapd_timer 2024-09-14 07:12:28 INFO unit.etcd/1.juju-log server.go:316 Get config refresh.timer for snap core 2024-09-14 07:12:28 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:18:store_ca 2024-09-14 07:12:28 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:44:store_server 2024-09-14 07:12:28 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-14 07:12:28 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-14 07:12:28 INFO unit.etcd/1.juju-log server.go:316 status-set: active: Healthy with 3 known peers 2024-09-14 07:12:29 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-09-14 07:12:29 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for etcd/1 2024-09-14 07:12:29 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-14 07:12:29 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/1 uniter (run update-status hook) 2024-09-14 07:12:29 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/1 2024-09-14 07:12:29 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-14 07:12:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-14 07:12:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-14 07:12:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/2" already joined relation 0 2024-09-14 07:12:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-14 07:12:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/1" already joined relation 8 2024-09-14 07:12:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 8 2024-09-14 07:12:36 DEBUG juju.worker.meterstatus connected.go:93 got meter status change signal from watcher 2024-09-14 07:12:49 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for etcd/1 : {10 {map[easyrsa/0:{5}] map[] []}} 2024-09-14 07:12:49 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-14 07:12:49 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-14 07:12:49 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (10; unit: easyrsa/0) hook for etcd/1 2024-09-14 07:12:49 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/1 uniter (run relation-changed (10; unit: easyrsa/0) hook) 2024-09-14 07:12:50 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/1 uniter (run relation-changed (10; unit: easyrsa/0) hook) 2024-09-14 07:12:50 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (10; unit: easyrsa/0) hook" for etcd/1 2024-09-14 07:12:50 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (10; unit: easyrsa/0) hook" for etcd/1 2024-09-14 07:12:50 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running certificates-relation-changed hook for easyrsa/0 2024-09-14 07:12:50 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-1/agent.socket } 2024-09-14 07:12:51 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Reactive main running for hook certificates-relation-changed 2024-09-14 07:12:51 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:254:send_cluster_connection_details tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-14 07:12:51 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.default.nagios_context 2024-09-14 07:12:51 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.default.nagios_servicegroups 2024-09-14 07:12:51 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.set.snapd_refresh 2024-09-14 07:12:51 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.default.snapd_refresh 2024-09-14 07:12:51 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.set.port 2024-09-14 07:12:51 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.default.port 2024-09-14 07:12:51 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.set.management_port 2024-09-14 07:12:51 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.default.management_port 2024-09-14 07:12:51 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.set.channel 2024-09-14 07:12:51 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.default.channel 2024-09-14 07:12:51 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.set.bind_to_all_interfaces 2024-09-14 07:12:51 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: set flag config.default.bind_to_all_interfaces 2024-09-14 07:12:51 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Initializing Leadership Layer (is leader) 2024-09-14 07:12:51 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Initializing Snap Layer 2024-09-14 07:12:51 DEBUG unit.etcd/1.certificates-relation-changed logger.go:60 none 2024-09-14 07:12:51 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer> tracer: starting handler dispatch, 58 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.batch.cert.available tracer: set flag certificates.ca.available tracer: set flag certificates.certs.available tracer: set flag certificates.client.cert.available tracer: set flag certificates.server.cert.available tracer: set flag certificates.server.certs.available tracer: set flag cluster.joined tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.etcd_0.server.cert tracer: set flag endpoint.certificates.changed.etcd_0.server.key tracer: set flag endpoint.certificates.changed.etcd_1.server.cert tracer: set flag endpoint.certificates.changed.etcd_1.server.key tracer: set flag endpoint.certificates.changed.etcd_2.server.cert tracer: set flag endpoint.certificates.changed.etcd_2.server.key tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.leader.configured tracer: set flag etcd.registered tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag etcd.ssl.placed tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster tracer: set flag leadership.set.leader_address tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca_installed tracer: set flag tls_client.certs.saved tracer: set flag tls_client.client.certificate.saved tracer: set flag tls_client.client.key.saved tracer: set flag tls_client.server.certificate.saved tracer: set flag tls_client.server.key.saved 2024-09-14 07:12:51 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer: hooks phase, 0 handlers queued 2024-09-14 07:12:51 DEBUG unit.etcd/1.juju-log server.go:316 certificates:10: tracer> tracer: main dispatch loop, 10 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:254:send_cluster_connection_details tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-14 07:12:51 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/etcd.py:95:check_cluster_health 2024-09-14 07:12:51 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-14 07:12:51 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-14 07:12:51 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/etcd.py:247:set_db_ingress_address 2024-09-14 07:12:51 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/etcd.py:254:send_cluster_connection_details 2024-09-14 07:12:52 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/etcd.py:488:process_snapd_timer 2024-09-14 07:12:52 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Get config refresh.timer for snap core 2024-09-14 07:12:52 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/tls_client.py:18:store_ca 2024-09-14 07:12:52 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/tls_client.py:44:store_server 2024-09-14 07:12:52 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-14 07:12:52 INFO unit.etcd/1.juju-log server.go:316 certificates:10: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-14 07:12:52 INFO unit.etcd/1.juju-log server.go:316 certificates:10: status-set: active: Healthy with 3 known peers 2024-09-14 07:12:52 INFO juju.worker.uniter.operation runhook.go:159 ran "certificates-relation-changed" hook (via explicit, bespoke hook script) 2024-09-14 07:12:52 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (10; unit: easyrsa/0) hook" for etcd/1 2024-09-14 07:12:52 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-14 07:12:52 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/1 uniter (run relation-changed (10; unit: easyrsa/0) hook) 2024-09-14 07:12:52 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/1 2024-09-14 07:12:52 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-14 07:12:52 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-14 07:12:52 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/2" already joined relation 0 2024-09-14 07:12:52 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-14 07:12:52 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/1" already joined relation 8 2024-09-14 07:12:52 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 8 2024-09-14 07:12:52 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-14 07:12:52 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 2024-09-14 07:17:09 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for etcd/1 2024-09-14 07:17:09 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-14 07:17:09 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-14 07:17:09 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-14 07:17:09 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/2" already joined relation 0 2024-09-14 07:17:09 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-14 07:17:09 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/1" already joined relation 8 2024-09-14 07:17:09 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 8 2024-09-14 07:17:09 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for etcd/1 2024-09-14 07:17:09 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/1 uniter (run update-status hook) 2024-09-14 07:17:09 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/1 uniter (run update-status hook) 2024-09-14 07:17:09 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for etcd/1 2024-09-14 07:17:09 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for etcd/1 2024-09-14 07:17:09 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-1/agent.socket } 2024-09-14 07:17:10 INFO unit.etcd/1.juju-log server.go:316 Reactive main running for hook update-status 2024-09-14 07:17:10 DEBUG unit.etcd/1.juju-log server.go:316 tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:254:send_cluster_connection_details tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-14 07:17:10 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.nagios_context 2024-09-14 07:17:10 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2024-09-14 07:17:10 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.snapd_refresh 2024-09-14 07:17:10 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.snapd_refresh 2024-09-14 07:17:10 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.port 2024-09-14 07:17:10 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.port 2024-09-14 07:17:10 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.management_port 2024-09-14 07:17:10 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.management_port 2024-09-14 07:17:10 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.channel 2024-09-14 07:17:10 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.channel 2024-09-14 07:17:10 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.bind_to_all_interfaces 2024-09-14 07:17:10 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.bind_to_all_interfaces 2024-09-14 07:17:10 INFO unit.etcd/1.juju-log server.go:316 Initializing Leadership Layer (is leader) 2024-09-14 07:17:10 INFO unit.etcd/1.juju-log server.go:316 Initializing Snap Layer 2024-09-14 07:17:10 DEBUG unit.etcd/1.update-status logger.go:60 none 2024-09-14 07:17:10 DEBUG unit.etcd/1.juju-log server.go:316 tracer> tracer: starting handler dispatch, 58 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.batch.cert.available tracer: set flag certificates.ca.available tracer: set flag certificates.certs.available tracer: set flag certificates.client.cert.available tracer: set flag certificates.server.cert.available tracer: set flag certificates.server.certs.available tracer: set flag cluster.joined tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.etcd_0.server.cert tracer: set flag endpoint.certificates.changed.etcd_0.server.key tracer: set flag endpoint.certificates.changed.etcd_1.server.cert tracer: set flag endpoint.certificates.changed.etcd_1.server.key tracer: set flag endpoint.certificates.changed.etcd_2.server.cert tracer: set flag endpoint.certificates.changed.etcd_2.server.key tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.leader.configured tracer: set flag etcd.registered tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag etcd.ssl.placed tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster tracer: set flag leadership.set.leader_address tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca_installed tracer: set flag tls_client.certs.saved tracer: set flag tls_client.client.certificate.saved tracer: set flag tls_client.client.key.saved tracer: set flag tls_client.server.certificate.saved tracer: set flag tls_client.server.key.saved 2024-09-14 07:17:10 DEBUG unit.etcd/1.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-09-14 07:17:10 DEBUG unit.etcd/1.juju-log server.go:316 tracer> tracer: main dispatch loop, 10 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:254:send_cluster_connection_details tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-14 07:17:10 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:95:check_cluster_health 2024-09-14 07:17:11 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-14 07:17:11 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-14 07:17:11 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:247:set_db_ingress_address 2024-09-14 07:17:11 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:254:send_cluster_connection_details 2024-09-14 07:17:11 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:488:process_snapd_timer 2024-09-14 07:17:11 INFO unit.etcd/1.juju-log server.go:316 Get config refresh.timer for snap core 2024-09-14 07:17:11 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:18:store_ca 2024-09-14 07:17:11 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:44:store_server 2024-09-14 07:17:11 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-14 07:17:11 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-14 07:17:11 INFO unit.etcd/1.juju-log server.go:316 status-set: active: Healthy with 3 known peers 2024-09-14 07:17:12 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-09-14 07:17:12 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for etcd/1 2024-09-14 07:17:12 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-14 07:17:12 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/1 uniter (run update-status hook) 2024-09-14 07:17:12 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/1 2024-09-14 07:17:12 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-14 07:17:12 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-14 07:17:12 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-14 07:17:12 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/2" already joined relation 0 2024-09-14 07:17:12 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-14 07:17:12 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/1" already joined relation 8 2024-09-14 07:17:12 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 8 2024-09-14 07:22:18 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for etcd/1 2024-09-14 07:22:18 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-14 07:22:18 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-14 07:22:18 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/1" already joined relation 8 2024-09-14 07:22:18 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 8 2024-09-14 07:22:18 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-14 07:22:18 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-14 07:22:18 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/2" already joined relation 0 2024-09-14 07:22:18 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for etcd/1 2024-09-14 07:22:18 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/1 uniter (run update-status hook) 2024-09-14 07:22:18 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/1 uniter (run update-status hook) 2024-09-14 07:22:18 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for etcd/1 2024-09-14 07:22:18 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for etcd/1 2024-09-14 07:22:18 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-1/agent.socket } 2024-09-14 07:22:18 INFO unit.etcd/1.juju-log server.go:316 Reactive main running for hook update-status 2024-09-14 07:22:18 DEBUG unit.etcd/1.juju-log server.go:316 tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:254:send_cluster_connection_details tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-14 07:22:18 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.nagios_context 2024-09-14 07:22:18 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2024-09-14 07:22:18 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.snapd_refresh 2024-09-14 07:22:18 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.snapd_refresh 2024-09-14 07:22:19 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.port 2024-09-14 07:22:19 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.port 2024-09-14 07:22:19 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.management_port 2024-09-14 07:22:19 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.management_port 2024-09-14 07:22:19 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.channel 2024-09-14 07:22:19 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.channel 2024-09-14 07:22:19 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.bind_to_all_interfaces 2024-09-14 07:22:19 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.bind_to_all_interfaces 2024-09-14 07:22:19 INFO unit.etcd/1.juju-log server.go:316 Initializing Leadership Layer (is leader) 2024-09-14 07:22:19 INFO unit.etcd/1.juju-log server.go:316 Initializing Snap Layer 2024-09-14 07:22:19 DEBUG unit.etcd/1.update-status logger.go:60 none 2024-09-14 07:22:19 DEBUG unit.etcd/1.juju-log server.go:316 tracer> tracer: starting handler dispatch, 58 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.batch.cert.available tracer: set flag certificates.ca.available tracer: set flag certificates.certs.available tracer: set flag certificates.client.cert.available tracer: set flag certificates.server.cert.available tracer: set flag certificates.server.certs.available tracer: set flag cluster.joined tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.etcd_0.server.cert tracer: set flag endpoint.certificates.changed.etcd_0.server.key tracer: set flag endpoint.certificates.changed.etcd_1.server.cert tracer: set flag endpoint.certificates.changed.etcd_1.server.key tracer: set flag endpoint.certificates.changed.etcd_2.server.cert tracer: set flag endpoint.certificates.changed.etcd_2.server.key tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.leader.configured tracer: set flag etcd.registered tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag etcd.ssl.placed tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster tracer: set flag leadership.set.leader_address tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca_installed tracer: set flag tls_client.certs.saved tracer: set flag tls_client.client.certificate.saved tracer: set flag tls_client.client.key.saved tracer: set flag tls_client.server.certificate.saved tracer: set flag tls_client.server.key.saved 2024-09-14 07:22:19 DEBUG unit.etcd/1.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-09-14 07:22:19 DEBUG unit.etcd/1.juju-log server.go:316 tracer> tracer: main dispatch loop, 10 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:254:send_cluster_connection_details tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-14 07:22:19 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:95:check_cluster_health 2024-09-14 07:22:19 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-14 07:22:20 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-14 07:22:20 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:247:set_db_ingress_address 2024-09-14 07:22:20 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:254:send_cluster_connection_details 2024-09-14 07:22:20 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:488:process_snapd_timer 2024-09-14 07:22:20 INFO unit.etcd/1.juju-log server.go:316 Get config refresh.timer for snap core 2024-09-14 07:22:20 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:18:store_ca 2024-09-14 07:22:20 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:44:store_server 2024-09-14 07:22:20 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-14 07:22:20 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-14 07:22:20 INFO unit.etcd/1.juju-log server.go:316 status-set: active: Healthy with 3 known peers 2024-09-14 07:22:20 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-09-14 07:22:20 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for etcd/1 2024-09-14 07:22:20 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-14 07:22:20 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/1 uniter (run update-status hook) 2024-09-14 07:22:20 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/1 2024-09-14 07:22:20 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-14 07:22:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-14 07:22:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/2" already joined relation 0 2024-09-14 07:22:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-14 07:22:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/1" already joined relation 8 2024-09-14 07:22:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 8 2024-09-14 07:22:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-14 07:28:14 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for etcd/1 2024-09-14 07:28:14 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-14 07:28:14 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-14 07:28:14 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/2" already joined relation 0 2024-09-14 07:28:14 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-14 07:28:14 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/1" already joined relation 8 2024-09-14 07:28:14 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 8 2024-09-14 07:28:14 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-14 07:28:14 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for etcd/1 2024-09-14 07:28:14 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/1 uniter (run update-status hook) 2024-09-14 07:28:14 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/1 uniter (run update-status hook) 2024-09-14 07:28:14 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for etcd/1 2024-09-14 07:28:14 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for etcd/1 2024-09-14 07:28:14 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-1/agent.socket } 2024-09-14 07:28:14 INFO unit.etcd/1.juju-log server.go:316 Reactive main running for hook update-status 2024-09-14 07:28:14 DEBUG unit.etcd/1.juju-log server.go:316 tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:254:send_cluster_connection_details tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-14 07:28:14 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.nagios_context 2024-09-14 07:28:14 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2024-09-14 07:28:14 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.snapd_refresh 2024-09-14 07:28:15 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.snapd_refresh 2024-09-14 07:28:15 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.port 2024-09-14 07:28:15 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.port 2024-09-14 07:28:15 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.management_port 2024-09-14 07:28:15 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.management_port 2024-09-14 07:28:15 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.channel 2024-09-14 07:28:15 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.channel 2024-09-14 07:28:15 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.bind_to_all_interfaces 2024-09-14 07:28:15 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.bind_to_all_interfaces 2024-09-14 07:28:15 INFO unit.etcd/1.juju-log server.go:316 Initializing Leadership Layer (is leader) 2024-09-14 07:28:15 INFO unit.etcd/1.juju-log server.go:316 Initializing Snap Layer 2024-09-14 07:28:15 DEBUG unit.etcd/1.update-status logger.go:60 none 2024-09-14 07:28:15 DEBUG unit.etcd/1.juju-log server.go:316 tracer> tracer: starting handler dispatch, 58 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.batch.cert.available tracer: set flag certificates.ca.available tracer: set flag certificates.certs.available tracer: set flag certificates.client.cert.available tracer: set flag certificates.server.cert.available tracer: set flag certificates.server.certs.available tracer: set flag cluster.joined tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.etcd_0.server.cert tracer: set flag endpoint.certificates.changed.etcd_0.server.key tracer: set flag endpoint.certificates.changed.etcd_1.server.cert tracer: set flag endpoint.certificates.changed.etcd_1.server.key tracer: set flag endpoint.certificates.changed.etcd_2.server.cert tracer: set flag endpoint.certificates.changed.etcd_2.server.key tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.leader.configured tracer: set flag etcd.registered tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag etcd.ssl.placed tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster tracer: set flag leadership.set.leader_address tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca_installed tracer: set flag tls_client.certs.saved tracer: set flag tls_client.client.certificate.saved tracer: set flag tls_client.client.key.saved tracer: set flag tls_client.server.certificate.saved tracer: set flag tls_client.server.key.saved 2024-09-14 07:28:15 DEBUG unit.etcd/1.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-09-14 07:28:15 DEBUG unit.etcd/1.juju-log server.go:316 tracer> tracer: main dispatch loop, 10 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:254:send_cluster_connection_details tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-14 07:28:15 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:95:check_cluster_health 2024-09-14 07:28:15 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-14 07:28:15 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-14 07:28:15 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:247:set_db_ingress_address 2024-09-14 07:28:15 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:254:send_cluster_connection_details 2024-09-14 07:28:15 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:488:process_snapd_timer 2024-09-14 07:28:15 INFO unit.etcd/1.juju-log server.go:316 Get config refresh.timer for snap core 2024-09-14 07:28:15 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:18:store_ca 2024-09-14 07:28:15 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:44:store_server 2024-09-14 07:28:15 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-14 07:28:15 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-14 07:28:15 INFO unit.etcd/1.juju-log server.go:316 status-set: active: Healthy with 3 known peers 2024-09-14 07:28:16 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-09-14 07:28:16 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for etcd/1 2024-09-14 07:28:16 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-14 07:28:16 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/1 uniter (run update-status hook) 2024-09-14 07:28:16 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/1 2024-09-14 07:28:16 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-14 07:28:16 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-14 07:28:16 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/2" already joined relation 0 2024-09-14 07:28:16 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-14 07:28:16 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/1" already joined relation 8 2024-09-14 07:28:16 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 8 2024-09-14 07:28:16 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-14 07:33:48 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for etcd/1 2024-09-14 07:33:48 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-14 07:33:48 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-14 07:33:48 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/2" already joined relation 0 2024-09-14 07:33:48 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-14 07:33:48 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/1" already joined relation 8 2024-09-14 07:33:48 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 8 2024-09-14 07:33:48 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-14 07:33:48 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for etcd/1 2024-09-14 07:33:48 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/1 uniter (run update-status hook) 2024-09-14 07:33:56 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/1 uniter (run update-status hook) 2024-09-14 07:33:56 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for etcd/1 2024-09-14 07:33:56 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for etcd/1 2024-09-14 07:33:56 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-1/agent.socket } 2024-09-14 07:33:57 INFO unit.etcd/1.juju-log server.go:316 Reactive main running for hook update-status 2024-09-14 07:33:57 DEBUG unit.etcd/1.juju-log server.go:316 tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:254:send_cluster_connection_details tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-14 07:33:57 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.nagios_context 2024-09-14 07:33:57 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2024-09-14 07:33:57 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.snapd_refresh 2024-09-14 07:33:57 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.snapd_refresh 2024-09-14 07:33:57 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.port 2024-09-14 07:33:57 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.port 2024-09-14 07:33:57 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.management_port 2024-09-14 07:33:57 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.management_port 2024-09-14 07:33:57 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.channel 2024-09-14 07:33:57 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.channel 2024-09-14 07:33:57 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.bind_to_all_interfaces 2024-09-14 07:33:57 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.bind_to_all_interfaces 2024-09-14 07:33:57 INFO unit.etcd/1.juju-log server.go:316 Initializing Leadership Layer (is leader) 2024-09-14 07:33:57 INFO unit.etcd/1.juju-log server.go:316 Initializing Snap Layer 2024-09-14 07:33:57 DEBUG unit.etcd/1.update-status logger.go:60 none 2024-09-14 07:33:57 DEBUG unit.etcd/1.juju-log server.go:316 tracer> tracer: starting handler dispatch, 58 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.batch.cert.available tracer: set flag certificates.ca.available tracer: set flag certificates.certs.available tracer: set flag certificates.client.cert.available tracer: set flag certificates.server.cert.available tracer: set flag certificates.server.certs.available tracer: set flag cluster.joined tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.etcd_0.server.cert tracer: set flag endpoint.certificates.changed.etcd_0.server.key tracer: set flag endpoint.certificates.changed.etcd_1.server.cert tracer: set flag endpoint.certificates.changed.etcd_1.server.key tracer: set flag endpoint.certificates.changed.etcd_2.server.cert tracer: set flag endpoint.certificates.changed.etcd_2.server.key tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.leader.configured tracer: set flag etcd.registered tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag etcd.ssl.placed tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster tracer: set flag leadership.set.leader_address tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca_installed tracer: set flag tls_client.certs.saved tracer: set flag tls_client.client.certificate.saved tracer: set flag tls_client.client.key.saved tracer: set flag tls_client.server.certificate.saved tracer: set flag tls_client.server.key.saved 2024-09-14 07:33:57 DEBUG unit.etcd/1.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-09-14 07:33:57 DEBUG unit.etcd/1.juju-log server.go:316 tracer> tracer: main dispatch loop, 10 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:254:send_cluster_connection_details tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-14 07:33:57 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:95:check_cluster_health 2024-09-14 07:33:57 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-14 07:33:57 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-14 07:33:57 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:247:set_db_ingress_address 2024-09-14 07:33:57 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:254:send_cluster_connection_details 2024-09-14 07:33:58 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:488:process_snapd_timer 2024-09-14 07:33:58 INFO unit.etcd/1.juju-log server.go:316 Get config refresh.timer for snap core 2024-09-14 07:33:58 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:18:store_ca 2024-09-14 07:33:58 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:44:store_server 2024-09-14 07:33:58 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-14 07:33:58 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-14 07:33:58 INFO unit.etcd/1.juju-log server.go:316 status-set: active: Healthy with 3 known peers 2024-09-14 07:33:58 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-09-14 07:33:58 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for etcd/1 2024-09-14 07:33:58 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-14 07:33:58 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/1 uniter (run update-status hook) 2024-09-14 07:33:58 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/1 2024-09-14 07:33:58 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-14 07:33:58 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-14 07:33:58 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/2" already joined relation 0 2024-09-14 07:33:58 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-14 07:33:58 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/1" already joined relation 8 2024-09-14 07:33:58 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 8 2024-09-14 07:33:58 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-14 07:38:05 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for etcd/1 2024-09-14 07:38:05 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-14 07:38:05 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-14 07:38:05 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/2" already joined relation 0 2024-09-14 07:38:05 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-14 07:38:05 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/1" already joined relation 8 2024-09-14 07:38:05 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 8 2024-09-14 07:38:05 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-14 07:38:05 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for etcd/1 2024-09-14 07:38:05 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/1 uniter (run update-status hook) 2024-09-14 07:38:05 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/1 uniter (run update-status hook) 2024-09-14 07:38:05 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for etcd/1 2024-09-14 07:38:05 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for etcd/1 2024-09-14 07:38:05 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-1/agent.socket } 2024-09-14 07:38:05 INFO unit.etcd/1.juju-log server.go:316 Reactive main running for hook update-status 2024-09-14 07:38:05 DEBUG unit.etcd/1.juju-log server.go:316 tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:254:send_cluster_connection_details tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-14 07:38:05 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.nagios_context 2024-09-14 07:38:05 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2024-09-14 07:38:05 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.snapd_refresh 2024-09-14 07:38:05 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.snapd_refresh 2024-09-14 07:38:05 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.port 2024-09-14 07:38:05 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.port 2024-09-14 07:38:05 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.management_port 2024-09-14 07:38:05 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.management_port 2024-09-14 07:38:05 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.channel 2024-09-14 07:38:05 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.channel 2024-09-14 07:38:05 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.bind_to_all_interfaces 2024-09-14 07:38:05 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.bind_to_all_interfaces 2024-09-14 07:38:05 INFO unit.etcd/1.juju-log server.go:316 Initializing Leadership Layer (is leader) 2024-09-14 07:38:05 INFO unit.etcd/1.juju-log server.go:316 Initializing Snap Layer 2024-09-14 07:38:05 DEBUG unit.etcd/1.update-status logger.go:60 none 2024-09-14 07:38:05 DEBUG unit.etcd/1.juju-log server.go:316 tracer> tracer: starting handler dispatch, 58 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.batch.cert.available tracer: set flag certificates.ca.available tracer: set flag certificates.certs.available tracer: set flag certificates.client.cert.available tracer: set flag certificates.server.cert.available tracer: set flag certificates.server.certs.available tracer: set flag cluster.joined tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.etcd_0.server.cert tracer: set flag endpoint.certificates.changed.etcd_0.server.key tracer: set flag endpoint.certificates.changed.etcd_1.server.cert tracer: set flag endpoint.certificates.changed.etcd_1.server.key tracer: set flag endpoint.certificates.changed.etcd_2.server.cert tracer: set flag endpoint.certificates.changed.etcd_2.server.key tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.leader.configured tracer: set flag etcd.registered tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag etcd.ssl.placed tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster tracer: set flag leadership.set.leader_address tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca_installed tracer: set flag tls_client.certs.saved tracer: set flag tls_client.client.certificate.saved tracer: set flag tls_client.client.key.saved tracer: set flag tls_client.server.certificate.saved tracer: set flag tls_client.server.key.saved 2024-09-14 07:38:05 DEBUG unit.etcd/1.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-09-14 07:38:05 DEBUG unit.etcd/1.juju-log server.go:316 tracer> tracer: main dispatch loop, 10 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:254:send_cluster_connection_details tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-14 07:38:05 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:95:check_cluster_health 2024-09-14 07:38:06 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-14 07:38:06 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-14 07:38:06 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:247:set_db_ingress_address 2024-09-14 07:38:06 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:254:send_cluster_connection_details 2024-09-14 07:38:06 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:488:process_snapd_timer 2024-09-14 07:38:06 INFO unit.etcd/1.juju-log server.go:316 Get config refresh.timer for snap core 2024-09-14 07:38:06 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:18:store_ca 2024-09-14 07:38:06 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:44:store_server 2024-09-14 07:38:06 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-14 07:38:06 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-14 07:38:06 INFO unit.etcd/1.juju-log server.go:316 status-set: active: Healthy with 3 known peers 2024-09-14 07:38:06 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-09-14 07:38:06 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for etcd/1 2024-09-14 07:38:06 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-14 07:38:06 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/1 uniter (run update-status hook) 2024-09-14 07:38:06 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/1 2024-09-14 07:38:06 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-14 07:38:06 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-14 07:38:06 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-14 07:38:06 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/2" already joined relation 0 2024-09-14 07:38:06 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-14 07:38:06 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/1" already joined relation 8 2024-09-14 07:38:06 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 8 2024-09-14 07:44:04 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for etcd/1 2024-09-14 07:44:04 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-14 07:44:04 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-14 07:44:04 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/2" already joined relation 0 2024-09-14 07:44:04 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-14 07:44:04 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/1" already joined relation 8 2024-09-14 07:44:04 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 8 2024-09-14 07:44:04 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-14 07:44:04 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for etcd/1 2024-09-14 07:44:04 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/1 uniter (run update-status hook) 2024-09-14 07:44:04 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/1 uniter (run update-status hook) 2024-09-14 07:44:04 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for etcd/1 2024-09-14 07:44:04 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for etcd/1 2024-09-14 07:44:04 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-1/agent.socket } 2024-09-14 07:44:04 INFO unit.etcd/1.juju-log server.go:316 Reactive main running for hook update-status 2024-09-14 07:44:05 DEBUG unit.etcd/1.juju-log server.go:316 tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:254:send_cluster_connection_details tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-14 07:44:05 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.nagios_context 2024-09-14 07:44:05 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2024-09-14 07:44:05 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.snapd_refresh 2024-09-14 07:44:05 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.snapd_refresh 2024-09-14 07:44:05 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.port 2024-09-14 07:44:05 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.port 2024-09-14 07:44:05 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.management_port 2024-09-14 07:44:05 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.management_port 2024-09-14 07:44:05 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.channel 2024-09-14 07:44:05 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.channel 2024-09-14 07:44:05 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.bind_to_all_interfaces 2024-09-14 07:44:05 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.bind_to_all_interfaces 2024-09-14 07:44:05 INFO unit.etcd/1.juju-log server.go:316 Initializing Leadership Layer (is leader) 2024-09-14 07:44:05 INFO unit.etcd/1.juju-log server.go:316 Initializing Snap Layer 2024-09-14 07:44:05 DEBUG unit.etcd/1.update-status logger.go:60 none 2024-09-14 07:44:05 DEBUG unit.etcd/1.juju-log server.go:316 tracer> tracer: starting handler dispatch, 58 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.batch.cert.available tracer: set flag certificates.ca.available tracer: set flag certificates.certs.available tracer: set flag certificates.client.cert.available tracer: set flag certificates.server.cert.available tracer: set flag certificates.server.certs.available tracer: set flag cluster.joined tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.etcd_0.server.cert tracer: set flag endpoint.certificates.changed.etcd_0.server.key tracer: set flag endpoint.certificates.changed.etcd_1.server.cert tracer: set flag endpoint.certificates.changed.etcd_1.server.key tracer: set flag endpoint.certificates.changed.etcd_2.server.cert tracer: set flag endpoint.certificates.changed.etcd_2.server.key tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.leader.configured tracer: set flag etcd.registered tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag etcd.ssl.placed tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster tracer: set flag leadership.set.leader_address tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca_installed tracer: set flag tls_client.certs.saved tracer: set flag tls_client.client.certificate.saved tracer: set flag tls_client.client.key.saved tracer: set flag tls_client.server.certificate.saved tracer: set flag tls_client.server.key.saved 2024-09-14 07:44:05 DEBUG unit.etcd/1.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-09-14 07:44:05 DEBUG unit.etcd/1.juju-log server.go:316 tracer> tracer: main dispatch loop, 10 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:254:send_cluster_connection_details tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-14 07:44:05 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:95:check_cluster_health 2024-09-14 07:44:05 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-14 07:44:05 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-14 07:44:05 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:247:set_db_ingress_address 2024-09-14 07:44:05 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:254:send_cluster_connection_details 2024-09-14 07:44:05 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:488:process_snapd_timer 2024-09-14 07:44:05 INFO unit.etcd/1.juju-log server.go:316 Get config refresh.timer for snap core 2024-09-14 07:44:05 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:18:store_ca 2024-09-14 07:44:06 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:44:store_server 2024-09-14 07:44:06 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-14 07:44:06 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-14 07:44:06 INFO unit.etcd/1.juju-log server.go:316 status-set: active: Healthy with 3 known peers 2024-09-14 07:44:06 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-09-14 07:44:06 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for etcd/1 2024-09-14 07:44:06 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-14 07:44:06 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/1 uniter (run update-status hook) 2024-09-14 07:44:06 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/1 2024-09-14 07:44:06 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-14 07:44:06 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-14 07:44:06 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/2" already joined relation 0 2024-09-14 07:44:06 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-14 07:44:06 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/1" already joined relation 8 2024-09-14 07:44:06 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 8 2024-09-14 07:44:06 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-14 07:49:04 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for etcd/1 2024-09-14 07:49:04 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-14 07:49:04 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-14 07:49:04 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/2" already joined relation 0 2024-09-14 07:49:04 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-14 07:49:04 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/1" already joined relation 8 2024-09-14 07:49:04 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 8 2024-09-14 07:49:04 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-14 07:49:04 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for etcd/1 2024-09-14 07:49:04 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/1 uniter (run update-status hook) 2024-09-14 07:49:04 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/1 uniter (run update-status hook) 2024-09-14 07:49:04 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for etcd/1 2024-09-14 07:49:04 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for etcd/1 2024-09-14 07:49:04 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-1/agent.socket } 2024-09-14 07:49:05 INFO unit.etcd/1.juju-log server.go:316 Reactive main running for hook update-status 2024-09-14 07:49:05 DEBUG unit.etcd/1.juju-log server.go:316 tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:254:send_cluster_connection_details tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-14 07:49:05 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.nagios_context 2024-09-14 07:49:05 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2024-09-14 07:49:05 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.snapd_refresh 2024-09-14 07:49:05 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.snapd_refresh 2024-09-14 07:49:05 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.port 2024-09-14 07:49:05 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.port 2024-09-14 07:49:05 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.management_port 2024-09-14 07:49:05 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.management_port 2024-09-14 07:49:05 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.channel 2024-09-14 07:49:05 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.channel 2024-09-14 07:49:05 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.bind_to_all_interfaces 2024-09-14 07:49:05 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.bind_to_all_interfaces 2024-09-14 07:49:05 INFO unit.etcd/1.juju-log server.go:316 Initializing Leadership Layer (is leader) 2024-09-14 07:49:05 INFO unit.etcd/1.juju-log server.go:316 Initializing Snap Layer 2024-09-14 07:49:05 DEBUG unit.etcd/1.update-status logger.go:60 none 2024-09-14 07:49:05 DEBUG unit.etcd/1.juju-log server.go:316 tracer> tracer: starting handler dispatch, 58 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.batch.cert.available tracer: set flag certificates.ca.available tracer: set flag certificates.certs.available tracer: set flag certificates.client.cert.available tracer: set flag certificates.server.cert.available tracer: set flag certificates.server.certs.available tracer: set flag cluster.joined tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.etcd_0.server.cert tracer: set flag endpoint.certificates.changed.etcd_0.server.key tracer: set flag endpoint.certificates.changed.etcd_1.server.cert tracer: set flag endpoint.certificates.changed.etcd_1.server.key tracer: set flag endpoint.certificates.changed.etcd_2.server.cert tracer: set flag endpoint.certificates.changed.etcd_2.server.key tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.leader.configured tracer: set flag etcd.registered tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag etcd.ssl.placed tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster tracer: set flag leadership.set.leader_address tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca_installed tracer: set flag tls_client.certs.saved tracer: set flag tls_client.client.certificate.saved tracer: set flag tls_client.client.key.saved tracer: set flag tls_client.server.certificate.saved tracer: set flag tls_client.server.key.saved 2024-09-14 07:49:05 DEBUG unit.etcd/1.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-09-14 07:49:05 DEBUG unit.etcd/1.juju-log server.go:316 tracer> tracer: main dispatch loop, 10 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:254:send_cluster_connection_details tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-14 07:49:05 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:95:check_cluster_health 2024-09-14 07:49:05 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-14 07:49:05 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-14 07:49:05 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:247:set_db_ingress_address 2024-09-14 07:49:05 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:254:send_cluster_connection_details 2024-09-14 07:49:06 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:488:process_snapd_timer 2024-09-14 07:49:06 INFO unit.etcd/1.juju-log server.go:316 Get config refresh.timer for snap core 2024-09-14 07:49:06 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:18:store_ca 2024-09-14 07:49:06 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:44:store_server 2024-09-14 07:49:06 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-14 07:49:06 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-14 07:49:06 INFO unit.etcd/1.juju-log server.go:316 status-set: active: Healthy with 3 known peers 2024-09-14 07:49:06 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-09-14 07:49:06 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for etcd/1 2024-09-14 07:49:06 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-14 07:49:06 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/1 uniter (run update-status hook) 2024-09-14 07:49:06 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/1 2024-09-14 07:49:06 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-14 07:49:06 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-14 07:49:06 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/1" already joined relation 8 2024-09-14 07:49:06 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 8 2024-09-14 07:49:06 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-14 07:49:06 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-14 07:49:06 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/2" already joined relation 0 2024-09-14 07:54:34 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for etcd/1 2024-09-14 07:54:34 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-14 07:54:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-14 07:54:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-14 07:54:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/2" already joined relation 0 2024-09-14 07:54:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-14 07:54:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/1" already joined relation 8 2024-09-14 07:54:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 8 2024-09-14 07:54:34 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for etcd/1 2024-09-14 07:54:34 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/1 uniter (run update-status hook) 2024-09-14 07:54:34 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/1 uniter (run update-status hook) 2024-09-14 07:54:34 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for etcd/1 2024-09-14 07:54:34 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for etcd/1 2024-09-14 07:54:34 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-1/agent.socket } 2024-09-14 07:54:34 INFO unit.etcd/1.juju-log server.go:316 Reactive main running for hook update-status 2024-09-14 07:54:34 DEBUG unit.etcd/1.juju-log server.go:316 tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:254:send_cluster_connection_details tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-14 07:54:34 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.nagios_context 2024-09-14 07:54:34 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2024-09-14 07:54:34 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.snapd_refresh 2024-09-14 07:54:34 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.snapd_refresh 2024-09-14 07:54:34 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.port 2024-09-14 07:54:34 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.port 2024-09-14 07:54:34 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.management_port 2024-09-14 07:54:34 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.management_port 2024-09-14 07:54:34 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.channel 2024-09-14 07:54:34 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.channel 2024-09-14 07:54:34 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.bind_to_all_interfaces 2024-09-14 07:54:34 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.bind_to_all_interfaces 2024-09-14 07:54:34 INFO unit.etcd/1.juju-log server.go:316 Initializing Leadership Layer (is leader) 2024-09-14 07:54:34 INFO unit.etcd/1.juju-log server.go:316 Initializing Snap Layer 2024-09-14 07:54:35 DEBUG unit.etcd/1.update-status logger.go:60 none 2024-09-14 07:54:35 DEBUG unit.etcd/1.juju-log server.go:316 tracer> tracer: starting handler dispatch, 58 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.batch.cert.available tracer: set flag certificates.ca.available tracer: set flag certificates.certs.available tracer: set flag certificates.client.cert.available tracer: set flag certificates.server.cert.available tracer: set flag certificates.server.certs.available tracer: set flag cluster.joined tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.etcd_0.server.cert tracer: set flag endpoint.certificates.changed.etcd_0.server.key tracer: set flag endpoint.certificates.changed.etcd_1.server.cert tracer: set flag endpoint.certificates.changed.etcd_1.server.key tracer: set flag endpoint.certificates.changed.etcd_2.server.cert tracer: set flag endpoint.certificates.changed.etcd_2.server.key tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.leader.configured tracer: set flag etcd.registered tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag etcd.ssl.placed tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster tracer: set flag leadership.set.leader_address tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca_installed tracer: set flag tls_client.certs.saved tracer: set flag tls_client.client.certificate.saved tracer: set flag tls_client.client.key.saved tracer: set flag tls_client.server.certificate.saved tracer: set flag tls_client.server.key.saved 2024-09-14 07:54:35 DEBUG unit.etcd/1.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-09-14 07:54:35 DEBUG unit.etcd/1.juju-log server.go:316 tracer> tracer: main dispatch loop, 10 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:254:send_cluster_connection_details tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-14 07:54:35 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:95:check_cluster_health 2024-09-14 07:54:35 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-14 07:54:35 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-14 07:54:35 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:247:set_db_ingress_address 2024-09-14 07:54:35 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:254:send_cluster_connection_details 2024-09-14 07:54:35 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:488:process_snapd_timer 2024-09-14 07:54:35 INFO unit.etcd/1.juju-log server.go:316 Get config refresh.timer for snap core 2024-09-14 07:54:35 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:18:store_ca 2024-09-14 07:54:35 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:44:store_server 2024-09-14 07:54:35 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-14 07:54:35 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-14 07:54:35 INFO unit.etcd/1.juju-log server.go:316 status-set: active: Healthy with 3 known peers 2024-09-14 07:54:35 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-09-14 07:54:35 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for etcd/1 2024-09-14 07:54:35 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-14 07:54:35 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/1 uniter (run update-status hook) 2024-09-14 07:54:35 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/1 2024-09-14 07:54:35 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-14 07:54:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-14 07:54:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-14 07:54:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/2" already joined relation 0 2024-09-14 07:54:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-14 07:54:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/1" already joined relation 8 2024-09-14 07:54:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 8 2024-09-14 07:54:46 DEBUG juju.worker.uniter.remotestate watcher.go:623 got update status interval change for etcd/1: ok=true 2024-09-14 07:54:46 DEBUG juju.worker.retrystrategy worker.go:92 bouncing retrystrategy worker to get new values 2024-09-14 07:54:46 DEBUG juju.worker.dependency engine.go:621 "hook-retry-strategy" manifold worker stopped: restart immediately 2024-09-14 07:54:46 DEBUG juju.worker.uniter runlistener.go:130 juju-run listener stopping 2024-09-14 07:54:46 DEBUG juju.worker.uniter runlistener.go:149 juju-run listener stopped 2024-09-14 07:54:46 INFO juju.worker.uniter uniter.go:319 unit "etcd/1" shutting down: catacomb 0xc000b6f200 is dying 2024-09-14 07:54:46 DEBUG juju.worker.dependency engine.go:603 "uniter" manifold worker completed successfully 2024-09-14 07:54:46 DEBUG juju.worker.dependency engine.go:580 "hook-retry-strategy" manifold worker started at 2024-09-14 07:54:46.9518885 +0000 UTC 2024-09-14 07:54:46 DEBUG juju.worker.dependency engine.go:580 "uniter" manifold worker started at 2024-09-14 07:54:46.96251787 +0000 UTC 2024-09-14 07:54:47 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "etcd/1" (leader=true) entered scope for relation "etcd:cluster" 2024-09-14 07:54:47 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "etcd/1" (leader=true) entered scope for relation "etcd:certificates easyrsa:client" 2024-09-14 07:54:47 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "etcd/1" (leader=true) entered scope for relation "kubernetes-master:etcd etcd:db" 2024-09-14 07:54:48 DEBUG juju.worker.uniter uniter.go:883 starting local juju-run listener on {unix /var/lib/juju/agents/unit-etcd-1/run.socket } 2024-09-14 07:54:48 INFO juju.worker.uniter uniter.go:335 unit "etcd/1" started 2024-09-14 07:54:48 DEBUG juju.worker.uniter runlistener.go:117 juju-run listener running 2024-09-14 07:54:48 INFO juju.worker.uniter uniter.go:361 hooks are retried false 2024-09-14 07:54:48 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for etcd/1: ok=true 2024-09-14 07:54:48 DEBUG juju.worker.uniter.remotestate watcher.go:603 got relations change for etcd/1: ok=true 2024-09-14 07:54:48 DEBUG juju.worker.uniter.remotestate watcher.go:553 got trust config change for etcd/1: ok=true, hashes=[17f2acda51310eebc7ec5fc33ba3e24c9838f484cf50956f7b6066f1d8bba28f] 2024-09-14 07:54:48 DEBUG juju.worker.uniter.remotestate watcher.go:489 got unit change for etcd/1 2024-09-14 07:54:48 DEBUG juju.worker.uniter.remotestate watcher.go:574 got address change for etcd/1: ok=true, hashes=[843f625ebaf8471f073b1a21cd550b961636698be715f06c7f05a3c7a6837450] 2024-09-14 07:54:48 DEBUG juju.worker.uniter.remotestate watcher.go:623 got update status interval change for etcd/1: ok=true 2024-09-14 07:54:48 DEBUG juju.worker.uniter.remotestate watcher.go:613 got storage change for etcd/1: [] ok=true 2024-09-14 07:54:48 DEBUG juju.worker.uniter.remotestate watcher.go:499 got application change for etcd/1 2024-09-14 07:54:48 DEBUG juju.worker.uniter.remotestate watcher.go:595 got action change for etcd/1: [] ok=true 2024-09-14 07:54:48 DEBUG juju.worker.uniter.remotestate watcher.go:542 got config change for etcd/1: ok=true, hashes=[51e9e2593d2d2d48099fb3c0fe9760058a9f2043cb2eddd9a7a27cc5b8850729] 2024-09-14 07:54:48 DEBUG juju.worker.uniter.remotestate watcher.go:564 got upgrade series change 2024-09-14 07:54:48 DEBUG juju.worker.uniter.remotestate watcher.go:714 no upgrade series in progress, reinitializing local upgrade series state 2024-09-14 07:54:48 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-14 07:54:48 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-14 07:54:48 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-14 07:54:48 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/2" already joined relation 0 2024-09-14 07:54:48 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-14 07:54:48 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/1" already joined relation 8 2024-09-14 07:54:48 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 8 2024-09-14 07:54:48 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 2024-09-14 08:00:19 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for etcd/1 2024-09-14 08:00:19 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-14 08:00:19 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-14 08:00:19 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-14 08:00:19 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/2" already joined relation 0 2024-09-14 08:00:19 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-14 08:00:19 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/1" already joined relation 8 2024-09-14 08:00:19 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 8 2024-09-14 08:00:19 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for etcd/1 2024-09-14 08:00:19 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/1 uniter (run update-status hook) 2024-09-14 08:00:44 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/1 uniter (run update-status hook) 2024-09-14 08:00:44 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for etcd/1 2024-09-14 08:00:45 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for etcd/1 2024-09-14 08:00:45 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-1/agent.socket } 2024-09-14 08:00:45 INFO unit.etcd/1.juju-log server.go:316 Reactive main running for hook update-status 2024-09-14 08:00:45 DEBUG unit.etcd/1.juju-log server.go:316 tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:254:send_cluster_connection_details tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-14 08:00:45 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.nagios_context 2024-09-14 08:00:45 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2024-09-14 08:00:45 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.snapd_refresh 2024-09-14 08:00:45 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.snapd_refresh 2024-09-14 08:00:45 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.port 2024-09-14 08:00:45 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.port 2024-09-14 08:00:45 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.management_port 2024-09-14 08:00:45 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.management_port 2024-09-14 08:00:45 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.channel 2024-09-14 08:00:45 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.channel 2024-09-14 08:00:45 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.bind_to_all_interfaces 2024-09-14 08:00:45 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.bind_to_all_interfaces 2024-09-14 08:00:45 INFO unit.etcd/1.juju-log server.go:316 Initializing Leadership Layer (is leader) 2024-09-14 08:00:45 INFO unit.etcd/1.juju-log server.go:316 Initializing Snap Layer 2024-09-14 08:00:45 DEBUG unit.etcd/1.update-status logger.go:60 none 2024-09-14 08:00:45 DEBUG unit.etcd/1.juju-log server.go:316 tracer> tracer: starting handler dispatch, 58 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.batch.cert.available tracer: set flag certificates.ca.available tracer: set flag certificates.certs.available tracer: set flag certificates.client.cert.available tracer: set flag certificates.server.cert.available tracer: set flag certificates.server.certs.available tracer: set flag cluster.joined tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.etcd_0.server.cert tracer: set flag endpoint.certificates.changed.etcd_0.server.key tracer: set flag endpoint.certificates.changed.etcd_1.server.cert tracer: set flag endpoint.certificates.changed.etcd_1.server.key tracer: set flag endpoint.certificates.changed.etcd_2.server.cert tracer: set flag endpoint.certificates.changed.etcd_2.server.key tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.leader.configured tracer: set flag etcd.registered tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag etcd.ssl.placed tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster tracer: set flag leadership.set.leader_address tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca_installed tracer: set flag tls_client.certs.saved tracer: set flag tls_client.client.certificate.saved tracer: set flag tls_client.client.key.saved tracer: set flag tls_client.server.certificate.saved tracer: set flag tls_client.server.key.saved 2024-09-14 08:00:45 DEBUG unit.etcd/1.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-09-14 08:00:45 DEBUG unit.etcd/1.juju-log server.go:316 tracer> tracer: main dispatch loop, 10 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:254:send_cluster_connection_details tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-14 08:00:45 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:95:check_cluster_health 2024-09-14 08:00:46 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-14 08:00:46 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-14 08:00:46 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:247:set_db_ingress_address 2024-09-14 08:00:46 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:254:send_cluster_connection_details 2024-09-14 08:00:46 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:488:process_snapd_timer 2024-09-14 08:00:46 INFO unit.etcd/1.juju-log server.go:316 Get config refresh.timer for snap core 2024-09-14 08:00:46 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:18:store_ca 2024-09-14 08:00:46 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:44:store_server 2024-09-14 08:00:46 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-14 08:00:46 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-14 08:00:46 INFO unit.etcd/1.juju-log server.go:316 status-set: active: Healthy with 3 known peers 2024-09-14 08:00:46 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-09-14 08:00:46 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for etcd/1 2024-09-14 08:00:46 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-14 08:00:46 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/1 uniter (run update-status hook) 2024-09-14 08:00:46 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/1 2024-09-14 08:00:46 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-14 08:00:46 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-14 08:00:46 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/1" already joined relation 8 2024-09-14 08:00:46 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 8 2024-09-14 08:00:46 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-14 08:00:46 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-14 08:00:46 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/2" already joined relation 0 2024-09-14 08:05:28 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for etcd/1 2024-09-14 08:05:28 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-14 08:05:28 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-14 08:05:28 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-14 08:05:28 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/2" already joined relation 0 2024-09-14 08:05:28 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-14 08:05:28 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/1" already joined relation 8 2024-09-14 08:05:28 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 8 2024-09-14 08:05:28 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for etcd/1 2024-09-14 08:05:28 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/1 uniter (run update-status hook) 2024-09-14 08:05:29 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/1 uniter (run update-status hook) 2024-09-14 08:05:29 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for etcd/1 2024-09-14 08:05:29 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for etcd/1 2024-09-14 08:05:29 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-1/agent.socket } 2024-09-14 08:05:29 INFO unit.etcd/1.juju-log server.go:316 Reactive main running for hook update-status 2024-09-14 08:05:29 DEBUG unit.etcd/1.juju-log server.go:316 tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:254:send_cluster_connection_details tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-14 08:05:29 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.nagios_context 2024-09-14 08:05:29 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2024-09-14 08:05:29 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.snapd_refresh 2024-09-14 08:05:29 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.snapd_refresh 2024-09-14 08:05:29 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.port 2024-09-14 08:05:29 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.port 2024-09-14 08:05:29 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.management_port 2024-09-14 08:05:30 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.management_port 2024-09-14 08:05:30 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.channel 2024-09-14 08:05:30 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.channel 2024-09-14 08:05:30 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.bind_to_all_interfaces 2024-09-14 08:05:30 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.bind_to_all_interfaces 2024-09-14 08:05:30 INFO unit.etcd/1.juju-log server.go:316 Initializing Leadership Layer (is leader) 2024-09-14 08:05:30 INFO unit.etcd/1.juju-log server.go:316 Initializing Snap Layer 2024-09-14 08:05:30 DEBUG unit.etcd/1.update-status logger.go:60 none 2024-09-14 08:05:30 DEBUG unit.etcd/1.juju-log server.go:316 tracer> tracer: starting handler dispatch, 58 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.batch.cert.available tracer: set flag certificates.ca.available tracer: set flag certificates.certs.available tracer: set flag certificates.client.cert.available tracer: set flag certificates.server.cert.available tracer: set flag certificates.server.certs.available tracer: set flag cluster.joined tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.etcd_0.server.cert tracer: set flag endpoint.certificates.changed.etcd_0.server.key tracer: set flag endpoint.certificates.changed.etcd_1.server.cert tracer: set flag endpoint.certificates.changed.etcd_1.server.key tracer: set flag endpoint.certificates.changed.etcd_2.server.cert tracer: set flag endpoint.certificates.changed.etcd_2.server.key tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.leader.configured tracer: set flag etcd.registered tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag etcd.ssl.placed tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster tracer: set flag leadership.set.leader_address tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca_installed tracer: set flag tls_client.certs.saved tracer: set flag tls_client.client.certificate.saved tracer: set flag tls_client.client.key.saved tracer: set flag tls_client.server.certificate.saved tracer: set flag tls_client.server.key.saved 2024-09-14 08:05:30 DEBUG unit.etcd/1.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-09-14 08:05:30 DEBUG unit.etcd/1.juju-log server.go:316 tracer> tracer: main dispatch loop, 10 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:254:send_cluster_connection_details tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-14 08:05:30 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:95:check_cluster_health 2024-09-14 08:05:30 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-14 08:05:30 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-14 08:05:30 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:247:set_db_ingress_address 2024-09-14 08:05:30 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:254:send_cluster_connection_details 2024-09-14 08:05:31 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:488:process_snapd_timer 2024-09-14 08:05:31 INFO unit.etcd/1.juju-log server.go:316 Get config refresh.timer for snap core 2024-09-14 08:05:31 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:18:store_ca 2024-09-14 08:05:31 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:44:store_server 2024-09-14 08:05:31 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-14 08:05:31 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-14 08:05:31 INFO unit.etcd/1.juju-log server.go:316 status-set: active: Healthy with 3 known peers 2024-09-14 08:05:31 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-09-14 08:05:31 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for etcd/1 2024-09-14 08:05:31 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-14 08:05:31 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/1 uniter (run update-status hook) 2024-09-14 08:05:31 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/1 2024-09-14 08:05:31 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-14 08:05:31 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-14 08:05:31 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-14 08:05:31 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/2" already joined relation 0 2024-09-14 08:05:31 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-14 08:05:31 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/1" already joined relation 8 2024-09-14 08:05:31 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 8 2024-09-14 08:10:56 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for etcd/1 2024-09-14 08:10:56 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-14 08:10:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-14 08:10:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-14 08:10:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/2" already joined relation 0 2024-09-14 08:10:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-14 08:10:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/1" already joined relation 8 2024-09-14 08:10:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 8 2024-09-14 08:10:56 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for etcd/1 2024-09-14 08:10:56 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/1 uniter (run update-status hook) 2024-09-14 08:10:58 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/1 uniter (run update-status hook) 2024-09-14 08:10:58 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for etcd/1 2024-09-14 08:10:58 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for etcd/1 2024-09-14 08:10:58 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-1/agent.socket } 2024-09-14 08:10:59 INFO unit.etcd/1.juju-log server.go:316 Reactive main running for hook update-status 2024-09-14 08:10:59 DEBUG unit.etcd/1.juju-log server.go:316 tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:254:send_cluster_connection_details tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-14 08:10:59 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.nagios_context 2024-09-14 08:10:59 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2024-09-14 08:10:59 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.snapd_refresh 2024-09-14 08:10:59 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.snapd_refresh 2024-09-14 08:10:59 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.port 2024-09-14 08:10:59 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.port 2024-09-14 08:10:59 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.management_port 2024-09-14 08:10:59 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.management_port 2024-09-14 08:10:59 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.channel 2024-09-14 08:10:59 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.channel 2024-09-14 08:10:59 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.bind_to_all_interfaces 2024-09-14 08:10:59 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.bind_to_all_interfaces 2024-09-14 08:10:59 INFO unit.etcd/1.juju-log server.go:316 Initializing Leadership Layer (is leader) 2024-09-14 08:10:59 INFO unit.etcd/1.juju-log server.go:316 Initializing Snap Layer 2024-09-14 08:10:59 DEBUG unit.etcd/1.update-status logger.go:60 none 2024-09-14 08:10:59 DEBUG unit.etcd/1.juju-log server.go:316 tracer> tracer: starting handler dispatch, 58 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.batch.cert.available tracer: set flag certificates.ca.available tracer: set flag certificates.certs.available tracer: set flag certificates.client.cert.available tracer: set flag certificates.server.cert.available tracer: set flag certificates.server.certs.available tracer: set flag cluster.joined tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.etcd_0.server.cert tracer: set flag endpoint.certificates.changed.etcd_0.server.key tracer: set flag endpoint.certificates.changed.etcd_1.server.cert tracer: set flag endpoint.certificates.changed.etcd_1.server.key tracer: set flag endpoint.certificates.changed.etcd_2.server.cert tracer: set flag endpoint.certificates.changed.etcd_2.server.key tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.leader.configured tracer: set flag etcd.registered tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag etcd.ssl.placed tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster tracer: set flag leadership.set.leader_address tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca_installed tracer: set flag tls_client.certs.saved tracer: set flag tls_client.client.certificate.saved tracer: set flag tls_client.client.key.saved tracer: set flag tls_client.server.certificate.saved tracer: set flag tls_client.server.key.saved 2024-09-14 08:10:59 DEBUG unit.etcd/1.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-09-14 08:10:59 DEBUG unit.etcd/1.juju-log server.go:316 tracer> tracer: main dispatch loop, 10 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:254:send_cluster_connection_details tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-14 08:10:59 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:95:check_cluster_health 2024-09-14 08:11:00 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-14 08:11:00 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-14 08:11:00 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:247:set_db_ingress_address 2024-09-14 08:11:00 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:254:send_cluster_connection_details 2024-09-14 08:11:00 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:488:process_snapd_timer 2024-09-14 08:11:00 INFO unit.etcd/1.juju-log server.go:316 Get config refresh.timer for snap core 2024-09-14 08:11:00 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:18:store_ca 2024-09-14 08:11:00 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:44:store_server 2024-09-14 08:11:00 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-14 08:11:00 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-14 08:11:00 INFO unit.etcd/1.juju-log server.go:316 status-set: active: Healthy with 3 known peers 2024-09-14 08:11:01 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-09-14 08:11:01 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for etcd/1 2024-09-14 08:11:01 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-14 08:11:01 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/1 uniter (run update-status hook) 2024-09-14 08:11:01 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/1 2024-09-14 08:11:01 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-14 08:11:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-14 08:11:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-14 08:11:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/2" already joined relation 0 2024-09-14 08:11:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-14 08:11:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/1" already joined relation 8 2024-09-14 08:11:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 8 2024-09-14 08:15:39 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for etcd/1 2024-09-14 08:15:39 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-14 08:15:39 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-14 08:15:39 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-14 08:15:39 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/2" already joined relation 0 2024-09-14 08:15:39 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-14 08:15:39 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/1" already joined relation 8 2024-09-14 08:15:39 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 8 2024-09-14 08:15:39 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for etcd/1 2024-09-14 08:15:39 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/1 uniter (run update-status hook) 2024-09-14 08:15:41 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/1 uniter (run update-status hook) 2024-09-14 08:15:41 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for etcd/1 2024-09-14 08:15:41 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for etcd/1 2024-09-14 08:15:41 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-1/agent.socket } 2024-09-14 08:15:41 INFO unit.etcd/1.juju-log server.go:316 Reactive main running for hook update-status 2024-09-14 08:15:42 DEBUG unit.etcd/1.juju-log server.go:316 tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:254:send_cluster_connection_details tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-14 08:15:42 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.nagios_context 2024-09-14 08:15:42 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2024-09-14 08:15:42 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.snapd_refresh 2024-09-14 08:15:42 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.snapd_refresh 2024-09-14 08:15:42 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.port 2024-09-14 08:15:42 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.port 2024-09-14 08:15:42 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.management_port 2024-09-14 08:15:42 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.management_port 2024-09-14 08:15:42 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.channel 2024-09-14 08:15:42 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.channel 2024-09-14 08:15:42 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.bind_to_all_interfaces 2024-09-14 08:15:42 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.bind_to_all_interfaces 2024-09-14 08:15:42 INFO unit.etcd/1.juju-log server.go:316 Initializing Leadership Layer (is leader) 2024-09-14 08:15:42 INFO unit.etcd/1.juju-log server.go:316 Initializing Snap Layer 2024-09-14 08:15:42 DEBUG unit.etcd/1.update-status logger.go:60 none 2024-09-14 08:15:42 DEBUG unit.etcd/1.juju-log server.go:316 tracer> tracer: starting handler dispatch, 58 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.batch.cert.available tracer: set flag certificates.ca.available tracer: set flag certificates.certs.available tracer: set flag certificates.client.cert.available tracer: set flag certificates.server.cert.available tracer: set flag certificates.server.certs.available tracer: set flag cluster.joined tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.etcd_0.server.cert tracer: set flag endpoint.certificates.changed.etcd_0.server.key tracer: set flag endpoint.certificates.changed.etcd_1.server.cert tracer: set flag endpoint.certificates.changed.etcd_1.server.key tracer: set flag endpoint.certificates.changed.etcd_2.server.cert tracer: set flag endpoint.certificates.changed.etcd_2.server.key tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.leader.configured tracer: set flag etcd.registered tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag etcd.ssl.placed tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster tracer: set flag leadership.set.leader_address tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca_installed tracer: set flag tls_client.certs.saved tracer: set flag tls_client.client.certificate.saved tracer: set flag tls_client.client.key.saved tracer: set flag tls_client.server.certificate.saved tracer: set flag tls_client.server.key.saved 2024-09-14 08:15:42 DEBUG unit.etcd/1.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-09-14 08:15:42 DEBUG unit.etcd/1.juju-log server.go:316 tracer> tracer: main dispatch loop, 10 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:254:send_cluster_connection_details tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-14 08:15:42 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:95:check_cluster_health 2024-09-14 08:15:43 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-14 08:15:43 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-14 08:15:43 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:247:set_db_ingress_address 2024-09-14 08:15:43 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:254:send_cluster_connection_details 2024-09-14 08:15:44 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:488:process_snapd_timer 2024-09-14 08:15:44 INFO unit.etcd/1.juju-log server.go:316 Get config refresh.timer for snap core 2024-09-14 08:15:44 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:18:store_ca 2024-09-14 08:15:44 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:44:store_server 2024-09-14 08:15:44 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-14 08:15:44 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-14 08:15:44 INFO unit.etcd/1.juju-log server.go:316 status-set: active: Healthy with 3 known peers 2024-09-14 08:15:44 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-09-14 08:15:44 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for etcd/1 2024-09-14 08:15:44 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-14 08:15:44 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/1 uniter (run update-status hook) 2024-09-14 08:15:44 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/1 2024-09-14 08:15:44 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-14 08:15:44 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-14 08:15:44 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-14 08:15:44 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/2" already joined relation 0 2024-09-14 08:15:44 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-14 08:15:44 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/1" already joined relation 8 2024-09-14 08:15:44 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 8 2024-09-14 08:20:55 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for etcd/1 2024-09-14 08:20:55 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-14 08:20:55 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-14 08:20:55 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-14 08:20:55 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/2" already joined relation 0 2024-09-14 08:20:55 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-14 08:20:55 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/1" already joined relation 8 2024-09-14 08:20:55 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 8 2024-09-14 08:20:55 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for etcd/1 2024-09-14 08:20:55 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/1 uniter (run update-status hook) 2024-09-14 08:20:56 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/1 uniter (run update-status hook) 2024-09-14 08:20:56 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for etcd/1 2024-09-14 08:20:56 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for etcd/1 2024-09-14 08:20:56 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-1/agent.socket } 2024-09-14 08:20:57 INFO unit.etcd/1.juju-log server.go:316 Reactive main running for hook update-status 2024-09-14 08:20:57 DEBUG unit.etcd/1.juju-log server.go:316 tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:254:send_cluster_connection_details tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-14 08:20:57 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.nagios_context 2024-09-14 08:20:57 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2024-09-14 08:20:57 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.snapd_refresh 2024-09-14 08:20:57 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.snapd_refresh 2024-09-14 08:20:57 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.port 2024-09-14 08:20:57 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.port 2024-09-14 08:20:57 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.management_port 2024-09-14 08:20:57 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.management_port 2024-09-14 08:20:57 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.channel 2024-09-14 08:20:57 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.channel 2024-09-14 08:20:57 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.bind_to_all_interfaces 2024-09-14 08:20:57 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.bind_to_all_interfaces 2024-09-14 08:20:57 INFO unit.etcd/1.juju-log server.go:316 Initializing Leadership Layer (is leader) 2024-09-14 08:20:57 INFO unit.etcd/1.juju-log server.go:316 Initializing Snap Layer 2024-09-14 08:20:57 DEBUG unit.etcd/1.update-status logger.go:60 none 2024-09-14 08:20:57 DEBUG unit.etcd/1.juju-log server.go:316 tracer> tracer: starting handler dispatch, 58 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.batch.cert.available tracer: set flag certificates.ca.available tracer: set flag certificates.certs.available tracer: set flag certificates.client.cert.available tracer: set flag certificates.server.cert.available tracer: set flag certificates.server.certs.available tracer: set flag cluster.joined tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.etcd_0.server.cert tracer: set flag endpoint.certificates.changed.etcd_0.server.key tracer: set flag endpoint.certificates.changed.etcd_1.server.cert tracer: set flag endpoint.certificates.changed.etcd_1.server.key tracer: set flag endpoint.certificates.changed.etcd_2.server.cert tracer: set flag endpoint.certificates.changed.etcd_2.server.key tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.leader.configured tracer: set flag etcd.registered tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag etcd.ssl.placed tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster tracer: set flag leadership.set.leader_address tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca_installed tracer: set flag tls_client.certs.saved tracer: set flag tls_client.client.certificate.saved tracer: set flag tls_client.client.key.saved tracer: set flag tls_client.server.certificate.saved tracer: set flag tls_client.server.key.saved 2024-09-14 08:20:57 DEBUG unit.etcd/1.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-09-14 08:20:57 DEBUG unit.etcd/1.juju-log server.go:316 tracer> tracer: main dispatch loop, 10 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:254:send_cluster_connection_details tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-14 08:20:57 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:95:check_cluster_health 2024-09-14 08:20:58 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-14 08:20:58 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-14 08:20:58 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:247:set_db_ingress_address 2024-09-14 08:20:58 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:254:send_cluster_connection_details 2024-09-14 08:20:58 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:488:process_snapd_timer 2024-09-14 08:20:58 INFO unit.etcd/1.juju-log server.go:316 Get config refresh.timer for snap core 2024-09-14 08:20:58 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:18:store_ca 2024-09-14 08:20:58 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:44:store_server 2024-09-14 08:20:58 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-14 08:20:58 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-14 08:20:58 INFO unit.etcd/1.juju-log server.go:316 status-set: active: Healthy with 3 known peers 2024-09-14 08:20:58 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-09-14 08:20:58 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for etcd/1 2024-09-14 08:20:58 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-14 08:20:58 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/1 uniter (run update-status hook) 2024-09-14 08:20:58 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/1 2024-09-14 08:20:58 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-14 08:20:58 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-14 08:20:58 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/1" already joined relation 8 2024-09-14 08:20:58 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 8 2024-09-14 08:20:58 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-14 08:20:58 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-14 08:20:58 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/2" already joined relation 0 2024-09-14 08:25:46 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for etcd/1 2024-09-14 08:25:46 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-14 08:25:46 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-14 08:25:46 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/1" already joined relation 8 2024-09-14 08:25:46 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 8 2024-09-14 08:25:46 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-14 08:25:46 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-14 08:25:46 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/2" already joined relation 0 2024-09-14 08:25:46 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for etcd/1 2024-09-14 08:25:46 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/1 uniter (run update-status hook) 2024-09-14 08:25:48 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/1 uniter (run update-status hook) 2024-09-14 08:25:48 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for etcd/1 2024-09-14 08:25:48 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for etcd/1 2024-09-14 08:25:48 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-1/agent.socket } 2024-09-14 08:25:49 INFO unit.etcd/1.juju-log server.go:316 Reactive main running for hook update-status 2024-09-14 08:25:49 DEBUG unit.etcd/1.juju-log server.go:316 tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:254:send_cluster_connection_details tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-14 08:25:49 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.nagios_context 2024-09-14 08:25:49 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2024-09-14 08:25:49 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.snapd_refresh 2024-09-14 08:25:49 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.snapd_refresh 2024-09-14 08:25:49 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.port 2024-09-14 08:25:49 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.port 2024-09-14 08:25:49 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.management_port 2024-09-14 08:25:49 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.management_port 2024-09-14 08:25:49 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.channel 2024-09-14 08:25:49 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.channel 2024-09-14 08:25:49 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.bind_to_all_interfaces 2024-09-14 08:25:49 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.bind_to_all_interfaces 2024-09-14 08:25:49 INFO unit.etcd/1.juju-log server.go:316 Initializing Leadership Layer (is leader) 2024-09-14 08:25:49 INFO unit.etcd/1.juju-log server.go:316 Initializing Snap Layer 2024-09-14 08:25:49 DEBUG unit.etcd/1.update-status logger.go:60 none 2024-09-14 08:25:49 DEBUG unit.etcd/1.juju-log server.go:316 tracer> tracer: starting handler dispatch, 58 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.batch.cert.available tracer: set flag certificates.ca.available tracer: set flag certificates.certs.available tracer: set flag certificates.client.cert.available tracer: set flag certificates.server.cert.available tracer: set flag certificates.server.certs.available tracer: set flag cluster.joined tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.etcd_0.server.cert tracer: set flag endpoint.certificates.changed.etcd_0.server.key tracer: set flag endpoint.certificates.changed.etcd_1.server.cert tracer: set flag endpoint.certificates.changed.etcd_1.server.key tracer: set flag endpoint.certificates.changed.etcd_2.server.cert tracer: set flag endpoint.certificates.changed.etcd_2.server.key tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.leader.configured tracer: set flag etcd.registered tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag etcd.ssl.placed tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster tracer: set flag leadership.set.leader_address tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca_installed tracer: set flag tls_client.certs.saved tracer: set flag tls_client.client.certificate.saved tracer: set flag tls_client.client.key.saved tracer: set flag tls_client.server.certificate.saved tracer: set flag tls_client.server.key.saved 2024-09-14 08:25:49 DEBUG unit.etcd/1.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-09-14 08:25:49 DEBUG unit.etcd/1.juju-log server.go:316 tracer> tracer: main dispatch loop, 10 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:254:send_cluster_connection_details tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-14 08:25:49 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:95:check_cluster_health 2024-09-14 08:25:50 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-14 08:25:50 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-14 08:25:50 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:247:set_db_ingress_address 2024-09-14 08:25:50 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:254:send_cluster_connection_details 2024-09-14 08:25:50 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:488:process_snapd_timer 2024-09-14 08:25:50 INFO unit.etcd/1.juju-log server.go:316 Get config refresh.timer for snap core 2024-09-14 08:25:50 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:18:store_ca 2024-09-14 08:25:50 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:44:store_server 2024-09-14 08:25:50 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-14 08:25:50 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-14 08:25:50 INFO unit.etcd/1.juju-log server.go:316 status-set: active: Healthy with 3 known peers 2024-09-14 08:25:51 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-09-14 08:25:51 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for etcd/1 2024-09-14 08:25:51 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-14 08:25:51 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/1 uniter (run update-status hook) 2024-09-14 08:25:51 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/1 2024-09-14 08:25:51 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-14 08:25:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-14 08:25:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-14 08:25:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/2" already joined relation 0 2024-09-14 08:25:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-14 08:25:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/1" already joined relation 8 2024-09-14 08:25:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 8 2024-09-14 08:30:43 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for etcd/1 2024-09-14 08:30:43 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-14 08:30:43 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-14 08:30:43 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-14 08:30:43 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/2" already joined relation 0 2024-09-14 08:30:43 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-14 08:30:43 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/1" already joined relation 8 2024-09-14 08:30:43 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 8 2024-09-14 08:30:43 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for etcd/1 2024-09-14 08:30:43 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/1 uniter (run update-status hook) 2024-09-14 08:30:44 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/1 uniter (run update-status hook) 2024-09-14 08:30:44 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for etcd/1 2024-09-14 08:30:44 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for etcd/1 2024-09-14 08:30:44 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-1/agent.socket } 2024-09-14 08:30:45 INFO unit.etcd/1.juju-log server.go:316 Reactive main running for hook update-status 2024-09-14 08:30:45 DEBUG unit.etcd/1.juju-log server.go:316 tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:254:send_cluster_connection_details tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-14 08:30:45 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.nagios_context 2024-09-14 08:30:45 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2024-09-14 08:30:45 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.snapd_refresh 2024-09-14 08:30:45 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.snapd_refresh 2024-09-14 08:30:45 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.port 2024-09-14 08:30:45 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.port 2024-09-14 08:30:45 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.management_port 2024-09-14 08:30:45 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.management_port 2024-09-14 08:30:45 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.channel 2024-09-14 08:30:45 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.channel 2024-09-14 08:30:45 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.bind_to_all_interfaces 2024-09-14 08:30:45 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.bind_to_all_interfaces 2024-09-14 08:30:45 INFO unit.etcd/1.juju-log server.go:316 Initializing Leadership Layer (is leader) 2024-09-14 08:30:45 INFO unit.etcd/1.juju-log server.go:316 Initializing Snap Layer 2024-09-14 08:30:45 DEBUG unit.etcd/1.update-status logger.go:60 none 2024-09-14 08:30:45 DEBUG unit.etcd/1.juju-log server.go:316 tracer> tracer: starting handler dispatch, 58 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.batch.cert.available tracer: set flag certificates.ca.available tracer: set flag certificates.certs.available tracer: set flag certificates.client.cert.available tracer: set flag certificates.server.cert.available tracer: set flag certificates.server.certs.available tracer: set flag cluster.joined tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.etcd_0.server.cert tracer: set flag endpoint.certificates.changed.etcd_0.server.key tracer: set flag endpoint.certificates.changed.etcd_1.server.cert tracer: set flag endpoint.certificates.changed.etcd_1.server.key tracer: set flag endpoint.certificates.changed.etcd_2.server.cert tracer: set flag endpoint.certificates.changed.etcd_2.server.key tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.leader.configured tracer: set flag etcd.registered tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag etcd.ssl.placed tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster tracer: set flag leadership.set.leader_address tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca_installed tracer: set flag tls_client.certs.saved tracer: set flag tls_client.client.certificate.saved tracer: set flag tls_client.client.key.saved tracer: set flag tls_client.server.certificate.saved tracer: set flag tls_client.server.key.saved 2024-09-14 08:30:45 DEBUG unit.etcd/1.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-09-14 08:30:45 DEBUG unit.etcd/1.juju-log server.go:316 tracer> tracer: main dispatch loop, 10 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:254:send_cluster_connection_details tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-14 08:30:45 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:95:check_cluster_health 2024-09-14 08:30:45 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-14 08:30:45 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-14 08:30:45 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:247:set_db_ingress_address 2024-09-14 08:30:46 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:254:send_cluster_connection_details 2024-09-14 08:30:46 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:488:process_snapd_timer 2024-09-14 08:30:46 INFO unit.etcd/1.juju-log server.go:316 Get config refresh.timer for snap core 2024-09-14 08:30:46 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:18:store_ca 2024-09-14 08:30:46 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:44:store_server 2024-09-14 08:30:46 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-14 08:30:46 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-14 08:30:46 INFO unit.etcd/1.juju-log server.go:316 status-set: active: Healthy with 3 known peers 2024-09-14 08:30:46 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-09-14 08:30:46 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for etcd/1 2024-09-14 08:30:46 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-14 08:30:46 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/1 uniter (run update-status hook) 2024-09-14 08:30:46 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/1 2024-09-14 08:30:46 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-14 08:30:46 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-14 08:30:46 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/2" already joined relation 0 2024-09-14 08:30:46 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-14 08:30:46 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/1" already joined relation 8 2024-09-14 08:30:46 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 8 2024-09-14 08:30:46 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-14 08:36:37 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for etcd/1 2024-09-14 08:36:37 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-14 08:36:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-14 08:36:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-14 08:36:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/2" already joined relation 0 2024-09-14 08:36:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-14 08:36:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/1" already joined relation 8 2024-09-14 08:36:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 8 2024-09-14 08:36:37 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for etcd/1 2024-09-14 08:36:37 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/1 uniter (run update-status hook) 2024-09-14 08:36:39 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/1 uniter (run update-status hook) 2024-09-14 08:36:39 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for etcd/1 2024-09-14 08:36:39 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for etcd/1 2024-09-14 08:36:39 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-1/agent.socket } 2024-09-14 08:36:39 INFO unit.etcd/1.juju-log server.go:316 Reactive main running for hook update-status 2024-09-14 08:36:39 DEBUG unit.etcd/1.juju-log server.go:316 tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:254:send_cluster_connection_details tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-14 08:36:39 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.nagios_context 2024-09-14 08:36:39 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2024-09-14 08:36:39 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.snapd_refresh 2024-09-14 08:36:39 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.snapd_refresh 2024-09-14 08:36:39 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.port 2024-09-14 08:36:39 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.port 2024-09-14 08:36:39 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.management_port 2024-09-14 08:36:39 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.management_port 2024-09-14 08:36:39 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.channel 2024-09-14 08:36:39 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.channel 2024-09-14 08:36:39 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.bind_to_all_interfaces 2024-09-14 08:36:39 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.bind_to_all_interfaces 2024-09-14 08:36:39 INFO unit.etcd/1.juju-log server.go:316 Initializing Leadership Layer (is leader) 2024-09-14 08:36:39 INFO unit.etcd/1.juju-log server.go:316 Initializing Snap Layer 2024-09-14 08:36:39 DEBUG unit.etcd/1.update-status logger.go:60 none 2024-09-14 08:36:39 DEBUG unit.etcd/1.juju-log server.go:316 tracer> tracer: starting handler dispatch, 58 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.batch.cert.available tracer: set flag certificates.ca.available tracer: set flag certificates.certs.available tracer: set flag certificates.client.cert.available tracer: set flag certificates.server.cert.available tracer: set flag certificates.server.certs.available tracer: set flag cluster.joined tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.etcd_0.server.cert tracer: set flag endpoint.certificates.changed.etcd_0.server.key tracer: set flag endpoint.certificates.changed.etcd_1.server.cert tracer: set flag endpoint.certificates.changed.etcd_1.server.key tracer: set flag endpoint.certificates.changed.etcd_2.server.cert tracer: set flag endpoint.certificates.changed.etcd_2.server.key tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.leader.configured tracer: set flag etcd.registered tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag etcd.ssl.placed tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster tracer: set flag leadership.set.leader_address tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca_installed tracer: set flag tls_client.certs.saved tracer: set flag tls_client.client.certificate.saved tracer: set flag tls_client.client.key.saved tracer: set flag tls_client.server.certificate.saved tracer: set flag tls_client.server.key.saved 2024-09-14 08:36:39 DEBUG unit.etcd/1.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-09-14 08:36:40 DEBUG unit.etcd/1.juju-log server.go:316 tracer> tracer: main dispatch loop, 10 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:254:send_cluster_connection_details tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-14 08:36:40 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:95:check_cluster_health 2024-09-14 08:36:40 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-14 08:36:40 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-14 08:36:41 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:247:set_db_ingress_address 2024-09-14 08:36:41 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:254:send_cluster_connection_details 2024-09-14 08:36:41 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:488:process_snapd_timer 2024-09-14 08:36:41 INFO unit.etcd/1.juju-log server.go:316 Get config refresh.timer for snap core 2024-09-14 08:36:41 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:18:store_ca 2024-09-14 08:36:41 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:44:store_server 2024-09-14 08:36:41 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-14 08:36:41 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-14 08:36:41 INFO unit.etcd/1.juju-log server.go:316 status-set: active: Healthy with 3 known peers 2024-09-14 08:36:43 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-09-14 08:36:43 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for etcd/1 2024-09-14 08:36:43 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-14 08:36:43 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/1 uniter (run update-status hook) 2024-09-14 08:36:43 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/1 2024-09-14 08:36:43 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-14 08:36:43 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-14 08:36:43 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-14 08:36:43 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/2" already joined relation 0 2024-09-14 08:36:43 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-14 08:36:43 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/1" already joined relation 8 2024-09-14 08:36:43 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 8 2024-09-14 08:42:11 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for etcd/1 2024-09-14 08:42:11 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-14 08:42:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-14 08:42:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/1" already joined relation 8 2024-09-14 08:42:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 8 2024-09-14 08:42:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-14 08:42:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-14 08:42:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/2" already joined relation 0 2024-09-14 08:42:11 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for etcd/1 2024-09-14 08:42:11 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/1 uniter (run update-status hook) 2024-09-14 08:42:12 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/1 uniter (run update-status hook) 2024-09-14 08:42:12 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for etcd/1 2024-09-14 08:42:12 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for etcd/1 2024-09-14 08:42:12 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-1/agent.socket } 2024-09-14 08:42:12 INFO unit.etcd/1.juju-log server.go:316 Reactive main running for hook update-status 2024-09-14 08:42:12 DEBUG unit.etcd/1.juju-log server.go:316 tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:254:send_cluster_connection_details tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-14 08:42:12 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.nagios_context 2024-09-14 08:42:12 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2024-09-14 08:42:12 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.snapd_refresh 2024-09-14 08:42:12 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.snapd_refresh 2024-09-14 08:42:12 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.port 2024-09-14 08:42:12 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.port 2024-09-14 08:42:12 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.management_port 2024-09-14 08:42:12 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.management_port 2024-09-14 08:42:12 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.channel 2024-09-14 08:42:12 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.channel 2024-09-14 08:42:12 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.bind_to_all_interfaces 2024-09-14 08:42:12 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.bind_to_all_interfaces 2024-09-14 08:42:12 INFO unit.etcd/1.juju-log server.go:316 Initializing Leadership Layer (is leader) 2024-09-14 08:42:13 INFO unit.etcd/1.juju-log server.go:316 Initializing Snap Layer 2024-09-14 08:42:13 DEBUG unit.etcd/1.update-status logger.go:60 none 2024-09-14 08:42:13 DEBUG unit.etcd/1.juju-log server.go:316 tracer> tracer: starting handler dispatch, 58 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.batch.cert.available tracer: set flag certificates.ca.available tracer: set flag certificates.certs.available tracer: set flag certificates.client.cert.available tracer: set flag certificates.server.cert.available tracer: set flag certificates.server.certs.available tracer: set flag cluster.joined tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.etcd_0.server.cert tracer: set flag endpoint.certificates.changed.etcd_0.server.key tracer: set flag endpoint.certificates.changed.etcd_1.server.cert tracer: set flag endpoint.certificates.changed.etcd_1.server.key tracer: set flag endpoint.certificates.changed.etcd_2.server.cert tracer: set flag endpoint.certificates.changed.etcd_2.server.key tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.leader.configured tracer: set flag etcd.registered tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag etcd.ssl.placed tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster tracer: set flag leadership.set.leader_address tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca_installed tracer: set flag tls_client.certs.saved tracer: set flag tls_client.client.certificate.saved tracer: set flag tls_client.client.key.saved tracer: set flag tls_client.server.certificate.saved tracer: set flag tls_client.server.key.saved 2024-09-14 08:42:13 DEBUG unit.etcd/1.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-09-14 08:42:13 DEBUG unit.etcd/1.juju-log server.go:316 tracer> tracer: main dispatch loop, 10 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:254:send_cluster_connection_details tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-14 08:42:13 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:95:check_cluster_health 2024-09-14 08:42:13 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-14 08:42:13 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-14 08:42:14 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:247:set_db_ingress_address 2024-09-14 08:42:14 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:254:send_cluster_connection_details 2024-09-14 08:42:14 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:488:process_snapd_timer 2024-09-14 08:42:14 INFO unit.etcd/1.juju-log server.go:316 Get config refresh.timer for snap core 2024-09-14 08:42:14 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:18:store_ca 2024-09-14 08:42:14 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:44:store_server 2024-09-14 08:42:14 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-14 08:42:14 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-14 08:42:14 INFO unit.etcd/1.juju-log server.go:316 status-set: active: Healthy with 3 known peers 2024-09-14 08:42:14 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-09-14 08:42:14 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for etcd/1 2024-09-14 08:42:14 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-14 08:42:14 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/1 uniter (run update-status hook) 2024-09-14 08:42:14 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/1 2024-09-14 08:42:14 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-14 08:42:14 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-14 08:42:14 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/1" already joined relation 8 2024-09-14 08:42:14 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 8 2024-09-14 08:42:14 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-14 08:42:14 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-14 08:42:14 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/2" already joined relation 0 2024-09-14 08:46:22 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for etcd/1 2024-09-14 08:46:22 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-14 08:46:22 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10 2024-09-14 08:46:22 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-14 08:46:22 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/2" already joined relation 0 2024-09-14 08:46:22 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-14 08:46:22 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/1" already joined relation 8 2024-09-14 08:46:22 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 8 2024-09-14 08:46:22 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for etcd/1 2024-09-14 08:46:22 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for etcd/1 uniter (run update-status hook) 2024-09-14 08:46:23 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for etcd/1 uniter (run update-status hook) 2024-09-14 08:46:23 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for etcd/1 2024-09-14 08:46:23 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for etcd/1 2024-09-14 08:46:23 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-etcd-1/agent.socket } 2024-09-14 08:46:23 INFO unit.etcd/1.juju-log server.go:316 Reactive main running for hook update-status 2024-09-14 08:46:23 DEBUG unit.etcd/1.juju-log server.go:316 tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:254:send_cluster_connection_details tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-14 08:46:23 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.nagios_context 2024-09-14 08:46:23 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2024-09-14 08:46:23 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.snapd_refresh 2024-09-14 08:46:23 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.snapd_refresh 2024-09-14 08:46:24 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.port 2024-09-14 08:46:24 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.port 2024-09-14 08:46:24 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.management_port 2024-09-14 08:46:24 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.management_port 2024-09-14 08:46:24 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.channel 2024-09-14 08:46:24 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.channel 2024-09-14 08:46:24 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.set.bind_to_all_interfaces 2024-09-14 08:46:24 DEBUG unit.etcd/1.juju-log server.go:316 tracer: set flag config.default.bind_to_all_interfaces 2024-09-14 08:46:24 INFO unit.etcd/1.juju-log server.go:316 Initializing Leadership Layer (is leader) 2024-09-14 08:46:24 INFO unit.etcd/1.juju-log server.go:316 Initializing Snap Layer 2024-09-14 08:46:24 DEBUG unit.etcd/1.update-status logger.go:60 none 2024-09-14 08:46:24 DEBUG unit.etcd/1.juju-log server.go:316 tracer> tracer: starting handler dispatch, 58 flags set tracer: set flag cdk-service-kicker.installed tracer: set flag certificates.available tracer: set flag certificates.batch.cert.available tracer: set flag certificates.ca.available tracer: set flag certificates.certs.available tracer: set flag certificates.client.cert.available tracer: set flag certificates.server.cert.available tracer: set flag certificates.server.certs.available tracer: set flag cluster.joined tracer: set flag config.default.bind_to_all_interfaces tracer: set flag config.default.channel tracer: set flag config.default.management_port tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.port tracer: set flag config.default.snapd_refresh tracer: set flag config.set.bind_to_all_interfaces tracer: set flag config.set.channel tracer: set flag config.set.management_port tracer: set flag config.set.nagios_context tracer: set flag config.set.port tracer: set flag config.set.snapd_refresh tracer: set flag db.connected tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.etcd_0.server.cert tracer: set flag endpoint.certificates.changed.etcd_0.server.key tracer: set flag endpoint.certificates.changed.etcd_1.server.cert tracer: set flag endpoint.certificates.changed.etcd_1.server.key tracer: set flag endpoint.certificates.changed.etcd_2.server.cert tracer: set flag endpoint.certificates.changed.etcd_2.server.key tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag etcd.leader.configured tracer: set flag etcd.registered tracer: set flag etcd.service-restart.configured tracer: set flag etcd.ssl.exported tracer: set flag etcd.ssl.placed tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster tracer: set flag leadership.set.leader_address tracer: set flag leadership.set.snapd_refresh tracer: set flag leadership.set.token tracer: set flag snap.installed.core tracer: set flag snap.installed.etcd tracer: set flag snap.refresh.set tracer: set flag snap.refresh.was-set tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca_installed tracer: set flag tls_client.certs.saved tracer: set flag tls_client.client.certificate.saved tracer: set flag tls_client.client.key.saved tracer: set flag tls_client.server.certificate.saved tracer: set flag tls_client.server.key.saved 2024-09-14 08:46:24 DEBUG unit.etcd/1.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-09-14 08:46:24 DEBUG unit.etcd/1.juju-log server.go:316 tracer> tracer: main dispatch loop, 10 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/etcd.py:122:set_app_version tracer: ++ queue handler reactive/etcd.py:136:prepare_tls_certificates tracer: ++ queue handler reactive/etcd.py:247:set_db_ingress_address tracer: ++ queue handler reactive/etcd.py:254:send_cluster_connection_details tracer: ++ queue handler reactive/etcd.py:488:process_snapd_timer tracer: ++ queue handler reactive/etcd.py:95:check_cluster_health tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2024-09-14 08:46:24 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:95:check_cluster_health 2024-09-14 08:46:24 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:122:set_app_version 2024-09-14 08:46:24 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:136:prepare_tls_certificates 2024-09-14 08:46:24 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:247:set_db_ingress_address 2024-09-14 08:46:24 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:254:send_cluster_connection_details 2024-09-14 08:46:25 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/etcd.py:488:process_snapd_timer 2024-09-14 08:46:25 INFO unit.etcd/1.juju-log server.go:316 Get config refresh.timer for snap core 2024-09-14 08:46:25 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:18:store_ca 2024-09-14 08:46:25 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:44:store_server 2024-09-14 08:46:25 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:71:store_client 2024-09-14 08:46:25 INFO unit.etcd/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2024-09-14 08:46:25 INFO unit.etcd/1.juju-log server.go:316 status-set: active: Healthy with 3 known peers 2024-09-14 08:46:25 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-09-14 08:46:25 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for etcd/1 2024-09-14 08:46:25 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-09-14 08:46:25 DEBUG juju.machinelock machinelock.go:186 machine lock released for etcd/1 uniter (run update-status hook) 2024-09-14 08:46:25 DEBUG juju.worker.uniter.operation executor.go:121 lock released for etcd/1 2024-09-14 08:46:25 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-09-14 08:46:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/0" already joined relation 0 2024-09-14 08:46:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "etcd/2" already joined relation 0 2024-09-14 08:46:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/0" already joined relation 8 2024-09-14 08:46:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/1" already joined relation 8 2024-09-14 08:46:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-master/2" already joined relation 8 2024-09-14 08:46:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 10