2024-10-31 00:16:06 INFO juju unit_agent.go:289 Starting unit workers for "mysql-innodb-cluster/2" 2024-10-31 00:16:06 INFO juju.worker.apicaller connect.go:163 [15607c] "unit-mysql-innodb-cluster-2" successfully connected to "10.0.0.17:17070" 2024-10-31 00:16:06 INFO juju.worker.apicaller connect.go:260 [15607c] password changed for "unit-mysql-innodb-cluster-2" 2024-10-31 00:16:06 INFO juju.worker.apicaller connect.go:163 [15607c] "unit-mysql-innodb-cluster-2" successfully connected to "252.17.0.1:17070" 2024-10-31 00:16:06 INFO juju.worker.migrationminion worker.go:142 migration phase is now: NONE 2024-10-31 00:16:06 INFO juju.worker.logger logger.go:120 logger worker started 2024-10-31 00:16:06 DEBUG juju.worker.dependency engine.go:580 "hook-retry-strategy" manifold worker started at 2024-10-31 00:16:06.590130499 +0000 UTC 2024-10-31 00:16:06 DEBUG juju.worker.dependency engine.go:580 "uniter" manifold worker started at 2024-10-31 00:16:06.61369414 +0000 UTC 2024-10-31 00:16:06 DEBUG juju.worker.apiaddressupdater apiaddressupdater.go:98 updating API hostPorts to [[10.0.0.17:17070 252.17.0.1:17070 127.0.0.1:17070 [::1]:17070]] 2024-10-31 00:16:06 INFO juju.worker.upgrader upgrader.go:216 no waiter, upgrader is done 2024-10-31 00:16:06 DEBUG juju.worker.dependency engine.go:603 "upgrader" manifold worker completed successfully 2024-10-31 00:16:07 DEBUG juju.worker.meterstatus connected.go:93 got meter status change signal from watcher 2024-10-31 00:16:07 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for meterstatus (meter-status-changed) 2024-10-31 00:16:07 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for meterstatus (meter-status-changed) 2024-10-31 00:16:07 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 00:16:07 ERROR juju.worker.meterstatus runner.go:93 error running "meter-status-changed": charm missing from disk 2024-10-31 00:16:07 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 00:16:07 DEBUG juju.machinelock machinelock.go:186 machine lock released for meterstatus (meter-status-changed) 2024-10-31 00:16:07 DEBUG juju.worker.uniter uniter.go:883 starting local juju-run listener on {unix /var/lib/juju/agents/unit-mysql-innodb-cluster-2/run.socket } 2024-10-31 00:16:07 INFO juju.worker.uniter uniter.go:335 unit "mysql-innodb-cluster/2" started 2024-10-31 00:16:07 DEBUG juju.worker.uniter runlistener.go:117 juju-run listener running 2024-10-31 00:16:07 INFO juju.worker.uniter uniter.go:651 resuming charm install 2024-10-31 00:16:07 DEBUG juju.worker.uniter uniter.go:601 no lxd profile required for ch:amd64/jammy/mysql-innodb-cluster-153 2024-10-31 00:16:07 DEBUG juju.worker.uniter.operation executor.go:85 running operation install ch:amd64/jammy/mysql-innodb-cluster-153 for mysql-innodb-cluster/2 2024-10-31 00:16:07 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "install ch:amd64/jammy/mysql-innodb-cluster-153" for mysql-innodb-cluster/2 2024-10-31 00:16:07 INFO juju.worker.uniter.charm bundles.go:81 downloading ch:amd64/jammy/mysql-innodb-cluster-153 from API server 2024-10-31 00:16:08 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "install ch:amd64/jammy/mysql-innodb-cluster-153" for mysql-innodb-cluster/2 2024-10-31 00:16:08 DEBUG juju.worker.uniter.charm manifest_deployer.go:143 preparing to deploy charm "ch:amd64/jammy/mysql-innodb-cluster-153" 2024-10-31 00:16:08 DEBUG juju.worker.uniter.charm manifest_deployer.go:132 deploying charm "ch:amd64/jammy/mysql-innodb-cluster-153" 2024-10-31 00:16:12 DEBUG juju.worker.uniter.charm manifest_deployer.go:164 finishing deploy of charm "ch:amd64/jammy/mysql-innodb-cluster-153" 2024-10-31 00:16:12 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "install ch:amd64/jammy/mysql-innodb-cluster-153" for mysql-innodb-cluster/2 2024-10-31 00:16:12 INFO juju.worker.uniter uniter.go:361 hooks are retried true 2024-10-31 00:16:12 DEBUG juju.worker.uniter.remotestate watcher.go:509 got instance data change for mysql-innodb-cluster/2 2024-10-31 00:16:12 DEBUG juju.worker.uniter.remotestate watcher.go:843 LXDProfileName changed to "" 2024-10-31 00:16:12 DEBUG juju.worker.uniter.remotestate watcher.go:595 got action change for mysql-innodb-cluster/2: [] ok=true 2024-10-31 00:16:12 DEBUG juju.worker.uniter.remotestate watcher.go:603 got relations change for mysql-innodb-cluster/2: ok=true 2024-10-31 00:16:12 DEBUG juju.worker.uniter.remotestate watcher.go:489 got unit change for mysql-innodb-cluster/2 2024-10-31 00:16:12 DEBUG juju.worker.uniter.remotestate watcher.go:499 got application change for mysql-innodb-cluster/2 2024-10-31 00:16:12 DEBUG juju.worker.uniter.remotestate watcher.go:542 got config change for mysql-innodb-cluster/2: ok=true, hashes=[16220c72d89b4caf072292fc8a79692b89ee0cd3ccb03f9ea52e6ca7cca5ed2b] 2024-10-31 00:16:12 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for mysql-innodb-cluster/2: ok=true 2024-10-31 00:16:12 DEBUG juju.worker.uniter.remotestate watcher.go:553 got trust config change for mysql-innodb-cluster/2: ok=true, hashes=[aeddf8dcd2b7e0ac0c37321c9d8645dff25799f0d355a7d57fccc94a3c9956b2] 2024-10-31 00:16:12 DEBUG juju.worker.uniter.remotestate watcher.go:564 got upgrade series change 2024-10-31 00:16:12 DEBUG juju.worker.uniter.remotestate watcher.go:714 no upgrade series in progress, reinitializing local upgrade series state 2024-10-31 00:16:12 DEBUG juju.worker.uniter.remotestate watcher.go:613 got storage change for mysql-innodb-cluster/2: [] ok=true 2024-10-31 00:16:12 DEBUG juju.worker.uniter.remotestate watcher.go:623 got update status interval change for mysql-innodb-cluster/2: ok=true 2024-10-31 00:16:12 DEBUG juju.worker.uniter.remotestate watcher.go:574 got address change for mysql-innodb-cluster/2: ok=true, hashes=[7c90ade5ec79ca599927e3ec605ba210cc05047d01c94c2dced434e266005fbf] 2024-10-31 00:16:12 INFO juju.worker.uniter.storage resolver.go:126 initial storage attachments ready 2024-10-31 00:16:12 INFO juju.worker.uniter resolver.go:159 found queued "install" hook 2024-10-31 00:16:12 DEBUG juju.worker.uniter.operation executor.go:85 running operation run install hook for mysql-innodb-cluster/2 2024-10-31 00:16:12 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run install hook) 2024-10-31 00:16:12 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run install hook) 2024-10-31 00:16:12 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run install hook" for mysql-innodb-cluster/2 2024-10-31 00:16:13 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run install hook" for mysql-innodb-cluster/2 2024-10-31 00:16:13 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running install hook 2024-10-31 00:16:13 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 00:16:13 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Running the apt-get install command as .is-git-installed not set 2024-10-31 00:16:15 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Reading package lists... 2024-10-31 00:16:15 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Building dependency tree... 2024-10-31 00:16:15 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Reading state information... 2024-10-31 00:16:16 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 git is already the newest version (1:2.34.1-1ubuntu1.10). 2024-10-31 00:16:16 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 git set to manually installed. 2024-10-31 00:16:16 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 0 upgraded, 0 newly installed, 0 to remove and 0 not upgraded. 2024-10-31 00:16:16 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Reading package lists... 2024-10-31 00:16:16 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Building dependency tree... 2024-10-31 00:16:16 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Reading state information... 2024-10-31 00:16:16 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 python3-yaml is already the newest version (5.4.1-1ubuntu1). 2024-10-31 00:16:16 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 python3-yaml set to manually installed. 2024-10-31 00:16:16 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 python3-setuptools is already the newest version (59.6.0-1.2ubuntu0.22.04.1). 2024-10-31 00:16:16 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 The following additional packages will be installed: 2024-10-31 00:16:16 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 bzip2 cpp cpp-11 dpkg-dev fakeroot fontconfig-config fonts-dejavu-core g++ 2024-10-31 00:16:16 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 g++-11 gcc gcc-11 gcc-11-base javascript-common libalgorithm-diff-perl 2024-10-31 00:16:16 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 libalgorithm-diff-xs-perl libalgorithm-merge-perl libasan6 libatomic1 2024-10-31 00:16:16 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 libc-dev-bin libc-devtools libc6-dev libcc1-0 libcrypt-dev libdeflate0 2024-10-31 00:16:16 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 libdpkg-perl libexpat1-dev libfakeroot libfile-fcntllock-perl libfontconfig1 2024-10-31 00:16:16 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 libfreetype6 libgcc-11-dev libgd3 libgomp1 libisl23 libitm1 libjbig0 2024-10-31 00:16:16 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 libjpeg-turbo8 libjpeg8 libjs-jquery libjs-sphinxdoc libjs-underscore 2024-10-31 00:16:16 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 liblsan0 libmpc3 libnsl-dev libpython3-dev libpython3.10-dev libquadmath0 2024-10-31 00:16:16 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 libstdc++-11-dev libtiff5 libtirpc-dev libtsan0 libubsan1 libwebp7 libxpm4 2024-10-31 00:16:16 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 linux-libc-dev lto-disabled-list make manpages-dev python3.10-dev 2024-10-31 00:16:16 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 rpcsvc-proto zlib1g-dev 2024-10-31 00:16:16 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Suggested packages: 2024-10-31 00:16:16 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 bzip2-doc cpp-doc gcc-11-locales debian-keyring g++-multilib g++-11-multilib 2024-10-31 00:16:16 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 gcc-11-doc gcc-multilib autoconf automake libtool flex bison gdb gcc-doc 2024-10-31 00:16:16 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 gcc-11-multilib apache2 | lighttpd | httpd glibc-doc bzr libgd-tools 2024-10-31 00:16:16 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 libstdc++-11-doc make-doc 2024-10-31 00:16:17 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 The following NEW packages will be installed: 2024-10-31 00:16:17 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 build-essential bzip2 cpp cpp-11 dpkg-dev fakeroot fontconfig-config 2024-10-31 00:16:17 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 fonts-dejavu-core g++ g++-11 gcc gcc-11 gcc-11-base javascript-common 2024-10-31 00:16:17 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 libalgorithm-diff-perl libalgorithm-diff-xs-perl libalgorithm-merge-perl 2024-10-31 00:16:17 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 libasan6 libatomic1 libc-dev-bin libc-devtools libc6-dev libcc1-0 2024-10-31 00:16:17 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 libcrypt-dev libdeflate0 libdpkg-perl libexpat1-dev libfakeroot 2024-10-31 00:16:17 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 libfile-fcntllock-perl libfontconfig1 libfreetype6 libgcc-11-dev libgd3 2024-10-31 00:16:17 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 libgomp1 libisl23 libitm1 libjbig0 libjpeg-turbo8 libjpeg8 libjs-jquery 2024-10-31 00:16:17 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 libjs-sphinxdoc libjs-underscore liblsan0 libmpc3 libnsl-dev libpython3-dev 2024-10-31 00:16:17 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 libpython3.10-dev libquadmath0 libstdc++-11-dev libtiff5 libtirpc-dev 2024-10-31 00:16:17 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 libtsan0 libubsan1 libwebp7 libxpm4 linux-libc-dev lto-disabled-list make 2024-10-31 00:16:17 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 manpages-dev python3-dev python3-pip python3-wheel python3.10-dev 2024-10-31 00:16:17 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 rpcsvc-proto zlib1g-dev 2024-10-31 00:16:17 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 0 upgraded, 65 newly installed, 0 to remove and 0 not upgraded. 2024-10-31 00:16:17 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Need to get 71.7 MB of archives. 2024-10-31 00:16:17 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 After this operation, 240 MB of additional disk space will be used. 2024-10-31 00:16:17 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Get:1 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/main amd64 libc-dev-bin amd64 2.35-0ubuntu3.7 [20.3 kB] 2024-10-31 00:16:17 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Get:2 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-libc-dev amd64 5.15.0-105.115 [1330 kB] 2024-10-31 00:16:17 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Get:3 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 libcrypt-dev amd64 1:4.4.27-1 [112 kB] 2024-10-31 00:16:17 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Get:4 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 rpcsvc-proto amd64 1.4.2-0ubuntu6 [68.5 kB] 2024-10-31 00:16:17 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Get:5 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/main amd64 libtirpc-dev amd64 1.3.2-2ubuntu0.1 [192 kB] 2024-10-31 00:16:17 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Get:6 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 libnsl-dev amd64 1.3.0-2build2 [71.3 kB] 2024-10-31 00:16:17 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Get:7 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/main amd64 libc6-dev amd64 2.35-0ubuntu3.7 [2100 kB] 2024-10-31 00:16:17 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Get:8 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/main amd64 gcc-11-base amd64 11.4.0-1ubuntu1~22.04 [20.2 kB] 2024-10-31 00:16:17 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Get:9 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 libisl23 amd64 0.24-2build1 [727 kB] 2024-10-31 00:16:17 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Get:10 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 libmpc3 amd64 1.2.1-2build1 [46.9 kB] 2024-10-31 00:16:17 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Get:11 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/main amd64 cpp-11 amd64 11.4.0-1ubuntu1~22.04 [10.0 MB] 2024-10-31 00:16:17 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Get:12 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 cpp amd64 4:11.2.0-1ubuntu1 [27.7 kB] 2024-10-31 00:16:17 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Get:13 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/main amd64 libcc1-0 amd64 12.3.0-1ubuntu1~22.04 [48.3 kB] 2024-10-31 00:16:17 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Get:14 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgomp1 amd64 12.3.0-1ubuntu1~22.04 [126 kB] 2024-10-31 00:16:17 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Get:15 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/main amd64 libitm1 amd64 12.3.0-1ubuntu1~22.04 [30.2 kB] 2024-10-31 00:16:17 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Get:16 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/main amd64 libatomic1 amd64 12.3.0-1ubuntu1~22.04 [10.4 kB] 2024-10-31 00:16:17 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Get:17 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/main amd64 libasan6 amd64 11.4.0-1ubuntu1~22.04 [2282 kB] 2024-10-31 00:16:17 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Get:18 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/main amd64 liblsan0 amd64 12.3.0-1ubuntu1~22.04 [1069 kB] 2024-10-31 00:16:17 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Get:19 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/main amd64 libtsan0 amd64 11.4.0-1ubuntu1~22.04 [2260 kB] 2024-10-31 00:16:17 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Get:20 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/main amd64 libubsan1 amd64 12.3.0-1ubuntu1~22.04 [976 kB] 2024-10-31 00:16:17 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Get:21 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/main amd64 libquadmath0 amd64 12.3.0-1ubuntu1~22.04 [154 kB] 2024-10-31 00:16:17 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Get:22 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgcc-11-dev amd64 11.4.0-1ubuntu1~22.04 [2517 kB] 2024-10-31 00:16:17 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Get:23 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/main amd64 gcc-11 amd64 11.4.0-1ubuntu1~22.04 [20.1 MB] 2024-10-31 00:16:18 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Get:24 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 gcc amd64 4:11.2.0-1ubuntu1 [5112 B] 2024-10-31 00:16:18 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Get:25 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/main amd64 libstdc++-11-dev amd64 11.4.0-1ubuntu1~22.04 [2101 kB] 2024-10-31 00:16:18 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Get:26 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/main amd64 g++-11 amd64 11.4.0-1ubuntu1~22.04 [11.4 MB] 2024-10-31 00:16:18 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Get:27 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 g++ amd64 4:11.2.0-1ubuntu1 [1412 B] 2024-10-31 00:16:18 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Get:28 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 make amd64 4.3-4.1build1 [180 kB] 2024-10-31 00:16:18 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Get:29 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/main amd64 libdpkg-perl all 1.21.1ubuntu2.3 [237 kB] 2024-10-31 00:16:18 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Get:30 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 bzip2 amd64 1.0.8-5build1 [34.8 kB] 2024-10-31 00:16:18 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Get:31 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 lto-disabled-list all 24 [12.5 kB] 2024-10-31 00:16:18 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Get:32 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/main amd64 dpkg-dev all 1.21.1ubuntu2.3 [922 kB] 2024-10-31 00:16:18 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Get:33 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 build-essential amd64 12.9ubuntu3 [4744 B] 2024-10-31 00:16:18 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Get:34 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 libfakeroot amd64 1.28-1ubuntu1 [31.5 kB] 2024-10-31 00:16:18 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Get:35 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 fakeroot amd64 1.28-1ubuntu1 [60.4 kB] 2024-10-31 00:16:18 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Get:36 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 fonts-dejavu-core all 2.37-2build1 [1041 kB] 2024-10-31 00:16:18 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Get:37 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 fontconfig-config all 2.13.1-4.2ubuntu5 [29.1 kB] 2024-10-31 00:16:18 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Get:38 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 javascript-common all 11+nmu1 [5936 B] 2024-10-31 00:16:18 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Get:39 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 libalgorithm-diff-perl all 1.201-1 [41.8 kB] 2024-10-31 00:16:18 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Get:40 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 libalgorithm-diff-xs-perl amd64 0.04-6build3 [11.9 kB] 2024-10-31 00:16:18 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Get:41 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 libalgorithm-merge-perl all 0.08-3 [12.0 kB] 2024-10-31 00:16:18 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Get:42 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/main amd64 libfreetype6 amd64 2.11.1+dfsg-1ubuntu0.2 [389 kB] 2024-10-31 00:16:18 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Get:43 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 libfontconfig1 amd64 2.13.1-4.2ubuntu5 [131 kB] 2024-10-31 00:16:18 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Get:44 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 libjpeg-turbo8 amd64 2.1.2-0ubuntu1 [134 kB] 2024-10-31 00:16:18 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Get:45 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 libjpeg8 amd64 8c-2ubuntu10 [2264 B] 2024-10-31 00:16:18 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Get:46 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 libdeflate0 amd64 1.10-2 [70.9 kB] 2024-10-31 00:16:18 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Get:47 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/main amd64 libjbig0 amd64 2.1-3.1ubuntu0.22.04.1 [29.2 kB] 2024-10-31 00:16:18 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Get:48 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/main amd64 libwebp7 amd64 1.2.2-2ubuntu0.22.04.2 [206 kB] 2024-10-31 00:16:18 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Get:49 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/main amd64 libtiff5 amd64 4.3.0-6ubuntu0.8 [185 kB] 2024-10-31 00:16:18 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Get:50 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/main amd64 libxpm4 amd64 1:3.5.12-1ubuntu0.22.04.2 [36.7 kB] 2024-10-31 00:16:18 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Get:51 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 libgd3 amd64 2.3.0-2ubuntu2 [129 kB] 2024-10-31 00:16:18 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Get:52 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/main amd64 libc-devtools amd64 2.35-0ubuntu3.7 [29.0 kB] 2024-10-31 00:16:18 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Get:53 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/main amd64 libexpat1-dev amd64 2.4.7-1ubuntu0.3 [147 kB] 2024-10-31 00:16:18 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Get:54 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 libfile-fcntllock-perl amd64 0.22-3build7 [33.9 kB] 2024-10-31 00:16:18 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Get:55 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 libjs-jquery all 3.6.0+dfsg+~3.5.13-1 [321 kB] 2024-10-31 00:16:18 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Get:56 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 libjs-underscore all 1.13.2~dfsg-2 [118 kB] 2024-10-31 00:16:18 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Get:57 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 libjs-sphinxdoc all 4.3.2-1 [139 kB] 2024-10-31 00:16:18 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Get:58 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/main amd64 zlib1g-dev amd64 1:1.2.11.dfsg-2ubuntu9.2 [164 kB] 2024-10-31 00:16:18 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Get:59 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpython3.10-dev amd64 3.10.12-1~22.04.3 [4762 kB] 2024-10-31 00:16:18 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Get:60 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpython3-dev amd64 3.10.6-1~22.04 [7166 B] 2024-10-31 00:16:18 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Get:61 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 manpages-dev all 5.10-1ubuntu1 [2309 kB] 2024-10-31 00:16:18 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Get:62 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3.10-dev amd64 3.10.12-1~22.04.3 [507 kB] 2024-10-31 00:16:18 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Get:63 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-dev amd64 3.10.6-1~22.04 [26.0 kB] 2024-10-31 00:16:18 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Get:64 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/universe amd64 python3-wheel all 0.37.1-2ubuntu0.22.04.1 [32.0 kB] 2024-10-31 00:16:18 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Get:65 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/universe amd64 python3-pip all 22.0.2+dfsg-1ubuntu0.4 [1305 kB] 2024-10-31 00:16:19 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Fetched 71.7 MB in 2s (41.0 MB/s) 2024-10-31 00:16:19 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Selecting previously unselected package libc-dev-bin. 2024-10-31 00:16:19 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 34022 files and directories currently installed.) 2024-10-31 00:16:19 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing to unpack .../00-libc-dev-bin_2.35-0ubuntu3.7_amd64.deb ... 2024-10-31 00:16:19 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Unpacking libc-dev-bin (2.35-0ubuntu3.7) ... 2024-10-31 00:16:19 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Selecting previously unselected package linux-libc-dev:amd64. 2024-10-31 00:16:19 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing to unpack .../01-linux-libc-dev_5.15.0-105.115_amd64.deb ... 2024-10-31 00:16:19 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Unpacking linux-libc-dev:amd64 (5.15.0-105.115) ... 2024-10-31 00:16:22 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Selecting previously unselected package libcrypt-dev:amd64. 2024-10-31 00:16:22 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing to unpack .../02-libcrypt-dev_1%3a4.4.27-1_amd64.deb ... 2024-10-31 00:16:22 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Unpacking libcrypt-dev:amd64 (1:4.4.27-1) ... 2024-10-31 00:16:22 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Selecting previously unselected package rpcsvc-proto. 2024-10-31 00:16:22 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing to unpack .../03-rpcsvc-proto_1.4.2-0ubuntu6_amd64.deb ... 2024-10-31 00:16:22 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Unpacking rpcsvc-proto (1.4.2-0ubuntu6) ... 2024-10-31 00:16:22 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Selecting previously unselected package libtirpc-dev:amd64. 2024-10-31 00:16:22 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing to unpack .../04-libtirpc-dev_1.3.2-2ubuntu0.1_amd64.deb ... 2024-10-31 00:16:22 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Unpacking libtirpc-dev:amd64 (1.3.2-2ubuntu0.1) ... 2024-10-31 00:16:23 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Selecting previously unselected package libnsl-dev:amd64. 2024-10-31 00:16:23 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing to unpack .../05-libnsl-dev_1.3.0-2build2_amd64.deb ... 2024-10-31 00:16:23 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Unpacking libnsl-dev:amd64 (1.3.0-2build2) ... 2024-10-31 00:16:23 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Selecting previously unselected package libc6-dev:amd64. 2024-10-31 00:16:23 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing to unpack .../06-libc6-dev_2.35-0ubuntu3.7_amd64.deb ... 2024-10-31 00:16:23 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Unpacking libc6-dev:amd64 (2.35-0ubuntu3.7) ... 2024-10-31 00:16:24 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Selecting previously unselected package gcc-11-base:amd64. 2024-10-31 00:16:24 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing to unpack .../07-gcc-11-base_11.4.0-1ubuntu1~22.04_amd64.deb ... 2024-10-31 00:16:24 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Unpacking gcc-11-base:amd64 (11.4.0-1ubuntu1~22.04) ... 2024-10-31 00:16:24 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Selecting previously unselected package libisl23:amd64. 2024-10-31 00:16:24 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing to unpack .../08-libisl23_0.24-2build1_amd64.deb ... 2024-10-31 00:16:25 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Unpacking libisl23:amd64 (0.24-2build1) ... 2024-10-31 00:16:25 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Selecting previously unselected package libmpc3:amd64. 2024-10-31 00:16:25 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing to unpack .../09-libmpc3_1.2.1-2build1_amd64.deb ... 2024-10-31 00:16:25 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Unpacking libmpc3:amd64 (1.2.1-2build1) ... 2024-10-31 00:16:25 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Selecting previously unselected package cpp-11. 2024-10-31 00:16:25 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing to unpack .../10-cpp-11_11.4.0-1ubuntu1~22.04_amd64.deb ... 2024-10-31 00:16:25 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Unpacking cpp-11 (11.4.0-1ubuntu1~22.04) ... 2024-10-31 00:16:26 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Selecting previously unselected package cpp. 2024-10-31 00:16:26 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing to unpack .../11-cpp_4%3a11.2.0-1ubuntu1_amd64.deb ... 2024-10-31 00:16:26 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Unpacking cpp (4:11.2.0-1ubuntu1) ... 2024-10-31 00:16:26 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Selecting previously unselected package libcc1-0:amd64. 2024-10-31 00:16:26 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing to unpack .../12-libcc1-0_12.3.0-1ubuntu1~22.04_amd64.deb ... 2024-10-31 00:16:26 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Unpacking libcc1-0:amd64 (12.3.0-1ubuntu1~22.04) ... 2024-10-31 00:16:26 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Selecting previously unselected package libgomp1:amd64. 2024-10-31 00:16:26 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing to unpack .../13-libgomp1_12.3.0-1ubuntu1~22.04_amd64.deb ... 2024-10-31 00:16:26 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Unpacking libgomp1:amd64 (12.3.0-1ubuntu1~22.04) ... 2024-10-31 00:16:26 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Selecting previously unselected package libitm1:amd64. 2024-10-31 00:16:26 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing to unpack .../14-libitm1_12.3.0-1ubuntu1~22.04_amd64.deb ... 2024-10-31 00:16:26 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Unpacking libitm1:amd64 (12.3.0-1ubuntu1~22.04) ... 2024-10-31 00:16:26 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Selecting previously unselected package libatomic1:amd64. 2024-10-31 00:16:26 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing to unpack .../15-libatomic1_12.3.0-1ubuntu1~22.04_amd64.deb ... 2024-10-31 00:16:26 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Unpacking libatomic1:amd64 (12.3.0-1ubuntu1~22.04) ... 2024-10-31 00:16:27 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Selecting previously unselected package libasan6:amd64. 2024-10-31 00:16:27 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing to unpack .../16-libasan6_11.4.0-1ubuntu1~22.04_amd64.deb ... 2024-10-31 00:16:27 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Unpacking libasan6:amd64 (11.4.0-1ubuntu1~22.04) ... 2024-10-31 00:16:27 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Selecting previously unselected package liblsan0:amd64. 2024-10-31 00:16:27 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing to unpack .../17-liblsan0_12.3.0-1ubuntu1~22.04_amd64.deb ... 2024-10-31 00:16:27 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Unpacking liblsan0:amd64 (12.3.0-1ubuntu1~22.04) ... 2024-10-31 00:16:29 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Selecting previously unselected package libtsan0:amd64. 2024-10-31 00:16:29 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing to unpack .../18-libtsan0_11.4.0-1ubuntu1~22.04_amd64.deb ... 2024-10-31 00:16:29 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Unpacking libtsan0:amd64 (11.4.0-1ubuntu1~22.04) ... 2024-10-31 00:16:29 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Selecting previously unselected package libubsan1:amd64. 2024-10-31 00:16:29 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing to unpack .../19-libubsan1_12.3.0-1ubuntu1~22.04_amd64.deb ... 2024-10-31 00:16:29 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Unpacking libubsan1:amd64 (12.3.0-1ubuntu1~22.04) ... 2024-10-31 00:16:29 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Selecting previously unselected package libquadmath0:amd64. 2024-10-31 00:16:29 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing to unpack .../20-libquadmath0_12.3.0-1ubuntu1~22.04_amd64.deb ... 2024-10-31 00:16:29 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Unpacking libquadmath0:amd64 (12.3.0-1ubuntu1~22.04) ... 2024-10-31 00:16:30 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Selecting previously unselected package libgcc-11-dev:amd64. 2024-10-31 00:16:30 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing to unpack .../21-libgcc-11-dev_11.4.0-1ubuntu1~22.04_amd64.deb ... 2024-10-31 00:16:30 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Unpacking libgcc-11-dev:amd64 (11.4.0-1ubuntu1~22.04) ... 2024-10-31 00:16:30 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Selecting previously unselected package gcc-11. 2024-10-31 00:16:30 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing to unpack .../22-gcc-11_11.4.0-1ubuntu1~22.04_amd64.deb ... 2024-10-31 00:16:30 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Unpacking gcc-11 (11.4.0-1ubuntu1~22.04) ... 2024-10-31 00:16:31 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Selecting previously unselected package gcc. 2024-10-31 00:16:31 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing to unpack .../23-gcc_4%3a11.2.0-1ubuntu1_amd64.deb ... 2024-10-31 00:16:31 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Unpacking gcc (4:11.2.0-1ubuntu1) ... 2024-10-31 00:16:31 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Selecting previously unselected package libstdc++-11-dev:amd64. 2024-10-31 00:16:31 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing to unpack .../24-libstdc++-11-dev_11.4.0-1ubuntu1~22.04_amd64.deb ... 2024-10-31 00:16:32 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Unpacking libstdc++-11-dev:amd64 (11.4.0-1ubuntu1~22.04) ... 2024-10-31 00:16:33 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Selecting previously unselected package g++-11. 2024-10-31 00:16:33 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing to unpack .../25-g++-11_11.4.0-1ubuntu1~22.04_amd64.deb ... 2024-10-31 00:16:33 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Unpacking g++-11 (11.4.0-1ubuntu1~22.04) ... 2024-10-31 00:16:35 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Selecting previously unselected package g++. 2024-10-31 00:16:35 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing to unpack .../26-g++_4%3a11.2.0-1ubuntu1_amd64.deb ... 2024-10-31 00:16:35 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Unpacking g++ (4:11.2.0-1ubuntu1) ... 2024-10-31 00:16:35 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Selecting previously unselected package make. 2024-10-31 00:16:35 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing to unpack .../27-make_4.3-4.1build1_amd64.deb ... 2024-10-31 00:16:35 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Unpacking make (4.3-4.1build1) ... 2024-10-31 00:16:35 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Selecting previously unselected package libdpkg-perl. 2024-10-31 00:16:35 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing to unpack .../28-libdpkg-perl_1.21.1ubuntu2.3_all.deb ... 2024-10-31 00:16:35 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Unpacking libdpkg-perl (1.21.1ubuntu2.3) ... 2024-10-31 00:16:35 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Selecting previously unselected package bzip2. 2024-10-31 00:16:35 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing to unpack .../29-bzip2_1.0.8-5build1_amd64.deb ... 2024-10-31 00:16:35 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Unpacking bzip2 (1.0.8-5build1) ... 2024-10-31 00:16:36 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Selecting previously unselected package lto-disabled-list. 2024-10-31 00:16:36 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing to unpack .../30-lto-disabled-list_24_all.deb ... 2024-10-31 00:16:36 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Unpacking lto-disabled-list (24) ... 2024-10-31 00:16:36 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Selecting previously unselected package dpkg-dev. 2024-10-31 00:16:36 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing to unpack .../31-dpkg-dev_1.21.1ubuntu2.3_all.deb ... 2024-10-31 00:16:36 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Unpacking dpkg-dev (1.21.1ubuntu2.3) ... 2024-10-31 00:16:36 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Selecting previously unselected package build-essential. 2024-10-31 00:16:36 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing to unpack .../32-build-essential_12.9ubuntu3_amd64.deb ... 2024-10-31 00:16:36 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Unpacking build-essential (12.9ubuntu3) ... 2024-10-31 00:16:37 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Selecting previously unselected package libfakeroot:amd64. 2024-10-31 00:16:37 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing to unpack .../33-libfakeroot_1.28-1ubuntu1_amd64.deb ... 2024-10-31 00:16:37 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Unpacking libfakeroot:amd64 (1.28-1ubuntu1) ... 2024-10-31 00:16:37 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Selecting previously unselected package fakeroot. 2024-10-31 00:16:37 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing to unpack .../34-fakeroot_1.28-1ubuntu1_amd64.deb ... 2024-10-31 00:16:37 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Unpacking fakeroot (1.28-1ubuntu1) ... 2024-10-31 00:16:37 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Selecting previously unselected package fonts-dejavu-core. 2024-10-31 00:16:37 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing to unpack .../35-fonts-dejavu-core_2.37-2build1_all.deb ... 2024-10-31 00:16:37 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Unpacking fonts-dejavu-core (2.37-2build1) ... 2024-10-31 00:16:38 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Selecting previously unselected package fontconfig-config. 2024-10-31 00:16:38 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing to unpack .../36-fontconfig-config_2.13.1-4.2ubuntu5_all.deb ... 2024-10-31 00:16:38 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Unpacking fontconfig-config (2.13.1-4.2ubuntu5) ... 2024-10-31 00:16:38 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Selecting previously unselected package javascript-common. 2024-10-31 00:16:38 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing to unpack .../37-javascript-common_11+nmu1_all.deb ... 2024-10-31 00:16:38 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Unpacking javascript-common (11+nmu1) ... 2024-10-31 00:16:38 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Selecting previously unselected package libalgorithm-diff-perl. 2024-10-31 00:16:38 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing to unpack .../38-libalgorithm-diff-perl_1.201-1_all.deb ... 2024-10-31 00:16:38 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Unpacking libalgorithm-diff-perl (1.201-1) ... 2024-10-31 00:16:39 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Selecting previously unselected package libalgorithm-diff-xs-perl. 2024-10-31 00:16:39 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing to unpack .../39-libalgorithm-diff-xs-perl_0.04-6build3_amd64.deb ... 2024-10-31 00:16:39 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Unpacking libalgorithm-diff-xs-perl (0.04-6build3) ... 2024-10-31 00:16:39 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Selecting previously unselected package libalgorithm-merge-perl. 2024-10-31 00:16:39 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing to unpack .../40-libalgorithm-merge-perl_0.08-3_all.deb ... 2024-10-31 00:16:39 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Unpacking libalgorithm-merge-perl (0.08-3) ... 2024-10-31 00:16:39 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Selecting previously unselected package libfreetype6:amd64. 2024-10-31 00:16:39 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing to unpack .../41-libfreetype6_2.11.1+dfsg-1ubuntu0.2_amd64.deb ... 2024-10-31 00:16:39 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Unpacking libfreetype6:amd64 (2.11.1+dfsg-1ubuntu0.2) ... 2024-10-31 00:16:39 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Selecting previously unselected package libfontconfig1:amd64. 2024-10-31 00:16:39 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing to unpack .../42-libfontconfig1_2.13.1-4.2ubuntu5_amd64.deb ... 2024-10-31 00:16:40 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Unpacking libfontconfig1:amd64 (2.13.1-4.2ubuntu5) ... 2024-10-31 00:16:40 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Selecting previously unselected package libjpeg-turbo8:amd64. 2024-10-31 00:16:40 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing to unpack .../43-libjpeg-turbo8_2.1.2-0ubuntu1_amd64.deb ... 2024-10-31 00:16:40 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Unpacking libjpeg-turbo8:amd64 (2.1.2-0ubuntu1) ... 2024-10-31 00:16:40 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Selecting previously unselected package libjpeg8:amd64. 2024-10-31 00:16:40 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing to unpack .../44-libjpeg8_8c-2ubuntu10_amd64.deb ... 2024-10-31 00:16:40 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Unpacking libjpeg8:amd64 (8c-2ubuntu10) ... 2024-10-31 00:16:40 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Selecting previously unselected package libdeflate0:amd64. 2024-10-31 00:16:40 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing to unpack .../45-libdeflate0_1.10-2_amd64.deb ... 2024-10-31 00:16:40 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Unpacking libdeflate0:amd64 (1.10-2) ... 2024-10-31 00:16:40 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Selecting previously unselected package libjbig0:amd64. 2024-10-31 00:16:40 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing to unpack .../46-libjbig0_2.1-3.1ubuntu0.22.04.1_amd64.deb ... 2024-10-31 00:16:40 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Unpacking libjbig0:amd64 (2.1-3.1ubuntu0.22.04.1) ... 2024-10-31 00:16:41 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Selecting previously unselected package libwebp7:amd64. 2024-10-31 00:16:41 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing to unpack .../47-libwebp7_1.2.2-2ubuntu0.22.04.2_amd64.deb ... 2024-10-31 00:16:41 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Unpacking libwebp7:amd64 (1.2.2-2ubuntu0.22.04.2) ... 2024-10-31 00:16:41 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Selecting previously unselected package libtiff5:amd64. 2024-10-31 00:16:41 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing to unpack .../48-libtiff5_4.3.0-6ubuntu0.8_amd64.deb ... 2024-10-31 00:16:41 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Unpacking libtiff5:amd64 (4.3.0-6ubuntu0.8) ... 2024-10-31 00:16:41 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Selecting previously unselected package libxpm4:amd64. 2024-10-31 00:16:41 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing to unpack .../49-libxpm4_1%3a3.5.12-1ubuntu0.22.04.2_amd64.deb ... 2024-10-31 00:16:41 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Unpacking libxpm4:amd64 (1:3.5.12-1ubuntu0.22.04.2) ... 2024-10-31 00:16:41 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Selecting previously unselected package libgd3:amd64. 2024-10-31 00:16:41 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing to unpack .../50-libgd3_2.3.0-2ubuntu2_amd64.deb ... 2024-10-31 00:16:42 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Unpacking libgd3:amd64 (2.3.0-2ubuntu2) ... 2024-10-31 00:16:42 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Selecting previously unselected package libc-devtools. 2024-10-31 00:16:42 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing to unpack .../51-libc-devtools_2.35-0ubuntu3.7_amd64.deb ... 2024-10-31 00:16:42 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Unpacking libc-devtools (2.35-0ubuntu3.7) ... 2024-10-31 00:16:43 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Selecting previously unselected package libexpat1-dev:amd64. 2024-10-31 00:16:43 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing to unpack .../52-libexpat1-dev_2.4.7-1ubuntu0.3_amd64.deb ... 2024-10-31 00:16:43 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Unpacking libexpat1-dev:amd64 (2.4.7-1ubuntu0.3) ... 2024-10-31 00:16:43 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Selecting previously unselected package libfile-fcntllock-perl. 2024-10-31 00:16:43 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing to unpack .../53-libfile-fcntllock-perl_0.22-3build7_amd64.deb ... 2024-10-31 00:16:43 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Unpacking libfile-fcntllock-perl (0.22-3build7) ... 2024-10-31 00:16:43 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Selecting previously unselected package libjs-jquery. 2024-10-31 00:16:43 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing to unpack .../54-libjs-jquery_3.6.0+dfsg+~3.5.13-1_all.deb ... 2024-10-31 00:16:43 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Unpacking libjs-jquery (3.6.0+dfsg+~3.5.13-1) ... 2024-10-31 00:16:43 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Selecting previously unselected package libjs-underscore. 2024-10-31 00:16:43 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing to unpack .../55-libjs-underscore_1.13.2~dfsg-2_all.deb ... 2024-10-31 00:16:43 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Unpacking libjs-underscore (1.13.2~dfsg-2) ... 2024-10-31 00:16:44 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Selecting previously unselected package libjs-sphinxdoc. 2024-10-31 00:16:44 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing to unpack .../56-libjs-sphinxdoc_4.3.2-1_all.deb ... 2024-10-31 00:16:44 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Unpacking libjs-sphinxdoc (4.3.2-1) ... 2024-10-31 00:16:44 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Selecting previously unselected package zlib1g-dev:amd64. 2024-10-31 00:16:44 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing to unpack .../57-zlib1g-dev_1%3a1.2.11.dfsg-2ubuntu9.2_amd64.deb ... 2024-10-31 00:16:44 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Unpacking zlib1g-dev:amd64 (1:1.2.11.dfsg-2ubuntu9.2) ... 2024-10-31 00:16:44 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Selecting previously unselected package libpython3.10-dev:amd64. 2024-10-31 00:16:44 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing to unpack .../58-libpython3.10-dev_3.10.12-1~22.04.3_amd64.deb ... 2024-10-31 00:16:44 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Unpacking libpython3.10-dev:amd64 (3.10.12-1~22.04.3) ... 2024-10-31 00:16:46 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Selecting previously unselected package libpython3-dev:amd64. 2024-10-31 00:16:46 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing to unpack .../59-libpython3-dev_3.10.6-1~22.04_amd64.deb ... 2024-10-31 00:16:46 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Unpacking libpython3-dev:amd64 (3.10.6-1~22.04) ... 2024-10-31 00:16:46 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Selecting previously unselected package manpages-dev. 2024-10-31 00:16:46 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing to unpack .../60-manpages-dev_5.10-1ubuntu1_all.deb ... 2024-10-31 00:16:46 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Unpacking manpages-dev (5.10-1ubuntu1) ... 2024-10-31 00:16:50 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Selecting previously unselected package python3.10-dev. 2024-10-31 00:16:50 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing to unpack .../61-python3.10-dev_3.10.12-1~22.04.3_amd64.deb ... 2024-10-31 00:16:50 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Unpacking python3.10-dev (3.10.12-1~22.04.3) ... 2024-10-31 00:16:50 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Selecting previously unselected package python3-dev. 2024-10-31 00:16:50 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing to unpack .../62-python3-dev_3.10.6-1~22.04_amd64.deb ... 2024-10-31 00:16:50 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Unpacking python3-dev (3.10.6-1~22.04) ... 2024-10-31 00:16:50 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Selecting previously unselected package python3-wheel. 2024-10-31 00:16:50 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing to unpack .../63-python3-wheel_0.37.1-2ubuntu0.22.04.1_all.deb ... 2024-10-31 00:16:50 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Unpacking python3-wheel (0.37.1-2ubuntu0.22.04.1) ... 2024-10-31 00:16:50 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Selecting previously unselected package python3-pip. 2024-10-31 00:16:50 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing to unpack .../64-python3-pip_22.0.2+dfsg-1ubuntu0.4_all.deb ... 2024-10-31 00:16:50 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Unpacking python3-pip (22.0.2+dfsg-1ubuntu0.4) ... 2024-10-31 00:16:52 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Setting up javascript-common (11+nmu1) ... 2024-10-31 00:16:52 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Setting up gcc-11-base:amd64 (11.4.0-1ubuntu1~22.04) ... 2024-10-31 00:16:52 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Setting up manpages-dev (5.10-1ubuntu1) ... 2024-10-31 00:16:52 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Setting up lto-disabled-list (24) ... 2024-10-31 00:16:52 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Setting up libxpm4:amd64 (1:3.5.12-1ubuntu0.22.04.2) ... 2024-10-31 00:16:52 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Setting up libfile-fcntllock-perl (0.22-3build7) ... 2024-10-31 00:16:52 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Setting up libalgorithm-diff-perl (1.201-1) ... 2024-10-31 00:16:52 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Setting up libdeflate0:amd64 (1.10-2) ... 2024-10-31 00:16:52 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Setting up linux-libc-dev:amd64 (5.15.0-105.115) ... 2024-10-31 00:16:52 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Setting up libgomp1:amd64 (12.3.0-1ubuntu1~22.04) ... 2024-10-31 00:16:52 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Setting up bzip2 (1.0.8-5build1) ... 2024-10-31 00:16:53 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Setting up python3-wheel (0.37.1-2ubuntu0.22.04.1) ... 2024-10-31 00:16:53 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Setting up libjbig0:amd64 (2.1-3.1ubuntu0.22.04.1) ... 2024-10-31 00:16:53 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Setting up libfakeroot:amd64 (1.28-1ubuntu1) ... 2024-10-31 00:16:54 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Setting up libasan6:amd64 (11.4.0-1ubuntu1~22.04) ... 2024-10-31 00:16:54 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Setting up fakeroot (1.28-1ubuntu1) ... 2024-10-31 00:16:54 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 update-alternatives: using /usr/bin/fakeroot-sysv to provide /usr/bin/fakeroot (fakeroot) in auto mode 2024-10-31 00:16:54 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Setting up libtirpc-dev:amd64 (1.3.2-2ubuntu0.1) ... 2024-10-31 00:16:54 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Setting up rpcsvc-proto (1.4.2-0ubuntu6) ... 2024-10-31 00:16:55 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Setting up libfreetype6:amd64 (2.11.1+dfsg-1ubuntu0.2) ... 2024-10-31 00:16:55 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Setting up make (4.3-4.1build1) ... 2024-10-31 00:16:56 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Setting up libquadmath0:amd64 (12.3.0-1ubuntu1~22.04) ... 2024-10-31 00:16:57 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Setting up libmpc3:amd64 (1.2.1-2build1) ... 2024-10-31 00:16:57 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Setting up libatomic1:amd64 (12.3.0-1ubuntu1~22.04) ... 2024-10-31 00:16:57 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Setting up fonts-dejavu-core (2.37-2build1) ... 2024-10-31 00:16:58 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Setting up python3-pip (22.0.2+dfsg-1ubuntu0.4) ... 2024-10-31 00:17:02 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Setting up libjpeg-turbo8:amd64 (2.1.2-0ubuntu1) ... 2024-10-31 00:17:02 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Setting up libdpkg-perl (1.21.1ubuntu2.3) ... 2024-10-31 00:17:02 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Setting up libwebp7:amd64 (1.2.2-2ubuntu0.22.04.2) ... 2024-10-31 00:17:02 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Setting up libubsan1:amd64 (12.3.0-1ubuntu1~22.04) ... 2024-10-31 00:17:02 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Setting up libnsl-dev:amd64 (1.3.0-2build2) ... 2024-10-31 00:17:02 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Setting up libcrypt-dev:amd64 (1:4.4.27-1) ... 2024-10-31 00:17:02 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Setting up libjs-jquery (3.6.0+dfsg+~3.5.13-1) ... 2024-10-31 00:17:02 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Setting up libisl23:amd64 (0.24-2build1) ... 2024-10-31 00:17:02 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Setting up libc-dev-bin (2.35-0ubuntu3.7) ... 2024-10-31 00:17:02 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Setting up libalgorithm-diff-xs-perl (0.04-6build3) ... 2024-10-31 00:17:02 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Setting up libcc1-0:amd64 (12.3.0-1ubuntu1~22.04) ... 2024-10-31 00:17:02 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Setting up liblsan0:amd64 (12.3.0-1ubuntu1~22.04) ... 2024-10-31 00:17:03 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Setting up libitm1:amd64 (12.3.0-1ubuntu1~22.04) ... 2024-10-31 00:17:03 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Setting up libjs-underscore (1.13.2~dfsg-2) ... 2024-10-31 00:17:03 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Setting up libalgorithm-merge-perl (0.08-3) ... 2024-10-31 00:17:03 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Setting up libtsan0:amd64 (11.4.0-1ubuntu1~22.04) ... 2024-10-31 00:17:03 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Setting up libjpeg8:amd64 (8c-2ubuntu10) ... 2024-10-31 00:17:03 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Setting up cpp-11 (11.4.0-1ubuntu1~22.04) ... 2024-10-31 00:17:03 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Setting up fontconfig-config (2.13.1-4.2ubuntu5) ... 2024-10-31 00:17:04 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Setting up dpkg-dev (1.21.1ubuntu2.3) ... 2024-10-31 00:17:04 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Setting up libjs-sphinxdoc (4.3.2-1) ... 2024-10-31 00:17:04 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Setting up libgcc-11-dev:amd64 (11.4.0-1ubuntu1~22.04) ... 2024-10-31 00:17:04 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Setting up gcc-11 (11.4.0-1ubuntu1~22.04) ... 2024-10-31 00:17:04 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Setting up cpp (4:11.2.0-1ubuntu1) ... 2024-10-31 00:17:04 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Setting up libc6-dev:amd64 (2.35-0ubuntu3.7) ... 2024-10-31 00:17:04 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Setting up libtiff5:amd64 (4.3.0-6ubuntu0.8) ... 2024-10-31 00:17:04 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Setting up libfontconfig1:amd64 (2.13.1-4.2ubuntu5) ... 2024-10-31 00:17:04 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Setting up gcc (4:11.2.0-1ubuntu1) ... 2024-10-31 00:17:04 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Setting up libexpat1-dev:amd64 (2.4.7-1ubuntu0.3) ... 2024-10-31 00:17:04 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Setting up libgd3:amd64 (2.3.0-2ubuntu2) ... 2024-10-31 00:17:04 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Setting up libstdc++-11-dev:amd64 (11.4.0-1ubuntu1~22.04) ... 2024-10-31 00:17:04 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Setting up zlib1g-dev:amd64 (1:1.2.11.dfsg-2ubuntu9.2) ... 2024-10-31 00:17:05 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Setting up libc-devtools (2.35-0ubuntu3.7) ... 2024-10-31 00:17:05 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Setting up g++-11 (11.4.0-1ubuntu1~22.04) ... 2024-10-31 00:17:05 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Setting up libpython3.10-dev:amd64 (3.10.12-1~22.04.3) ... 2024-10-31 00:17:05 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Setting up python3.10-dev (3.10.12-1~22.04.3) ... 2024-10-31 00:17:05 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Setting up g++ (4:11.2.0-1ubuntu1) ... 2024-10-31 00:17:05 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 update-alternatives: using /usr/bin/g++ to provide /usr/bin/c++ (c++) in auto mode 2024-10-31 00:17:05 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Setting up build-essential (12.9ubuntu3) ... 2024-10-31 00:17:05 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Setting up libpython3-dev:amd64 (3.10.6-1~22.04) ... 2024-10-31 00:17:05 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Setting up python3-dev (3.10.6-1~22.04) ... 2024-10-31 00:17:05 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Processing triggers for man-db (2.10.2-1) ... 2024-10-31 00:17:07 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Processing triggers for libc-bin (2.35-0ubuntu3.7) ... 2024-10-31 00:17:09 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 NEEDRESTART-VER: 3.5 2024-10-31 00:17:12 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Reading package lists... 2024-10-31 00:17:12 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Building dependency tree... 2024-10-31 00:17:12 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Reading state information... 2024-10-31 00:17:12 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 The following additional packages will be installed: 2024-10-31 00:17:12 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 libmysqlclient21 libssl-dev libzstd-dev mysql-common 2024-10-31 00:17:12 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Suggested packages: 2024-10-31 00:17:12 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 libssl-doc 2024-10-31 00:17:12 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 The following NEW packages will be installed: 2024-10-31 00:17:12 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 libmysqlclient-dev libmysqlclient21 libssl-dev libzstd-dev mysql-common 2024-10-31 00:17:12 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 0 upgraded, 5 newly installed, 0 to remove and 0 not upgraded. 2024-10-31 00:17:12 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Need to get 5744 kB of archives. 2024-10-31 00:17:12 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 After this operation, 29.8 MB of additional disk space will be used. 2024-10-31 00:17:12 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Get:1 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 mysql-common all 5.8+1.0.8 [7212 B] 2024-10-31 00:17:12 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Get:2 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmysqlclient21 amd64 8.0.36-0ubuntu0.22.04.1 [1302 kB] 2024-10-31 00:17:12 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Get:3 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2376 kB] 2024-10-31 00:17:12 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Get:4 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 libzstd-dev amd64 1.4.8+dfsg-3build1 [401 kB] 2024-10-31 00:17:12 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Get:5 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmysqlclient-dev amd64 8.0.36-0ubuntu0.22.04.1 [1657 kB] 2024-10-31 00:17:13 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Fetched 5744 kB in 0s (28.9 MB/s) 2024-10-31 00:17:13 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Selecting previously unselected package mysql-common. 2024-10-31 00:17:13 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 40815 files and directories currently installed.) 2024-10-31 00:17:13 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing to unpack .../mysql-common_5.8+1.0.8_all.deb ... 2024-10-31 00:17:13 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Unpacking mysql-common (5.8+1.0.8) ... 2024-10-31 00:17:13 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Selecting previously unselected package libmysqlclient21:amd64. 2024-10-31 00:17:13 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing to unpack .../libmysqlclient21_8.0.36-0ubuntu0.22.04.1_amd64.deb ... 2024-10-31 00:17:14 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Unpacking libmysqlclient21:amd64 (8.0.36-0ubuntu0.22.04.1) ... 2024-10-31 00:17:14 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Selecting previously unselected package libssl-dev:amd64. 2024-10-31 00:17:14 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing to unpack .../libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-10-31 00:17:14 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-10-31 00:17:16 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Selecting previously unselected package libzstd-dev:amd64. 2024-10-31 00:17:16 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing to unpack .../libzstd-dev_1.4.8+dfsg-3build1_amd64.deb ... 2024-10-31 00:17:16 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Unpacking libzstd-dev:amd64 (1.4.8+dfsg-3build1) ... 2024-10-31 00:17:16 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Selecting previously unselected package libmysqlclient-dev. 2024-10-31 00:17:16 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing to unpack .../libmysqlclient-dev_8.0.36-0ubuntu0.22.04.1_amd64.deb ... 2024-10-31 00:17:16 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Unpacking libmysqlclient-dev (8.0.36-0ubuntu0.22.04.1) ... 2024-10-31 00:17:17 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Setting up mysql-common (5.8+1.0.8) ... 2024-10-31 00:17:17 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 update-alternatives: using /etc/mysql/my.cnf.fallback to provide /etc/mysql/my.cnf (my.cnf) in auto mode 2024-10-31 00:17:17 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Setting up libmysqlclient21:amd64 (8.0.36-0ubuntu0.22.04.1) ... 2024-10-31 00:17:17 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Setting up libzstd-dev:amd64 (1.4.8+dfsg-3build1) ... 2024-10-31 00:17:17 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-10-31 00:17:17 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Setting up libmysqlclient-dev (8.0.36-0ubuntu0.22.04.1) ... 2024-10-31 00:17:17 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Processing triggers for man-db (2.10.2-1) ... 2024-10-31 00:17:17 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Processing triggers for libc-bin (2.35-0ubuntu3.7) ... 2024-10-31 00:17:18 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 NEEDRESTART-VER: 3.5 2024-10-31 00:17:20 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Reading package lists... 2024-10-31 00:17:20 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Building dependency tree... 2024-10-31 00:17:20 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Reading state information... 2024-10-31 00:17:21 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 The following additional packages will be installed: 2024-10-31 00:17:21 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 python3-distlib python3-filelock python3-pip-whl python3-platformdirs 2024-10-31 00:17:21 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 python3-setuptools-whl python3-virtualenv python3-wheel-whl 2024-10-31 00:17:21 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Suggested packages: 2024-10-31 00:17:21 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 python2-pip-whl python2-setuptools-whl 2024-10-31 00:17:21 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 The following NEW packages will be installed: 2024-10-31 00:17:21 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 python3-distlib python3-filelock python3-pip-whl python3-platformdirs 2024-10-31 00:17:21 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 python3-setuptools-whl python3-virtualenv python3-wheel-whl virtualenv 2024-10-31 00:17:21 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 0 upgraded, 8 newly installed, 0 to remove and 0 not upgraded. 2024-10-31 00:17:21 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Need to get 2880 kB of archives. 2024-10-31 00:17:21 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 After this operation, 4677 kB of additional disk space will be used. 2024-10-31 00:17:21 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Get:1 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/universe amd64 python3-distlib all 0.3.4-1 [269 kB] 2024-10-31 00:17:21 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Get:2 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/universe amd64 python3-filelock all 3.6.0-1 [8788 B] 2024-10-31 00:17:21 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Get:3 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/universe amd64 python3-pip-whl all 22.0.2+dfsg-1ubuntu0.4 [1680 kB] 2024-10-31 00:17:21 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Get:4 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/universe amd64 python3-platformdirs all 2.5.1-1 [14.2 kB] 2024-10-31 00:17:21 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Get:5 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/universe amd64 python3-setuptools-whl all 59.6.0-1.2ubuntu0.22.04.1 [788 kB] 2024-10-31 00:17:21 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Get:6 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/universe amd64 python3-wheel-whl all 0.37.1-2ubuntu0.22.04.1 [38.0 kB] 2024-10-31 00:17:21 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Get:7 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/universe amd64 python3-virtualenv all 20.13.0+ds-2 [80.3 kB] 2024-10-31 00:17:21 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Get:8 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/universe amd64 virtualenv all 20.13.0+ds-2 [1968 B] 2024-10-31 00:17:21 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Fetched 2880 kB in 0s (28.5 MB/s) 2024-10-31 00:17:21 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Selecting previously unselected package python3-distlib. 2024-10-31 00:17:21 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 41033 files and directories currently installed.) 2024-10-31 00:17:21 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing to unpack .../0-python3-distlib_0.3.4-1_all.deb ... 2024-10-31 00:17:21 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Unpacking python3-distlib (0.3.4-1) ... 2024-10-31 00:17:22 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Selecting previously unselected package python3-filelock. 2024-10-31 00:17:22 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing to unpack .../1-python3-filelock_3.6.0-1_all.deb ... 2024-10-31 00:17:22 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Unpacking python3-filelock (3.6.0-1) ... 2024-10-31 00:17:22 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Selecting previously unselected package python3-pip-whl. 2024-10-31 00:17:22 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing to unpack .../2-python3-pip-whl_22.0.2+dfsg-1ubuntu0.4_all.deb ... 2024-10-31 00:17:22 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Unpacking python3-pip-whl (22.0.2+dfsg-1ubuntu0.4) ... 2024-10-31 00:17:22 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Selecting previously unselected package python3-platformdirs. 2024-10-31 00:17:22 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing to unpack .../3-python3-platformdirs_2.5.1-1_all.deb ... 2024-10-31 00:17:22 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Unpacking python3-platformdirs (2.5.1-1) ... 2024-10-31 00:17:22 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Selecting previously unselected package python3-setuptools-whl. 2024-10-31 00:17:22 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing to unpack .../4-python3-setuptools-whl_59.6.0-1.2ubuntu0.22.04.1_all.deb ... 2024-10-31 00:17:22 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Unpacking python3-setuptools-whl (59.6.0-1.2ubuntu0.22.04.1) ... 2024-10-31 00:17:23 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Selecting previously unselected package python3-wheel-whl. 2024-10-31 00:17:23 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing to unpack .../5-python3-wheel-whl_0.37.1-2ubuntu0.22.04.1_all.deb ... 2024-10-31 00:17:23 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Unpacking python3-wheel-whl (0.37.1-2ubuntu0.22.04.1) ... 2024-10-31 00:17:23 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Selecting previously unselected package python3-virtualenv. 2024-10-31 00:17:23 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing to unpack .../6-python3-virtualenv_20.13.0+ds-2_all.deb ... 2024-10-31 00:17:23 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Unpacking python3-virtualenv (20.13.0+ds-2) ... 2024-10-31 00:17:24 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Selecting previously unselected package virtualenv. 2024-10-31 00:17:24 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing to unpack .../7-virtualenv_20.13.0+ds-2_all.deb ... 2024-10-31 00:17:24 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Unpacking virtualenv (20.13.0+ds-2) ... 2024-10-31 00:17:24 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Setting up python3-setuptools-whl (59.6.0-1.2ubuntu0.22.04.1) ... 2024-10-31 00:17:24 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Setting up python3-filelock (3.6.0-1) ... 2024-10-31 00:17:26 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Setting up python3-pip-whl (22.0.2+dfsg-1ubuntu0.4) ... 2024-10-31 00:17:26 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Setting up python3-distlib (0.3.4-1) ... 2024-10-31 00:17:26 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Setting up python3-platformdirs (2.5.1-1) ... 2024-10-31 00:17:27 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Setting up python3-wheel-whl (0.37.1-2ubuntu0.22.04.1) ... 2024-10-31 00:17:27 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Setting up python3-virtualenv (20.13.0+ds-2) ... 2024-10-31 00:17:28 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Setting up virtualenv (20.13.0+ds-2) ... 2024-10-31 00:17:28 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Processing triggers for man-db (2.10.2-1) ... 2024-10-31 00:17:30 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 NEEDRESTART-VER: 3.5 2024-10-31 00:17:33 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 created virtual environment CPython3.10.12.final.0-64 in 746ms 2024-10-31 00:17:33 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 creator CPython3Posix(dest=/var/lib/juju/agents/unit-mysql-innodb-cluster-2/.venv, clear=False, no_vcs_ignore=False, global=False) 2024-10-31 00:17:33 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 seeder FromAppData(download=False, pip=bundle, setuptools=bundle, wheel=bundle, via=copy, app_data_dir=/root/.local/share/virtualenv) 2024-10-31 00:17:33 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 added seed packages: pip==22.0.2, setuptools==59.6.0, wheel==0.37.1 2024-10-31 00:17:33 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 activators BashActivator,CShellActivator,FishActivator,NushellActivator,PowerShellActivator,PythonActivator 2024-10-31 00:17:38 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Looking in links: wheelhouse 2024-10-31 00:17:38 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Requirement already satisfied: pip in /var/lib/juju/agents/unit-mysql-innodb-cluster-2/.venv/lib/python3.10/site-packages (22.0.2) 2024-10-31 00:17:38 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Processing ./wheelhouse/pip-22.0.4.tar.gz 2024-10-31 00:17:38 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Installing build dependencies: started 2024-10-31 00:17:55 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Installing build dependencies: finished with status 'done' 2024-10-31 00:17:55 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Getting requirements to build wheel: started 2024-10-31 00:17:58 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Getting requirements to build wheel: finished with status 'done' 2024-10-31 00:17:58 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing metadata (pyproject.toml): started 2024-10-31 00:18:00 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing metadata (pyproject.toml): finished with status 'done' 2024-10-31 00:18:00 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Building wheels for collected packages: pip 2024-10-31 00:18:00 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Building wheel for pip (pyproject.toml): started 2024-10-31 00:18:05 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Building wheel for pip (pyproject.toml): finished with status 'done' 2024-10-31 00:18:05 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Created wheel for pip: filename=pip-22.0.4-py3-none-any.whl size=2123598 sha256=19d7c00792ea08f60eed61fd45394329e66b29418ea3e11ff180831fc8af7c77 2024-10-31 00:18:05 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Stored in directory: /root/.cache/pip/wheels/d4/cb/a5/5463224d99e1897299d4a8a1c5c6109ea9b5bfe0cafa78088d 2024-10-31 00:18:05 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Successfully built pip 2024-10-31 00:18:05 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Installing collected packages: pip 2024-10-31 00:18:05 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Attempting uninstall: pip 2024-10-31 00:18:05 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Found existing installation: pip 22.0.2 2024-10-31 00:18:05 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Uninstalling pip-22.0.2: 2024-10-31 00:18:05 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Successfully uninstalled pip-22.0.2 2024-10-31 00:18:10 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Successfully installed pip-22.0.4 2024-10-31 00:18:11 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Looking in links: wheelhouse 2024-10-31 00:18:11 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Requirement already satisfied: setuptools in /var/lib/juju/agents/unit-mysql-innodb-cluster-2/.venv/lib/python3.10/site-packages (59.6.0) 2024-10-31 00:18:11 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Collecting setuptools 2024-10-31 00:18:11 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Using cached setuptools-62.1.0-py3-none-any.whl 2024-10-31 00:18:11 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Installing collected packages: setuptools 2024-10-31 00:18:11 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Attempting uninstall: setuptools 2024-10-31 00:18:11 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Found existing installation: setuptools 59.6.0 2024-10-31 00:18:11 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Uninstalling setuptools-59.6.0: 2024-10-31 00:18:11 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Successfully uninstalled setuptools-59.6.0 2024-10-31 00:18:13 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Successfully installed setuptools-62.1.0 2024-10-31 00:18:14 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Looking in links: wheelhouse 2024-10-31 00:18:14 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Processing ./wheelhouse/setuptools_scm-6.4.2.tar.gz 2024-10-31 00:18:15 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Installing build dependencies: started 2024-10-31 00:18:40 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Installing build dependencies: finished with status 'done' 2024-10-31 00:18:40 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Getting requirements to build wheel: started 2024-10-31 00:18:42 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Getting requirements to build wheel: finished with status 'done' 2024-10-31 00:18:42 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing metadata (pyproject.toml): started 2024-10-31 00:18:43 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing metadata (pyproject.toml): finished with status 'done' 2024-10-31 00:18:43 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Collecting packaging>=20.0 2024-10-31 00:18:43 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Using cached packaging-21.3-py3-none-any.whl 2024-10-31 00:18:44 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Collecting tomli>=1.0.0 2024-10-31 00:18:44 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Using cached tomli-2.0.1-py3-none-any.whl 2024-10-31 00:18:44 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Requirement already satisfied: setuptools in /var/lib/juju/agents/unit-mysql-innodb-cluster-2/.venv/lib/python3.10/site-packages (from setuptools-scm) (62.1.0) 2024-10-31 00:18:44 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Collecting pyparsing!=3.0.5,>=2.0.2 2024-10-31 00:18:44 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Using cached pyparsing-3.0.8-py3-none-any.whl 2024-10-31 00:18:44 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Building wheels for collected packages: setuptools-scm 2024-10-31 00:18:44 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Building wheel for setuptools-scm (pyproject.toml): started 2024-10-31 00:18:46 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Building wheel for setuptools-scm (pyproject.toml): finished with status 'done' 2024-10-31 00:18:46 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Created wheel for setuptools-scm: filename=setuptools_scm-6.4.2-py3-none-any.whl size=37098 sha256=62840d4b1b230d9b8cb5b7de23783bc7cc21bfc464f6e19c46f2427e305ff277 2024-10-31 00:18:46 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Stored in directory: /root/.cache/pip/wheels/6d/e4/a1/5dabc34dd1b46cba0581b7bf6d69602c95bfb18321375026fa 2024-10-31 00:18:46 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Successfully built setuptools-scm 2024-10-31 00:18:46 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Installing collected packages: tomli, pyparsing, packaging, setuptools-scm 2024-10-31 00:18:46 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Successfully installed packaging-21.3 pyparsing-3.0.8 setuptools-scm-6.4.2 tomli-2.0.1 2024-10-31 00:18:47 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Looking in links: wheelhouse 2024-10-31 00:18:47 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Processing ./wheelhouse/wheel-0.37.1.tar.gz 2024-10-31 00:18:47 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing metadata (setup.py): started 2024-10-31 00:18:49 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing metadata (setup.py): finished with status 'done' 2024-10-31 00:18:49 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Processing ./wheelhouse/MarkupSafe-2.1.1.tar.gz 2024-10-31 00:18:49 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing metadata (setup.py): started 2024-10-31 00:18:51 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing metadata (setup.py): finished with status 'done' 2024-10-31 00:18:51 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Building wheels for collected packages: wheel, MarkupSafe 2024-10-31 00:18:51 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Building wheel for wheel (setup.py): started 2024-10-31 00:18:53 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Building wheel for wheel (setup.py): finished with status 'done' 2024-10-31 00:18:53 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Created wheel for wheel: filename=wheel-0.37.1-py2.py3-none-any.whl size=35318 sha256=33814d721449f02294aa8de9623ea1b81ff058811fbae254bffef4cdfdc12a32 2024-10-31 00:18:53 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-vzr34s1x/wheels/c2/07/49/4d1d9150c0eae02b0b5e00eccd89eb170033ffad037ea201f0 2024-10-31 00:18:53 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Building wheel for MarkupSafe (setup.py): started 2024-10-31 00:18:56 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Building wheel for MarkupSafe (setup.py): finished with status 'done' 2024-10-31 00:18:56 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Created wheel for MarkupSafe: filename=MarkupSafe-2.1.1-cp310-cp310-linux_x86_64.whl size=25124 sha256=86ea82938a2b2c8d70301407a812b548c1c6f67c09325ce5d3ec39dec14674b4 2024-10-31 00:18:56 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-vzr34s1x/wheels/c2/8a/28/1a79d81a73ba2d272511614b31aa34352936443dd5d3c5d369 2024-10-31 00:18:56 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Successfully built wheel MarkupSafe 2024-10-31 00:18:56 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Installing collected packages: wheel, MarkupSafe 2024-10-31 00:18:56 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Attempting uninstall: wheel 2024-10-31 00:18:56 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Found existing installation: wheel 0.37.1 2024-10-31 00:18:56 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Uninstalling wheel-0.37.1: 2024-10-31 00:18:56 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Successfully uninstalled wheel-0.37.1 2024-10-31 00:18:56 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Successfully installed MarkupSafe-2.1.1 wheel-0.37.1 2024-10-31 00:18:57 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Looking in links: wheelhouse 2024-10-31 00:18:57 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Processing ./wheelhouse/Tempita-0.4.tar.gz 2024-10-31 00:18:57 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing metadata (setup.py): started 2024-10-31 00:18:59 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing metadata (setup.py): finished with status 'done' 2024-10-31 00:18:59 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Processing ./wheelhouse/Cython-0.29.37.tar.gz 2024-10-31 00:19:00 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing metadata (setup.py): started 2024-10-31 00:19:10 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing metadata (setup.py): finished with status 'done' 2024-10-31 00:19:10 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Processing ./wheelhouse/tomli-2.0.1.tar.gz 2024-10-31 00:19:11 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Installing build dependencies: started 2024-10-31 00:19:13 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Installing build dependencies: finished with status 'done' 2024-10-31 00:19:13 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Getting requirements to build wheel: started 2024-10-31 00:19:14 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Getting requirements to build wheel: finished with status 'done' 2024-10-31 00:19:14 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing metadata (pyproject.toml): started 2024-10-31 00:19:14 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing metadata (pyproject.toml): finished with status 'done' 2024-10-31 00:19:14 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Processing ./wheelhouse/pbr-5.8.1.tar.gz 2024-10-31 00:19:14 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing metadata (setup.py): started 2024-10-31 00:19:17 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing metadata (setup.py): finished with status 'done' 2024-10-31 00:19:17 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Processing ./wheelhouse/netifaces-0.11.0.tar.gz 2024-10-31 00:19:17 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing metadata (setup.py): started 2024-10-31 00:19:18 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing metadata (setup.py): finished with status 'done' 2024-10-31 00:19:18 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Processing ./wheelhouse/tenacity-7.0.0.tar.gz 2024-10-31 00:19:18 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing metadata (setup.py): started 2024-10-31 00:19:20 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing metadata (setup.py): finished with status 'done' 2024-10-31 00:19:20 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Processing ./wheelhouse/charms.reactive-1.5.0.tar.gz 2024-10-31 00:19:20 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing metadata (setup.py): started 2024-10-31 00:19:22 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing metadata (setup.py): finished with status 'done' 2024-10-31 00:19:22 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Processing ./wheelhouse/dnspython-1.16.0.zip 2024-10-31 00:19:22 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing metadata (setup.py): started 2024-10-31 00:19:24 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing metadata (setup.py): finished with status 'done' 2024-10-31 00:19:24 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Processing ./wheelhouse/mysqlclient-2.1.0.tar.gz 2024-10-31 00:19:24 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing metadata (setup.py): started 2024-10-31 00:19:26 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing metadata (setup.py): finished with status 'done' 2024-10-31 00:19:26 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Processing ./wheelhouse/charms.openstack-0.0.1.dev1.zip 2024-10-31 00:19:26 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing metadata (setup.py): started 2024-10-31 00:19:28 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing metadata (setup.py): finished with status 'done' 2024-10-31 00:19:28 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Processing ./wheelhouse/flit_core-3.7.1.tar.gz 2024-10-31 00:19:28 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Getting requirements to build wheel: started 2024-10-31 00:19:28 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Getting requirements to build wheel: finished with status 'done' 2024-10-31 00:19:28 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing metadata (pyproject.toml): started 2024-10-31 00:19:29 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing metadata (pyproject.toml): finished with status 'done' 2024-10-31 00:19:29 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Processing ./wheelhouse/Jinja2-3.1.1.tar.gz 2024-10-31 00:19:29 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing metadata (setup.py): started 2024-10-31 00:19:31 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing metadata (setup.py): finished with status 'done' 2024-10-31 00:19:31 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Processing ./wheelhouse/PyYAML-6.0.1.tar.gz 2024-10-31 00:19:31 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Installing build dependencies: started 2024-10-31 00:20:58 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Installing build dependencies: still running... 2024-10-31 00:21:07 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Installing build dependencies: finished with status 'done' 2024-10-31 00:21:07 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Getting requirements to build wheel: started 2024-10-31 00:21:12 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Getting requirements to build wheel: finished with status 'done' 2024-10-31 00:21:12 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing metadata (pyproject.toml): started 2024-10-31 00:21:14 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing metadata (pyproject.toml): finished with status 'done' 2024-10-31 00:21:14 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Processing ./wheelhouse/six-1.16.0.tar.gz 2024-10-31 00:21:14 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing metadata (setup.py): started 2024-10-31 00:21:16 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing metadata (setup.py): finished with status 'done' 2024-10-31 00:21:16 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Processing ./wheelhouse/packaging-21.3.tar.gz 2024-10-31 00:21:17 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Installing build dependencies: started 2024-10-31 00:21:22 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Installing build dependencies: finished with status 'done' 2024-10-31 00:21:22 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Getting requirements to build wheel: started 2024-10-31 00:21:24 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Getting requirements to build wheel: finished with status 'done' 2024-10-31 00:21:24 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing metadata (pyproject.toml): started 2024-10-31 00:21:27 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing metadata (pyproject.toml): finished with status 'done' 2024-10-31 00:21:27 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Processing ./wheelhouse/netaddr-0.7.19.tar.gz 2024-10-31 00:21:27 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing metadata (setup.py): started 2024-10-31 00:21:29 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing metadata (setup.py): finished with status 'done' 2024-10-31 00:21:29 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Processing ./wheelhouse/charmhelpers-1.1.1.dev44.zip 2024-10-31 00:21:30 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing metadata (setup.py): started 2024-10-31 00:21:42 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing metadata (setup.py): finished with status 'done' 2024-10-31 00:21:42 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Processing ./wheelhouse/pyaml-21.10.1.tar.gz 2024-10-31 00:21:42 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing metadata (setup.py): started 2024-10-31 00:21:44 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing metadata (setup.py): finished with status 'done' 2024-10-31 00:21:44 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Processing ./wheelhouse/pyparsing-3.0.8.tar.gz 2024-10-31 00:21:45 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Installing build dependencies: started 2024-10-31 00:21:47 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for mysql-innodb-cluster/2 2024-10-31 00:21:48 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Installing build dependencies: finished with status 'done' 2024-10-31 00:21:48 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Getting requirements to build wheel: started 2024-10-31 00:21:48 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Getting requirements to build wheel: finished with status 'done' 2024-10-31 00:21:49 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Installing backend dependencies: started 2024-10-31 00:21:52 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Installing backend dependencies: finished with status 'done' 2024-10-31 00:21:52 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing metadata (pyproject.toml): started 2024-10-31 00:21:52 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing metadata (pyproject.toml): finished with status 'done' 2024-10-31 00:21:52 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Processing ./wheelhouse/psutil-5.9.0.tar.gz 2024-10-31 00:21:52 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing metadata (setup.py): started 2024-10-31 00:21:55 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing metadata (setup.py): finished with status 'done' 2024-10-31 00:21:55 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Processing ./wheelhouse/MarkupSafe-2.1.1.tar.gz 2024-10-31 00:21:55 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing metadata (setup.py): started 2024-10-31 00:21:57 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Preparing metadata (setup.py): finished with status 'done' 2024-10-31 00:21:57 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Building wheels for collected packages: Tempita, Cython, tomli, pbr, netifaces, tenacity, charms.reactive, dnspython, mysqlclient, charms.openstack, flit-core, Jinja2, PyYAML, six, packaging, netaddr, charmhelpers, pyaml, pyparsing, psutil, MarkupSafe 2024-10-31 00:21:57 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Building wheel for Tempita (setup.py): started 2024-10-31 00:22:00 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Building wheel for Tempita (setup.py): finished with status 'done' 2024-10-31 00:22:00 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Created wheel for Tempita: filename=Tempita-0.4-py3-none-any.whl size=11794 sha256=a9e06b81ec8ca3fa92c40d615ee9999983fc7c0bccdfea17eb38a4611c2e6681 2024-10-31 00:22:00 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-7e3i7xti/wheels/f4/bc/cd/0a28bacc7c8257d018386dd63746fd337b98937429a98d59f3 2024-10-31 00:22:00 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Building wheel for Cython (setup.py): started 2024-10-31 00:23:04 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Building wheel for Cython (setup.py): still running... 2024-10-31 00:23:26 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Building wheel for Cython (setup.py): finished with status 'done' 2024-10-31 00:23:26 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Created wheel for Cython: filename=Cython-0.29.37-cp310-cp310-linux_x86_64.whl size=4835645 sha256=a5137b38f729d4f8bc4be40628d44b9e77effe5306ea759f8d8b96212b10a274 2024-10-31 00:23:26 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-7e3i7xti/wheels/ed/b4/cb/525b1aa6c438d2490db33c84300513b04e7e3b54571fcbbcd4 2024-10-31 00:23:26 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Building wheel for tomli (pyproject.toml): started 2024-10-31 00:23:27 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Building wheel for tomli (pyproject.toml): finished with status 'done' 2024-10-31 00:23:27 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Created wheel for tomli: filename=tomli-2.0.1-py3-none-any.whl size=12759 sha256=ea938b47d3fc357aff859dd096b47df090e2a49b7637d99c9e37887145c9c9a8 2024-10-31 00:23:27 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-7e3i7xti/wheels/7c/3f/44/1545d1da1f86299daaf659efb5fbf5cd8b33b36f1a5aea3dcd 2024-10-31 00:23:27 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Building wheel for pbr (setup.py): started 2024-10-31 00:23:30 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Building wheel for pbr (setup.py): finished with status 'done' 2024-10-31 00:23:30 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Created wheel for pbr: filename=pbr-5.8.1-py2.py3-none-any.whl size=113061 sha256=b20cd3033c01b14e59f1c3852d2b419f016ac91257e2969cc4acf248d2fcbfee 2024-10-31 00:23:30 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-7e3i7xti/wheels/9a/24/ec/6c5d2b90ef526069035ed308fcc559d01aeb220044463ed30a 2024-10-31 00:23:30 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Building wheel for netifaces (setup.py): started 2024-10-31 00:23:37 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Building wheel for netifaces (setup.py): finished with status 'done' 2024-10-31 00:23:37 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Created wheel for netifaces: filename=netifaces-0.11.0-cp310-cp310-linux_x86_64.whl size=35022 sha256=ef86bbbf1088419ead9438aee42dd32cf3b30d77882b1c2276d92c50be09a895 2024-10-31 00:23:37 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-7e3i7xti/wheels/a3/4a/a1/97d5309b56d824cba1c549de2d57e5cb29098f0b6937ba1b1c 2024-10-31 00:23:37 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Building wheel for tenacity (setup.py): started 2024-10-31 00:23:40 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Building wheel for tenacity (setup.py): finished with status 'done' 2024-10-31 00:23:40 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Created wheel for tenacity: filename=tenacity-7.0.0-py2.py3-none-any.whl size=23320 sha256=c8ecb77b07b6d9949703e39b9907e4e67ad7d9d1668bdb55b27e40f287c367f2 2024-10-31 00:23:40 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-7e3i7xti/wheels/a6/7f/56/021f43e46f1e65c865b44385d5754b4c59aec58685d2ac7119 2024-10-31 00:23:40 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Building wheel for charms.reactive (setup.py): started 2024-10-31 00:23:43 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Building wheel for charms.reactive (setup.py): finished with status 'done' 2024-10-31 00:23:43 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Created wheel for charms.reactive: filename=charms.reactive-1.5.0-py3-none-any.whl size=48112 sha256=fb61ddbaf36a876704576c4c10d714f90460936c66c9f89e10e7c69593934e43 2024-10-31 00:23:43 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-7e3i7xti/wheels/95/20/a0/77d01419bba71e3c6e05c191cfcbecd3cdf4c92d268e29e174 2024-10-31 00:23:43 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Building wheel for dnspython (setup.py): started 2024-10-31 00:23:46 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Building wheel for dnspython (setup.py): finished with status 'done' 2024-10-31 00:23:46 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Created wheel for dnspython: filename=dnspython-1.16.0-py2.py3-none-any.whl size=186988 sha256=04a51ce1061511b5e8dde81c2fe3c03ecced5d438dec716b011db1a7a49f891d 2024-10-31 00:23:46 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-7e3i7xti/wheels/c2/d4/56/305820beb2717aa8d857c6b4c2327070aa50085e4db3c83b6b 2024-10-31 00:23:46 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Building wheel for mysqlclient (setup.py): started 2024-10-31 00:23:50 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Building wheel for mysqlclient (setup.py): finished with status 'done' 2024-10-31 00:23:50 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Created wheel for mysqlclient: filename=mysqlclient-2.1.0-cp310-cp310-linux_x86_64.whl size=104294 sha256=fe0995ee94c67c4c06e7e49cb2b0bfa9e8bd1fc790e0bcdf7ea0af88ff93db97 2024-10-31 00:23:50 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-7e3i7xti/wheels/04/44/e0/361f69d2070bdf11be0aeef7f1926244f92a90a78a9f343414 2024-10-31 00:23:50 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Building wheel for charms.openstack (setup.py): started 2024-10-31 00:23:53 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Building wheel for charms.openstack (setup.py): finished with status 'done' 2024-10-31 00:23:53 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Created wheel for charms.openstack: filename=charms.openstack-0.0.1.dev1-py3-none-any.whl size=108498 sha256=0ead5486189016eafdbc479396fbc3f78a6497648b1d63e0e41fe1e5fcfbfefa 2024-10-31 00:23:53 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-7e3i7xti/wheels/99/8f/0b/798786864275b23d51b1709e28efaa964920f12084ff32b7cd 2024-10-31 00:23:53 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Building wheel for flit-core (pyproject.toml): started 2024-10-31 00:23:54 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Building wheel for flit-core (pyproject.toml): finished with status 'done' 2024-10-31 00:23:54 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Created wheel for flit-core: filename=flit_core-3.7.1-py3-none-any.whl size=60195 sha256=e454fdbf68c7036e1c7435ec7479383f9d9a1650ca5b304feb184eba1efcdcef 2024-10-31 00:23:54 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-7e3i7xti/wheels/b9/08/9c/79aeab5f44c8658b14ec629b8de47340f6136539caf6ca2f67 2024-10-31 00:23:54 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Building wheel for Jinja2 (setup.py): started 2024-10-31 00:23:57 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Building wheel for Jinja2 (setup.py): finished with status 'done' 2024-10-31 00:23:57 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Created wheel for Jinja2: filename=Jinja2-3.1.1-py3-none-any.whl size=132603 sha256=ba6bcc12b7b616ed58677607b85bc97792050c96cd8a83a20525dd681e242ec3 2024-10-31 00:23:57 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-7e3i7xti/wheels/3f/e6/a3/590e7d19e7e5e1af47f807d8a3bc6932569043b0dfd5f7f42b 2024-10-31 00:23:57 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Building wheel for PyYAML (pyproject.toml): started 2024-10-31 00:24:00 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Building wheel for PyYAML (pyproject.toml): finished with status 'done' 2024-10-31 00:24:00 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Created wheel for PyYAML: filename=PyYAML-6.0.1-cp310-cp310-linux_x86_64.whl size=45360 sha256=4041b916ab64b0eb493accf1a32107c5b307e0b4bff79bf636a1ea3d486c80c5 2024-10-31 00:24:00 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-7e3i7xti/wheels/64/bf/e0/9b0e747fc17cba359f0914eb762d47b33a453c8b3587b3947d 2024-10-31 00:24:00 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Building wheel for six (setup.py): started 2024-10-31 00:24:03 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Building wheel for six (setup.py): finished with status 'done' 2024-10-31 00:24:03 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Created wheel for six: filename=six-1.16.0-py2.py3-none-any.whl size=11061 sha256=7d4f153713ec17a5fb7d1e4884e8a6a58e3eb8ee0b24964fa5b24518678e5d0e 2024-10-31 00:24:03 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-7e3i7xti/wheels/25/3c/18/85b4b6552315d5891515213d99b985636da7830aca915d10d6 2024-10-31 00:24:03 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Building wheel for packaging (pyproject.toml): started 2024-10-31 00:24:06 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Building wheel for packaging (pyproject.toml): finished with status 'done' 2024-10-31 00:24:06 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Created wheel for packaging: filename=packaging-21.3-py3-none-any.whl size=40749 sha256=84dcec23824b0809437ebcac445da3c172c1fd99bc5258fd3cfd9a4ddd668ac2 2024-10-31 00:24:06 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-7e3i7xti/wheels/33/b0/87/68bf69a34a8af719208fd999da2ba88d4a12c19e6345638132 2024-10-31 00:24:06 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Building wheel for netaddr (setup.py): started 2024-10-31 00:24:10 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Building wheel for netaddr (setup.py): finished with status 'done' 2024-10-31 00:24:10 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Created wheel for netaddr: filename=netaddr-0.7.19-py3-none-any.whl size=1627931 sha256=19cf8d9b0fe5b8178f1833b58b49180d1b3ff9c847548e11cf59612814cdeff6 2024-10-31 00:24:10 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-7e3i7xti/wheels/ec/1f/04/e537ea58e1399b216e3e835aedc90a6735b607794aed257b18 2024-10-31 00:24:10 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Building wheel for charmhelpers (setup.py): started 2024-10-31 00:24:15 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Building wheel for charmhelpers (setup.py): finished with status 'done' 2024-10-31 00:24:15 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Created wheel for charmhelpers: filename=charmhelpers-1.1.1.dev44-py3-none-any.whl size=415522 sha256=0e9d48d6f51fac7993073407921dd4a57923575c904720648b564237b9a5d8a0 2024-10-31 00:24:15 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-7e3i7xti/wheels/86/22/ea/62a6f7ac60dd15029e7e72ac8c4168ef87bb0b1195e2525a69 2024-10-31 00:24:15 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Building wheel for pyaml (setup.py): started 2024-10-31 00:24:18 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Building wheel for pyaml (setup.py): finished with status 'done' 2024-10-31 00:24:18 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Created wheel for pyaml: filename=pyaml-21.10.1-py2.py3-none-any.whl size=17642 sha256=e42bef4538c2fe6fa601a6e60ae14efd8b1681ace71143c25b1ca71d36f03012 2024-10-31 00:24:18 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-7e3i7xti/wheels/0b/66/3c/289741e8e45d570f310fe30ba5ea25886bd7a71d8f4a4f2fad 2024-10-31 00:24:18 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Building wheel for pyparsing (pyproject.toml): started 2024-10-31 00:24:18 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Building wheel for pyparsing (pyproject.toml): finished with status 'done' 2024-10-31 00:24:18 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Created wheel for pyparsing: filename=pyparsing-3.0.8-py3-none-any.whl size=98502 sha256=b850c29c308b5e6e9d94520a175c37dfbf2b9b067afe37c899518f00a4cb90c1 2024-10-31 00:24:18 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-7e3i7xti/wheels/6a/0f/a3/86e76df27e5312564901751ae66e4eae8e19cc8e45f7dedfc6 2024-10-31 00:24:18 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Building wheel for psutil (setup.py): started 2024-10-31 00:24:24 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Building wheel for psutil (setup.py): finished with status 'done' 2024-10-31 00:24:24 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Created wheel for psutil: filename=psutil-5.9.0-cp310-cp310-linux_x86_64.whl size=283003 sha256=84c5f14081691dbafe23528ca140464aa42cd2ba2a4897680c1de7086fa5858a 2024-10-31 00:24:24 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-7e3i7xti/wheels/84/b2/2a/238f132109587e8016dca00dd6eca0d64d2006a23202a86093 2024-10-31 00:24:24 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Building wheel for MarkupSafe (setup.py): started 2024-10-31 00:24:27 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Building wheel for MarkupSafe (setup.py): finished with status 'done' 2024-10-31 00:24:27 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Created wheel for MarkupSafe: filename=MarkupSafe-2.1.1-cp310-cp310-linux_x86_64.whl size=25122 sha256=b9316a465318b53631035fbbff138eae126e585f514d49fc14c3382ae5fa172c 2024-10-31 00:24:27 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-7e3i7xti/wheels/c2/8a/28/1a79d81a73ba2d272511614b31aa34352936443dd5d3c5d369 2024-10-31 00:24:27 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Successfully built Tempita Cython tomli pbr netifaces tenacity charms.reactive dnspython mysqlclient charms.openstack flit-core Jinja2 PyYAML six packaging netaddr charmhelpers pyaml pyparsing psutil MarkupSafe 2024-10-31 00:24:27 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Installing collected packages: Tempita, netifaces, netaddr, charms.openstack, tomli, six, PyYAML, pyparsing, psutil, pbr, mysqlclient, MarkupSafe, flit-core, dnspython, Cython, tenacity, pyaml, packaging, Jinja2, charmhelpers, charms.reactive 2024-10-31 00:24:27 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Attempting uninstall: tomli 2024-10-31 00:24:27 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Found existing installation: tomli 2.0.1 2024-10-31 00:24:27 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Uninstalling tomli-2.0.1: 2024-10-31 00:24:27 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Successfully uninstalled tomli-2.0.1 2024-10-31 00:24:27 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Attempting uninstall: pyparsing 2024-10-31 00:24:27 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Found existing installation: pyparsing 3.0.8 2024-10-31 00:24:27 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Uninstalling pyparsing-3.0.8: 2024-10-31 00:24:27 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Successfully uninstalled pyparsing-3.0.8 2024-10-31 00:24:28 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Attempting uninstall: MarkupSafe 2024-10-31 00:24:28 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Found existing installation: MarkupSafe 2.1.1 2024-10-31 00:24:28 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Uninstalling MarkupSafe-2.1.1: 2024-10-31 00:24:28 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Successfully uninstalled MarkupSafe-2.1.1 2024-10-31 00:24:30 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Attempting uninstall: packaging 2024-10-31 00:24:30 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Found existing installation: packaging 21.3 2024-10-31 00:24:30 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Uninstalling packaging-21.3: 2024-10-31 00:24:30 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Successfully uninstalled packaging-21.3 2024-10-31 00:24:32 DEBUG unit.mysql-innodb-cluster/2.install logger.go:60 Successfully installed Cython-0.29.37 Jinja2-3.1.1 MarkupSafe-2.1.1 PyYAML-6.0.1 Tempita-0.4 charmhelpers-1.1.1.dev44 charms.openstack-0.0.1.dev1 charms.reactive-1.5.0 dnspython-1.16.0 flit-core-3.7.1 mysqlclient-2.1.0 netaddr-0.7.19 netifaces-0.11.0 packaging-21.3 pbr-5.8.1 psutil-5.9.0 pyaml-21.10.1 pyparsing-3.0.8 six-1.16.0 tenacity-7.0.0 tomli-2.0.1 2024-10-31 00:24:34 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Reactive main running for hook install 2024-10-31 00:24:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.changed 2024-10-31 00:24:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.changed.snapd_refresh 2024-10-31 00:24:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.snapd_refresh 2024-10-31 00:24:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.changed.ssl_cert 2024-10-31 00:24:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.ssl_cert 2024-10-31 00:24:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.changed.ssl_key 2024-10-31 00:24:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.ssl_key 2024-10-31 00:24:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.changed.ssl_ca 2024-10-31 00:24:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.ssl_ca 2024-10-31 00:24:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.changed.source 2024-10-31 00:24:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.source 2024-10-31 00:24:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.source 2024-10-31 00:24:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.changed.cluster-name 2024-10-31 00:24:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.cluster-name 2024-10-31 00:24:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.cluster-name 2024-10-31 00:24:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.changed.auto-rejoin-tries 2024-10-31 00:24:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.auto-rejoin-tries 2024-10-31 00:24:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.auto-rejoin-tries 2024-10-31 00:24:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.changed.expel-timeout 2024-10-31 00:24:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.expel-timeout 2024-10-31 00:24:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.expel-timeout 2024-10-31 00:24:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.changed.innodb-buffer-pool-size 2024-10-31 00:24:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-buffer-pool-size 2024-10-31 00:24:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.changed.innodb-change-buffering 2024-10-31 00:24:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-change-buffering 2024-10-31 00:24:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.innodb-change-buffering 2024-10-31 00:24:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.changed.innodb-io-capacity 2024-10-31 00:24:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-io-capacity 2024-10-31 00:24:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.innodb-io-capacity 2024-10-31 00:24:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.changed.innodb-file-per-table 2024-10-31 00:24:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-file-per-table 2024-10-31 00:24:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.innodb-file-per-table 2024-10-31 00:24:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.changed.tuning-level 2024-10-31 00:24:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.tuning-level 2024-10-31 00:24:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.tuning-level 2024-10-31 00:24:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.changed.table-open-cache 2024-10-31 00:24:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.table-open-cache 2024-10-31 00:24:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.table-open-cache 2024-10-31 00:24:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.changed.max-connections 2024-10-31 00:24:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.max-connections 2024-10-31 00:24:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.changed.enable-binlogs 2024-10-31 00:24:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.enable-binlogs 2024-10-31 00:24:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.changed.binlogs-path 2024-10-31 00:24:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.binlogs-path 2024-10-31 00:24:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.binlogs-path 2024-10-31 00:24:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.changed.binlogs-max-size 2024-10-31 00:24:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.binlogs-max-size 2024-10-31 00:24:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.binlogs-max-size 2024-10-31 00:24:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.changed.binlogs-expire-days 2024-10-31 00:24:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.binlogs-expire-days 2024-10-31 00:24:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.binlogs-expire-days 2024-10-31 00:24:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.changed.prefer-ipv6 2024-10-31 00:24:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.prefer-ipv6 2024-10-31 00:24:36 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.changed.wait-timeout 2024-10-31 00:24:36 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.wait-timeout 2024-10-31 00:24:36 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.wait-timeout 2024-10-31 00:24:36 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.changed.os-db-router-hostname 2024-10-31 00:24:36 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.os-db-router-hostname 2024-10-31 00:24:36 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Initializing Snap Layer 2024-10-31 00:24:36 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Installing mysql-shell from store 2024-10-31 00:24:43 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for mysql-innodb-cluster/2: ok=true 2024-10-31 00:24:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Installation successful cmd="['snap', 'install', '--channel=stable', 'mysql-shell']" output="b'mysql-shell 8.0.23 from Canonical** installed\n'" 2024-10-31 00:24:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag snap.installed.mysql-shell 2024-10-31 00:24:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag snap.installed.core 2024-10-31 00:24:53 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator.DelayedActionCoordinator Loading state 2024-10-31 00:24:53 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator.DelayedActionCoordinator No peer relation. Loading local state 2024-10-31 00:24:53 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Coordinator: Initializing coordinator layer 2024-10-31 00:24:53 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Initializing Leadership Layer (is follower) 2024-10-31 00:24:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: starting handler dispatch, 61 flags set tracer: set flag charms.openstack.do-default-update-status tracer: set flag config.changed tracer: set flag config.changed.auto-rejoin-tries tracer: set flag config.changed.binlogs-expire-days tracer: set flag config.changed.binlogs-max-size tracer: set flag config.changed.binlogs-path tracer: set flag config.changed.cluster-name tracer: set flag config.changed.enable-binlogs tracer: set flag config.changed.expel-timeout tracer: set flag config.changed.innodb-buffer-pool-size tracer: set flag config.changed.innodb-change-buffering tracer: set flag config.changed.innodb-file-per-table tracer: set flag config.changed.innodb-io-capacity tracer: set flag config.changed.max-connections tracer: set flag config.changed.os-db-router-hostname tracer: set flag config.changed.prefer-ipv6 tracer: set flag config.changed.snapd_refresh tracer: set flag config.changed.source tracer: set flag config.changed.ssl_ca tracer: set flag config.changed.ssl_cert tracer: set flag config.changed.ssl_key tracer: set flag config.changed.table-open-cache tracer: set flag config.changed.tuning-level tracer: set flag config.changed.wait-timeout tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell 2024-10-31 00:24:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-10-31 00:24:54 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: main dispatch loop, 2 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/snap.py:321:change_snapd_refresh 2024-10-31 00:24:54 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/snap.py:321:change_snapd_refresh 2024-10-31 00:24:54 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: set flag snap.refresh.set tracer: -- dequeue handler reactive/snap.py:321:change_snapd_refresh 2024-10-31 00:24:54 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:24:54 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator.DelayedActionCoordinator Publishing state 2024-10-31 00:24:54 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator.DelayedActionCoordinator No peer relation. Saving local state 2024-10-31 00:24:54 INFO juju.worker.uniter.operation runhook.go:159 ran "install" hook (via explicit, bespoke hook script) 2024-10-31 00:24:55 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run install hook" for mysql-innodb-cluster/2 2024-10-31 00:24:55 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 00:24:55 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run install hook) 2024-10-31 00:24:55 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 00:24:56 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "mysql-innodb-cluster/2" (leader=false) entered scope for relation "mysql-innodb-cluster:coordinator" 2024-10-31 00:24:57 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "mysql-innodb-cluster/2" (leader=false) entered scope for relation "heat-mysql-router:db-router mysql-innodb-cluster:db-router" 2024-10-31 00:24:57 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "mysql-innodb-cluster/2" (leader=false) entered scope for relation "nova-mysql-router:db-router mysql-innodb-cluster:db-router" 2024-10-31 00:24:59 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "mysql-innodb-cluster/2" (leader=false) entered scope for relation "mysql-innodb-cluster:cluster" 2024-10-31 00:25:00 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "mysql-innodb-cluster/2" (leader=false) entered scope for relation "dashboard-mysql-router:db-router mysql-innodb-cluster:db-router" 2024-10-31 00:25:02 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "mysql-innodb-cluster/2" (leader=false) entered scope for relation "keystone-mysql-router:db-router mysql-innodb-cluster:db-router" 2024-10-31 00:25:03 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for mysql-innodb-cluster/2 : {3 {map[mysql-innodb-cluster/1:{0}] map[] []}} 2024-10-31 00:25:03 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "mysql-innodb-cluster/2" (leader=false) entered scope for relation "placement-mysql-router:db-router mysql-innodb-cluster:db-router" 2024-10-31 00:25:04 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "mysql-innodb-cluster/2" (leader=false) entered scope for relation "neutron-mysql-router:db-router mysql-innodb-cluster:db-router" 2024-10-31 00:25:05 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "mysql-innodb-cluster/2" (leader=false) entered scope for relation "glance-mysql-router:db-router mysql-innodb-cluster:db-router" 2024-10-31 00:25:05 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-created (43; app: dashboard-mysql-router) hook for mysql-innodb-cluster/2 2024-10-31 00:25:05 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run relation-created (43; app: dashboard-mysql-router) hook) 2024-10-31 00:25:05 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run relation-created (43; app: dashboard-mysql-router) hook) 2024-10-31 00:25:05 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-created (43; app: dashboard-mysql-router) hook" for mysql-innodb-cluster/2 2024-10-31 00:25:05 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-created (43; app: dashboard-mysql-router) hook" for mysql-innodb-cluster/2 2024-10-31 00:25:05 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running db-router-relation-created hook 2024-10-31 00:25:05 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 00:25:05 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for mysql-innodb-cluster/2 : {4 {map[mysql-innodb-cluster/1:{0}] map[] []}} 2024-10-31 00:25:06 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Reactive main running for hook db-router-relation-created 2024-10-31 00:25:07 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:25:07 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.ssl_cert 2024-10-31 00:25:07 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.ssl_key 2024-10-31 00:25:07 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.ssl_ca 2024-10-31 00:25:07 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.set.source 2024-10-31 00:25:07 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.source 2024-10-31 00:25:07 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.set.cluster-name 2024-10-31 00:25:07 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.cluster-name 2024-10-31 00:25:07 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.set.auto-rejoin-tries 2024-10-31 00:25:07 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.auto-rejoin-tries 2024-10-31 00:25:07 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.set.expel-timeout 2024-10-31 00:25:07 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.expel-timeout 2024-10-31 00:25:07 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.set.innodb-buffer-pool-size 2024-10-31 00:25:07 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.set.innodb-change-buffering 2024-10-31 00:25:08 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.innodb-change-buffering 2024-10-31 00:25:08 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.set.innodb-io-capacity 2024-10-31 00:25:08 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.innodb-io-capacity 2024-10-31 00:25:08 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.set.innodb-file-per-table 2024-10-31 00:25:08 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.innodb-file-per-table 2024-10-31 00:25:08 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.set.tuning-level 2024-10-31 00:25:08 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.tuning-level 2024-10-31 00:25:08 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.set.table-open-cache 2024-10-31 00:25:08 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.table-open-cache 2024-10-31 00:25:08 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.set.max-connections 2024-10-31 00:25:08 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.enable-binlogs 2024-10-31 00:25:08 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.set.binlogs-path 2024-10-31 00:25:08 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.binlogs-path 2024-10-31 00:25:08 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.set.binlogs-max-size 2024-10-31 00:25:08 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.binlogs-max-size 2024-10-31 00:25:08 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.set.binlogs-expire-days 2024-10-31 00:25:08 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.binlogs-expire-days 2024-10-31 00:25:08 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.prefer-ipv6 2024-10-31 00:25:08 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.set.wait-timeout 2024-10-31 00:25:08 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.wait-timeout 2024-10-31 00:25:08 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.os-db-router-hostname 2024-10-31 00:25:08 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Initializing Snap Layer 2024-10-31 00:25:09 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: coordinator.DelayedActionCoordinator Loading state 2024-10-31 00:25:09 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: coordinator.DelayedActionCoordinator New peer relation. Merging local state 2024-10-31 00:25:09 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Coordinator: Initializing coordinator layer 2024-10-31 00:25:09 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Initializing Leadership Layer (is follower) 2024-10-31 00:25:09 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag leadership.changed.mysql.passwd 2024-10-31 00:25:09 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer> tracer: set flag leadership.set.mysql.passwd tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:54:non_leader_install 2024-10-31 00:25:09 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag leadership.changed 2024-10-31 00:25:09 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer> tracer: starting handler dispatch, 42 flags set tracer: set flag charms.openstack.do-default-update-status tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag leadership.changed tracer: set flag leadership.changed.mysql.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 00:25:09 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: hooks phase, 0 handlers queued 2024-10-31 00:25:09 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer> tracer: main dispatch loop, 2 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:54:non_leader_install 2024-10-31 00:25:09 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:54:non_leader_install 2024-10-31 00:25:10 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Hit:1 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy InRelease 2024-10-31 00:25:10 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Hit:2 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-10-31 00:25:10 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Hit:3 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-10-31 00:25:10 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Hit:4 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-security InRelease 2024-10-31 00:25:14 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Reading package lists... 2024-10-31 00:25:16 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Installing ['mysql-router', 'mysql-server-8.0', 'python3-dnspython', 'libpython2.7'] with options: ['--option=Dpkg::Options::=--force-confold'] 2024-10-31 00:25:17 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Reading package lists... 2024-10-31 00:25:17 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Building dependency tree... 2024-10-31 00:25:17 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Reading state information... 2024-10-31 00:25:17 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 The following additional packages will be installed: 2024-10-31 00:25:17 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 libcgi-fast-perl libcgi-pm-perl libclone-perl libencode-locale-perl 2024-10-31 00:25:17 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 libevent-extra-2.1-7 libevent-openssl-2.1-7 libevent-pthreads-2.1-7 2024-10-31 00:25:17 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 libfcgi-bin libfcgi-perl libfcgi0ldbl libhtml-parser-perl 2024-10-31 00:25:17 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 libhtml-tagset-perl libhtml-template-perl libhttp-date-perl 2024-10-31 00:25:17 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 libhttp-message-perl libio-html-perl liblwp-mediatypes-perl libmecab2 2024-10-31 00:25:17 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 libprotobuf-lite23 libpython2.7-minimal libpython2.7-stdlib libtimedate-perl 2024-10-31 00:25:17 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 liburi-perl mecab-ipadic mecab-ipadic-utf8 mecab-utils mysql-client-8.0 2024-10-31 00:25:17 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 mysql-client-core-8.0 mysql-server-core-8.0 python3-requests-toolbelt 2024-10-31 00:25:17 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Suggested packages: 2024-10-31 00:25:17 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 libdata-dump-perl libipc-sharedcache-perl libbusiness-isbn-perl libwww-perl 2024-10-31 00:25:17 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 mailx tinyca python3-sniffio python3-trio 2024-10-31 00:25:17 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 The following NEW packages will be installed: 2024-10-31 00:25:17 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 libcgi-fast-perl libcgi-pm-perl libclone-perl libencode-locale-perl 2024-10-31 00:25:17 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 libevent-extra-2.1-7 libevent-openssl-2.1-7 libevent-pthreads-2.1-7 2024-10-31 00:25:17 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 libfcgi-bin libfcgi-perl libfcgi0ldbl libhtml-parser-perl 2024-10-31 00:25:17 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 libhtml-tagset-perl libhtml-template-perl libhttp-date-perl 2024-10-31 00:25:17 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 libhttp-message-perl libio-html-perl liblwp-mediatypes-perl libmecab2 2024-10-31 00:25:17 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 libprotobuf-lite23 libpython2.7 libpython2.7-minimal libpython2.7-stdlib 2024-10-31 00:25:17 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 libtimedate-perl liburi-perl mecab-ipadic mecab-ipadic-utf8 mecab-utils 2024-10-31 00:25:17 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 mysql-client-8.0 mysql-client-core-8.0 mysql-router mysql-server-8.0 2024-10-31 00:25:17 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 mysql-server-core-8.0 python3-dnspython python3-requests-toolbelt 2024-10-31 00:25:18 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 0 upgraded, 34 newly installed, 0 to remove and 0 not upgraded. 2024-10-31 00:25:18 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Need to get 37.8 MB of archives. 2024-10-31 00:25:18 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 After this operation, 293 MB of additional disk space will be used. 2024-10-31 00:25:18 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Get:1 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/main amd64 mysql-client-core-8.0 amd64 8.0.36-0ubuntu0.22.04.1 [2692 kB] 2024-10-31 00:25:18 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Get:2 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/main amd64 mysql-client-8.0 amd64 8.0.36-0ubuntu0.22.04.1 [22.7 kB] 2024-10-31 00:25:18 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Get:3 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 libevent-pthreads-2.1-7 amd64 2.1.12-stable-1build3 [7642 B] 2024-10-31 00:25:18 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Get:4 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 libmecab2 amd64 0.996-14build9 [199 kB] 2024-10-31 00:25:18 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Get:5 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/main amd64 libprotobuf-lite23 amd64 3.12.4-1ubuntu7.22.04.1 [209 kB] 2024-10-31 00:25:18 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Get:6 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/main amd64 mysql-server-core-8.0 amd64 8.0.36-0ubuntu0.22.04.1 [17.5 MB] 2024-10-31 00:25:18 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Get:7 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/main amd64 mysql-server-8.0 amd64 8.0.36-0ubuntu0.22.04.1 [1437 kB] 2024-10-31 00:25:18 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Get:8 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 libhtml-tagset-perl all 3.20-4 [12.5 kB] 2024-10-31 00:25:18 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Get:9 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 liburi-perl all 5.10-1 [78.8 kB] 2024-10-31 00:25:18 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Get:10 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 libhtml-parser-perl amd64 3.76-1build2 [88.4 kB] 2024-10-31 00:25:18 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Get:11 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 libcgi-pm-perl all 4.54-1 [188 kB] 2024-10-31 00:25:18 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Get:12 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 libfcgi0ldbl amd64 2.4.2-2build2 [28.0 kB] 2024-10-31 00:25:18 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Get:13 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 libfcgi-perl amd64 0.82+ds-1build1 [22.8 kB] 2024-10-31 00:25:18 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Get:14 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 libcgi-fast-perl all 1:2.15-1 [10.5 kB] 2024-10-31 00:25:18 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Get:15 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 libclone-perl amd64 0.45-1build3 [11.0 kB] 2024-10-31 00:25:18 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Get:16 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 libencode-locale-perl all 1.05-1.1 [11.8 kB] 2024-10-31 00:25:18 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Get:17 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 libevent-extra-2.1-7 amd64 2.1.12-stable-1build3 [65.4 kB] 2024-10-31 00:25:18 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Get:18 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 libevent-openssl-2.1-7 amd64 2.1.12-stable-1build3 [15.8 kB] 2024-10-31 00:25:18 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Get:19 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 libfcgi-bin amd64 2.4.2-2build2 [11.2 kB] 2024-10-31 00:25:18 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Get:20 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 libhtml-template-perl all 2.97-1.1 [59.1 kB] 2024-10-31 00:25:18 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Get:21 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 libtimedate-perl all 2.3300-2 [34.0 kB] 2024-10-31 00:25:18 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Get:22 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 libhttp-date-perl all 6.05-1 [9920 B] 2024-10-31 00:25:18 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Get:23 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 libio-html-perl all 1.004-2 [15.4 kB] 2024-10-31 00:25:18 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Get:24 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 liblwp-mediatypes-perl all 6.04-1 [19.5 kB] 2024-10-31 00:25:18 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Get:25 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 libhttp-message-perl all 6.36-1 [76.8 kB] 2024-10-31 00:25:18 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Get:26 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libpython2.7-minimal amd64 2.7.18-13ubuntu1.2 [347 kB] 2024-10-31 00:25:18 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Get:27 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libpython2.7-stdlib amd64 2.7.18-13ubuntu1.2 [1977 kB] 2024-10-31 00:25:18 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Get:28 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libpython2.7 amd64 2.7.18-13ubuntu1.2 [1160 kB] 2024-10-31 00:25:18 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Get:29 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 mecab-utils amd64 0.996-14build9 [4850 B] 2024-10-31 00:25:18 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Get:30 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 mecab-ipadic all 2.7.0-20070801+main-3 [6718 kB] 2024-10-31 00:25:19 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Get:31 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 mecab-ipadic-utf8 all 2.7.0-20070801+main-3 [4384 B] 2024-10-31 00:25:19 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Get:32 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/universe amd64 mysql-router amd64 8.0.36-0ubuntu0.22.04.1 [4603 kB] 2024-10-31 00:25:19 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Get:33 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 python3-dnspython all 2.1.0-1ubuntu1 [123 kB] 2024-10-31 00:25:19 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Get:34 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 python3-requests-toolbelt all 0.9.1-1 [38.0 kB] 2024-10-31 00:25:19 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Preconfiguring packages ... 2024-10-31 00:25:20 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Fetched 37.8 MB in 1s (31.6 MB/s) 2024-10-31 00:25:20 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Selecting previously unselected package mysql-client-core-8.0. 2024-10-31 00:25:20 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 41272 files and directories currently installed.) 2024-10-31 00:25:20 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Preparing to unpack .../00-mysql-client-core-8.0_8.0.36-0ubuntu0.22.04.1_amd64.deb ... 2024-10-31 00:25:20 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Unpacking mysql-client-core-8.0 (8.0.36-0ubuntu0.22.04.1) ... 2024-10-31 00:25:21 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Selecting previously unselected package mysql-client-8.0. 2024-10-31 00:25:21 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Preparing to unpack .../01-mysql-client-8.0_8.0.36-0ubuntu0.22.04.1_amd64.deb ... 2024-10-31 00:25:21 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Unpacking mysql-client-8.0 (8.0.36-0ubuntu0.22.04.1) ... 2024-10-31 00:25:21 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Selecting previously unselected package libevent-pthreads-2.1-7:amd64. 2024-10-31 00:25:21 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Preparing to unpack .../02-libevent-pthreads-2.1-7_2.1.12-stable-1build3_amd64.deb ... 2024-10-31 00:25:21 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Unpacking libevent-pthreads-2.1-7:amd64 (2.1.12-stable-1build3) ... 2024-10-31 00:25:21 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Selecting previously unselected package libmecab2:amd64. 2024-10-31 00:25:21 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Preparing to unpack .../03-libmecab2_0.996-14build9_amd64.deb ... 2024-10-31 00:25:21 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Unpacking libmecab2:amd64 (0.996-14build9) ... 2024-10-31 00:25:21 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Selecting previously unselected package libprotobuf-lite23:amd64. 2024-10-31 00:25:21 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Preparing to unpack .../04-libprotobuf-lite23_3.12.4-1ubuntu7.22.04.1_amd64.deb ... 2024-10-31 00:25:21 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Unpacking libprotobuf-lite23:amd64 (3.12.4-1ubuntu7.22.04.1) ... 2024-10-31 00:25:21 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Selecting previously unselected package mysql-server-core-8.0. 2024-10-31 00:25:21 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Preparing to unpack .../05-mysql-server-core-8.0_8.0.36-0ubuntu0.22.04.1_amd64.deb ... 2024-10-31 00:25:21 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Unpacking mysql-server-core-8.0 (8.0.36-0ubuntu0.22.04.1) ... 2024-10-31 00:25:23 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Selecting previously unselected package mysql-server-8.0. 2024-10-31 00:25:23 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Preparing to unpack .../06-mysql-server-8.0_8.0.36-0ubuntu0.22.04.1_amd64.deb ... 2024-10-31 00:25:24 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Unpacking mysql-server-8.0 (8.0.36-0ubuntu0.22.04.1) ... 2024-10-31 00:25:24 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Selecting previously unselected package libhtml-tagset-perl. 2024-10-31 00:25:24 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Preparing to unpack .../07-libhtml-tagset-perl_3.20-4_all.deb ... 2024-10-31 00:25:24 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Unpacking libhtml-tagset-perl (3.20-4) ... 2024-10-31 00:25:25 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Selecting previously unselected package liburi-perl. 2024-10-31 00:25:25 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Preparing to unpack .../08-liburi-perl_5.10-1_all.deb ... 2024-10-31 00:25:25 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Unpacking liburi-perl (5.10-1) ... 2024-10-31 00:25:25 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Selecting previously unselected package libhtml-parser-perl:amd64. 2024-10-31 00:25:25 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Preparing to unpack .../09-libhtml-parser-perl_3.76-1build2_amd64.deb ... 2024-10-31 00:25:25 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Unpacking libhtml-parser-perl:amd64 (3.76-1build2) ... 2024-10-31 00:25:25 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Selecting previously unselected package libcgi-pm-perl. 2024-10-31 00:25:25 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Preparing to unpack .../10-libcgi-pm-perl_4.54-1_all.deb ... 2024-10-31 00:25:25 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Unpacking libcgi-pm-perl (4.54-1) ... 2024-10-31 00:25:25 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Selecting previously unselected package libfcgi0ldbl:amd64. 2024-10-31 00:25:25 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Preparing to unpack .../11-libfcgi0ldbl_2.4.2-2build2_amd64.deb ... 2024-10-31 00:25:25 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Unpacking libfcgi0ldbl:amd64 (2.4.2-2build2) ... 2024-10-31 00:25:25 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Selecting previously unselected package libfcgi-perl:amd64. 2024-10-31 00:25:25 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Preparing to unpack .../12-libfcgi-perl_0.82+ds-1build1_amd64.deb ... 2024-10-31 00:25:25 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Unpacking libfcgi-perl:amd64 (0.82+ds-1build1) ... 2024-10-31 00:25:25 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Selecting previously unselected package libcgi-fast-perl. 2024-10-31 00:25:25 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Preparing to unpack .../13-libcgi-fast-perl_1%3a2.15-1_all.deb ... 2024-10-31 00:25:25 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Unpacking libcgi-fast-perl (1:2.15-1) ... 2024-10-31 00:25:25 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Selecting previously unselected package libclone-perl. 2024-10-31 00:25:25 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Preparing to unpack .../14-libclone-perl_0.45-1build3_amd64.deb ... 2024-10-31 00:25:25 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Unpacking libclone-perl (0.45-1build3) ... 2024-10-31 00:25:26 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Selecting previously unselected package libencode-locale-perl. 2024-10-31 00:25:26 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Preparing to unpack .../15-libencode-locale-perl_1.05-1.1_all.deb ... 2024-10-31 00:25:26 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Unpacking libencode-locale-perl (1.05-1.1) ... 2024-10-31 00:25:26 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Selecting previously unselected package libevent-extra-2.1-7:amd64. 2024-10-31 00:25:26 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Preparing to unpack .../16-libevent-extra-2.1-7_2.1.12-stable-1build3_amd64.deb ... 2024-10-31 00:25:26 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Unpacking libevent-extra-2.1-7:amd64 (2.1.12-stable-1build3) ... 2024-10-31 00:25:26 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Selecting previously unselected package libevent-openssl-2.1-7:amd64. 2024-10-31 00:25:26 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Preparing to unpack .../17-libevent-openssl-2.1-7_2.1.12-stable-1build3_amd64.deb ... 2024-10-31 00:25:26 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Unpacking libevent-openssl-2.1-7:amd64 (2.1.12-stable-1build3) ... 2024-10-31 00:25:26 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Selecting previously unselected package libfcgi-bin. 2024-10-31 00:25:26 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Preparing to unpack .../18-libfcgi-bin_2.4.2-2build2_amd64.deb ... 2024-10-31 00:25:26 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Unpacking libfcgi-bin (2.4.2-2build2) ... 2024-10-31 00:25:26 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Selecting previously unselected package libhtml-template-perl. 2024-10-31 00:25:26 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Preparing to unpack .../19-libhtml-template-perl_2.97-1.1_all.deb ... 2024-10-31 00:25:26 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Unpacking libhtml-template-perl (2.97-1.1) ... 2024-10-31 00:25:26 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Selecting previously unselected package libtimedate-perl. 2024-10-31 00:25:26 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Preparing to unpack .../20-libtimedate-perl_2.3300-2_all.deb ... 2024-10-31 00:25:26 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Unpacking libtimedate-perl (2.3300-2) ... 2024-10-31 00:25:26 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Selecting previously unselected package libhttp-date-perl. 2024-10-31 00:25:26 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Preparing to unpack .../21-libhttp-date-perl_6.05-1_all.deb ... 2024-10-31 00:25:27 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Unpacking libhttp-date-perl (6.05-1) ... 2024-10-31 00:25:27 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Selecting previously unselected package libio-html-perl. 2024-10-31 00:25:27 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Preparing to unpack .../22-libio-html-perl_1.004-2_all.deb ... 2024-10-31 00:25:27 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Unpacking libio-html-perl (1.004-2) ... 2024-10-31 00:25:27 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Selecting previously unselected package liblwp-mediatypes-perl. 2024-10-31 00:25:27 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Preparing to unpack .../23-liblwp-mediatypes-perl_6.04-1_all.deb ... 2024-10-31 00:25:27 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Unpacking liblwp-mediatypes-perl (6.04-1) ... 2024-10-31 00:25:27 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Selecting previously unselected package libhttp-message-perl. 2024-10-31 00:25:27 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Preparing to unpack .../24-libhttp-message-perl_6.36-1_all.deb ... 2024-10-31 00:25:27 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Unpacking libhttp-message-perl (6.36-1) ... 2024-10-31 00:25:27 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Selecting previously unselected package libpython2.7-minimal:amd64. 2024-10-31 00:25:27 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Preparing to unpack .../25-libpython2.7-minimal_2.7.18-13ubuntu1.2_amd64.deb ... 2024-10-31 00:25:27 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Unpacking libpython2.7-minimal:amd64 (2.7.18-13ubuntu1.2) ... 2024-10-31 00:25:27 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Selecting previously unselected package libpython2.7-stdlib:amd64. 2024-10-31 00:25:27 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Preparing to unpack .../26-libpython2.7-stdlib_2.7.18-13ubuntu1.2_amd64.deb ... 2024-10-31 00:25:27 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Unpacking libpython2.7-stdlib:amd64 (2.7.18-13ubuntu1.2) ... 2024-10-31 00:25:29 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Selecting previously unselected package libpython2.7:amd64. 2024-10-31 00:25:29 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Preparing to unpack .../27-libpython2.7_2.7.18-13ubuntu1.2_amd64.deb ... 2024-10-31 00:25:29 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Unpacking libpython2.7:amd64 (2.7.18-13ubuntu1.2) ... 2024-10-31 00:25:29 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Selecting previously unselected package mecab-utils. 2024-10-31 00:25:29 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Preparing to unpack .../28-mecab-utils_0.996-14build9_amd64.deb ... 2024-10-31 00:25:29 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Unpacking mecab-utils (0.996-14build9) ... 2024-10-31 00:25:29 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Selecting previously unselected package mecab-ipadic. 2024-10-31 00:25:29 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Preparing to unpack .../29-mecab-ipadic_2.7.0-20070801+main-3_all.deb ... 2024-10-31 00:25:29 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Unpacking mecab-ipadic (2.7.0-20070801+main-3) ... 2024-10-31 00:25:31 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Selecting previously unselected package mecab-ipadic-utf8. 2024-10-31 00:25:31 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Preparing to unpack .../30-mecab-ipadic-utf8_2.7.0-20070801+main-3_all.deb ... 2024-10-31 00:25:31 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Unpacking mecab-ipadic-utf8 (2.7.0-20070801+main-3) ... 2024-10-31 00:25:31 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Selecting previously unselected package mysql-router. 2024-10-31 00:25:31 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Preparing to unpack .../31-mysql-router_8.0.36-0ubuntu0.22.04.1_amd64.deb ... 2024-10-31 00:25:31 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Unpacking mysql-router (8.0.36-0ubuntu0.22.04.1) ... 2024-10-31 00:25:32 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Selecting previously unselected package python3-dnspython. 2024-10-31 00:25:32 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Preparing to unpack .../32-python3-dnspython_2.1.0-1ubuntu1_all.deb ... 2024-10-31 00:25:32 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Unpacking python3-dnspython (2.1.0-1ubuntu1) ... 2024-10-31 00:25:32 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Selecting previously unselected package python3-requests-toolbelt. 2024-10-31 00:25:32 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Preparing to unpack .../33-python3-requests-toolbelt_0.9.1-1_all.deb ... 2024-10-31 00:25:32 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Unpacking python3-requests-toolbelt (0.9.1-1) ... 2024-10-31 00:25:32 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Setting up libmecab2:amd64 (0.996-14build9) ... 2024-10-31 00:25:32 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Setting up mysql-client-core-8.0 (8.0.36-0ubuntu0.22.04.1) ... 2024-10-31 00:25:33 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Setting up libevent-extra-2.1-7:amd64 (2.1.12-stable-1build3) ... 2024-10-31 00:25:33 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Setting up python3-requests-toolbelt (0.9.1-1) ... 2024-10-31 00:25:33 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Setting up libfcgi0ldbl:amd64 (2.4.2-2build2) ... 2024-10-31 00:25:33 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Setting up libclone-perl (0.45-1build3) ... 2024-10-31 00:25:33 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Setting up libhtml-tagset-perl (3.20-4) ... 2024-10-31 00:25:33 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Setting up liblwp-mediatypes-perl (6.04-1) ... 2024-10-31 00:25:33 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Setting up libfcgi-bin (2.4.2-2build2) ... 2024-10-31 00:25:33 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Setting up libevent-openssl-2.1-7:amd64 (2.1.12-stable-1build3) ... 2024-10-31 00:25:33 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Setting up libencode-locale-perl (1.05-1.1) ... 2024-10-31 00:25:33 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Setting up libprotobuf-lite23:amd64 (3.12.4-1ubuntu7.22.04.1) ... 2024-10-31 00:25:33 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Setting up libpython2.7-minimal:amd64 (2.7.18-13ubuntu1.2) ... 2024-10-31 00:25:33 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Setting up mecab-utils (0.996-14build9) ... 2024-10-31 00:25:33 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Setting up libio-html-perl (1.004-2) ... 2024-10-31 00:25:33 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Setting up libtimedate-perl (2.3300-2) ... 2024-10-31 00:25:33 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Setting up python3-dnspython (2.1.0-1ubuntu1) ... 2024-10-31 00:25:34 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Setting up mysql-client-8.0 (8.0.36-0ubuntu0.22.04.1) ... 2024-10-31 00:25:34 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Setting up libfcgi-perl:amd64 (0.82+ds-1build1) ... 2024-10-31 00:25:34 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Setting up liburi-perl (5.10-1) ... 2024-10-31 00:25:34 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Setting up libevent-pthreads-2.1-7:amd64 (2.1.12-stable-1build3) ... 2024-10-31 00:25:34 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Setting up libhttp-date-perl (6.05-1) ... 2024-10-31 00:25:34 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Setting up mecab-ipadic (2.7.0-20070801+main-3) ... 2024-10-31 00:25:34 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Compiling IPA dictionary for Mecab. This takes long time... 2024-10-31 00:25:34 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 reading /usr/share/mecab/dic/ipadic/unk.def ... 40 2024-10-31 00:25:34 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 emitting double-array: 9% |### | emitting double-array: 18% |####### | emitting double-array: 27% |########### | emitting double-array: 36% |############### | emitting double-array: 45% |################### | emitting double-array: 54% |####################### | emitting double-array: 63% |########################### | emitting double-array: 72% |############################### | emitting double-array: 81% |################################### | emitting double-array: 90% |####################################### | emitting double-array: 100% |###########################################| 2024-10-31 00:25:34 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 /usr/share/mecab/dic/ipadic/model.def is not found. skipped. 2024-10-31 00:25:34 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 reading /usr/share/mecab/dic/ipadic/Adnominal.csv ... 135 2024-10-31 00:25:34 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 reading /usr/share/mecab/dic/ipadic/Verb.csv ... 130750 2024-10-31 00:25:34 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 reading /usr/share/mecab/dic/ipadic/Noun.number.csv ... 42 2024-10-31 00:25:34 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 reading /usr/share/mecab/dic/ipadic/Noun.place.csv ... 72999 2024-10-31 00:25:34 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 reading /usr/share/mecab/dic/ipadic/Filler.csv ... 19 2024-10-31 00:25:34 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 reading /usr/share/mecab/dic/ipadic/Adverb.csv ... 3032 2024-10-31 00:25:34 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 reading /usr/share/mecab/dic/ipadic/Interjection.csv ... 252 2024-10-31 00:25:34 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 reading /usr/share/mecab/dic/ipadic/Others.csv ... 2 2024-10-31 00:25:34 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 reading /usr/share/mecab/dic/ipadic/Conjunction.csv ... 171 2024-10-31 00:25:34 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 reading /usr/share/mecab/dic/ipadic/Postp-col.csv ... 91 2024-10-31 00:25:34 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 reading /usr/share/mecab/dic/ipadic/Noun.verbal.csv ... 12146 2024-10-31 00:25:34 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 reading /usr/share/mecab/dic/ipadic/Noun.adverbal.csv ... 795 2024-10-31 00:25:35 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 reading /usr/share/mecab/dic/ipadic/Noun.csv ... 60477 2024-10-31 00:25:35 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 reading /usr/share/mecab/dic/ipadic/Noun.name.csv ... 34202 2024-10-31 00:25:35 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 reading /usr/share/mecab/dic/ipadic/Noun.demonst.csv ... 120 2024-10-31 00:25:35 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 reading /usr/share/mecab/dic/ipadic/Suffix.csv ... 1393 2024-10-31 00:25:35 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 reading /usr/share/mecab/dic/ipadic/Noun.others.csv ... 151 2024-10-31 00:25:35 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 reading /usr/share/mecab/dic/ipadic/Prefix.csv ... 221 2024-10-31 00:25:35 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 reading /usr/share/mecab/dic/ipadic/Noun.proper.csv ... 27328 2024-10-31 00:25:35 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 reading /usr/share/mecab/dic/ipadic/Noun.adjv.csv ... 3328 2024-10-31 00:25:35 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 reading /usr/share/mecab/dic/ipadic/Noun.org.csv ... 16668 2024-10-31 00:25:35 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 reading /usr/share/mecab/dic/ipadic/Auxil.csv ... 199 2024-10-31 00:25:35 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 reading /usr/share/mecab/dic/ipadic/Noun.nai.csv ... 42 2024-10-31 00:25:35 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 reading /usr/share/mecab/dic/ipadic/Symbol.csv ... 208 2024-10-31 00:25:35 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 reading /usr/share/mecab/dic/ipadic/Adj.csv ... 27210 2024-10-31 00:25:35 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 reading /usr/share/mecab/dic/ipadic/Postp.csv ... 146 2024-10-31 00:25:35 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 emitting double-array: 0% | | emitting double-array: 1% | | emitting double-array: 2% | | emitting double-array: 3% |# | emitting double-array: 4% |# | emitting double-array: 5% |## | emitting double-array: 6% |## | emitting double-array: 7% |### | emitting double-array: 8% |### | emitting double-array: 9% |### | emitting double-array: 10% |#### | emitting double-array: 11% |#### | emitting double-array: 12% |##### | emitting double-array: 13% |##### | emitting double-array: 14% |###### | emitting double-array: 15% |###### | emitting double-array: 16% |###### | emitting double-array: 17% |####### | emitting double-array: 18% |####### | emitting double-array: 19% |######## | emitting double-array: 20% |######## | emitting double-array: 21% |######### | emitting double-array: 22% |######### | emitting double-array: 23% |######### | emitting double-array: 24% |########## | emitting double-array: 25% |########## | emitting double-array: 26% |########### | emitting double-array: 27% |########### | emitting double-array: 28% |############ | emitting double-array: 29% |############ | emitting double-array: 30% |############ | emitting double-array: 31% |############# | emitting double-array: 32% |############# | emitting double-array: 33% |############## | emitting double-array: 34% |############## | emitting double-array: 35% |############### | emitting double-array: 36% |############### | emitting double-array: 37% |############### | emitting double-array: 38% |################ | emitting double-array: 39% |################ | emitting double-array: 40% |################# | emitting double-array: 41% |################# | emitting double-array: 42% |################## | emitting double-array: 43% |################## | emitting double-array: 44% |################## | emitting double-array: 45% |################### | emitting double-array: 46% |################### | emitting double-array: 47% |#################### | emitting double-array: 48% |#################### | emitting double-array: 49% |##################### | emitting double-array: 50% |##################### | emitting double-array: 51% |##################### | emitting double-array: 52% |###################### | emitting double-array: 53% |###################### | emitting double-array: 54% |################# 2024-10-31 00:25:35 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 ###### | emitting double-array: 55% |####################### | emitting double-array: 56% |######################## | emitting double-array: 57% |######################## | emitting double-array: 58% |######################## | emitting double-array: 59% |######################### | emitting double-array: 60% |######################### | emitting double-array: 61% |########################## | emitting double-array: 62% |########################## | emitting double-array: 63% |########################### | emitting double-array: 64% |########################### | emitting double-array: 65% |########################### | emitting double-array: 66% |############################ | emitting double-array: 67% |############################ | emitting double-array: 68% |############################# | emitting double-array: 69% |############################# | emitting double-array: 70% |############################## | emitting double-array: 71% |############################## | emitting double-array: 72% |############################## | emitting double-array: 73% |############################### | emitting double-array: 74% |############################### | emitting double-array: 75% |################################ | emitting double-array: 76% |################################ | emitting double-array: 77% |################################# | emitting double-array: 78% |################################# | emitting double-array: 79% |################################# | emitting double-array: 80% |################################## | emitting double-array: 81% |################################## | emitting double-array: 82% |################################### | emitting double-array: 83% |################################### | emitting double-array: 84% |#################################### | emitting double-array: 85% |#################################### | emitting double-array: 86% |#################################### | emitting double-array: 87% |##################################### | emitting double-array: 88% |##################################### | emitting double-array: 89% |###################################### | emitting double-array: 90% |###################################### | emitting double-array: 91% |####################################### | emitting double-array: 92% |####################################### | emitting double-array: 93% |####################################### | emitting double-array: 94% |######################################## | emitting double-array: 95% |######################################## | emitting double-array: 96% |######################################### | emitting double-array: 97% |######################################### | emitting double-array: 98% |########################################## | emitting double-array: 99% |########################################## | emitting double-array: 100% |###########################################| 2024-10-31 00:25:36 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 reading /usr/share/mecab/dic/ipadic/matrix.def ... 1316x1316 2024-10-31 00:25:36 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 emitting matrix : 0% | | emitting matrix : 1% | | emitting matrix : 2% | | emitting matrix : 3% |# | emitting matrix : 4% |# | emitting matrix : 5% |## | emitting matrix : 6% |## | emitting matrix : 7% |### | emitting matrix : 8% |### | emitting matrix : 9% |### | emitting matrix : 10% |#### | emitting matrix : 11% |#### | emitting matrix : 12% |##### | emitting matrix : 13% |##### | emitting matrix : 14% |###### | emitting matrix : 15% |###### | emitting matrix : 16% |###### | emitting matrix : 17% |####### | emitting matrix : 18% |####### | emitting matrix : 19% |######## | emitting matrix : 20% |######## | emitting matrix : 21% |######### | emitting matrix : 22% |######### | emitting matrix : 23% |######### | emitting matrix : 24% |########## | emitting matrix : 25% |########## | emitting matrix : 26% |########### | emitting matrix : 27% |########### | emitting matrix : 28% |############ | emitting matrix : 29% |############ | emitting matrix : 30% |############ | emitting matrix : 31% |############# | emitting matrix : 32% |############# | emitting matrix : 33% |############## | emitting matrix : 34% |############## | emitting matrix : 35% |############### | emitting matrix : 36% |############### | emitting matrix : 37% |############### | emitting matrix : 38% |################ | emitting matrix : 39% |################ | emitting matrix : 40% |################# | emitting matrix : 41% |################# | emitting matrix : 42% |################## | emitting matrix : 43% |################## | emitting matrix : 44% |################## | emitting matrix : 45% |################### | emitting matrix : 46% |################### | emitting matrix : 47% |#################### | emitting matrix : 48% |#################### | emitting matrix : 49% |##################### | emitting matrix : 50% |##################### | emitting matrix : 51% |##################### | emitting matrix : 52% |###################### | emitting matrix : 53% |###################### | emitting matrix : 54% |################# 2024-10-31 00:25:36 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 ###### | emitting matrix : 55% |####################### | emitting matrix : 56% |######################## | emitting matrix : 57% |######################## | emitting matrix : 58% |######################## | emitting matrix : 59% |######################### | emitting matrix : 60% |######################### | emitting matrix : 61% |########################## | emitting matrix : 62% |########################## | emitting matrix : 63% |########################### | emitting matrix : 64% |########################### | emitting matrix : 65% |########################### | emitting matrix : 66% |############################ | emitting matrix : 67% |############################ | emitting matrix : 68% |############################# | emitting matrix : 69% |############################# | emitting matrix : 70% |############################## | emitting matrix : 71% |############################## | emitting matrix : 72% |############################## | emitting matrix : 73% |############################### | emitting matrix : 74% |############################### | emitting matrix : 75% |################################ | emitting matrix : 76% |################################ | emitting matrix : 77% |################################# | emitting matrix : 78% |################################# | emitting matrix : 79% |################################# | emitting matrix : 80% |################################## | emitting matrix : 81% |################################## | emitting matrix : 82% |################################### | emitting matrix : 83% |################################### | emitting matrix : 84% |#################################### | emitting matrix : 85% |#################################### | emitting matrix : 86% |#################################### | emitting matrix : 87% |##################################### | emitting matrix : 88% |##################################### | emitting matrix : 89% |###################################### | emitting matrix : 90% |###################################### | emitting matrix : 91% |####################################### | emitting matrix : 92% |####################################### | emitting matrix : 93% |####################################### | emitting matrix : 94% |######################################## | emitting matrix : 95% |######################################## | emitting matrix : 96% |######################################### | emitting matrix : 97% |######################################### | emitting matrix : 98% |########################################## | emitting matrix : 99% |########################################## | emitting matrix : 100% |###########################################| 2024-10-31 00:25:36 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 2024-10-31 00:25:36 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 done! 2024-10-31 00:25:36 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 update-alternatives: using /var/lib/mecab/dic/ipadic to provide /var/lib/mecab/dic/debian (mecab-dictionary) in auto mode 2024-10-31 00:25:36 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Setting up libpython2.7-stdlib:amd64 (2.7.18-13ubuntu1.2) ... 2024-10-31 00:25:36 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Setting up mysql-server-core-8.0 (8.0.36-0ubuntu0.22.04.1) ... 2024-10-31 00:25:36 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Setting up mecab-ipadic-utf8 (2.7.0-20070801+main-3) ... 2024-10-31 00:25:36 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Compiling IPA dictionary for Mecab. This takes long time... 2024-10-31 00:25:36 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 reading /usr/share/mecab/dic/ipadic/unk.def ... 40 2024-10-31 00:25:36 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 emitting double-array: 9% |### | emitting double-array: 18% |####### | emitting double-array: 27% |########### | emitting double-array: 36% |############### | emitting double-array: 45% |################### | emitting double-array: 54% |####################### | emitting double-array: 63% |########################### | emitting double-array: 72% |############################### | emitting double-array: 81% |################################### | emitting double-array: 90% |####################################### | emitting double-array: 100% |###########################################| 2024-10-31 00:25:36 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 /usr/share/mecab/dic/ipadic/model.def is not found. skipped. 2024-10-31 00:25:36 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 reading /usr/share/mecab/dic/ipadic/Adnominal.csv ... 135 2024-10-31 00:25:36 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 reading /usr/share/mecab/dic/ipadic/Verb.csv ... 130750 2024-10-31 00:25:36 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 reading /usr/share/mecab/dic/ipadic/Noun.number.csv ... 42 2024-10-31 00:25:37 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 reading /usr/share/mecab/dic/ipadic/Noun.place.csv ... 72999 2024-10-31 00:25:37 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 reading /usr/share/mecab/dic/ipadic/Filler.csv ... 19 2024-10-31 00:25:37 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 reading /usr/share/mecab/dic/ipadic/Adverb.csv ... 3032 2024-10-31 00:25:37 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 reading /usr/share/mecab/dic/ipadic/Interjection.csv ... 252 2024-10-31 00:25:37 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 reading /usr/share/mecab/dic/ipadic/Others.csv ... 2 2024-10-31 00:25:37 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 reading /usr/share/mecab/dic/ipadic/Conjunction.csv ... 171 2024-10-31 00:25:37 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 reading /usr/share/mecab/dic/ipadic/Postp-col.csv ... 91 2024-10-31 00:25:37 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 reading /usr/share/mecab/dic/ipadic/Noun.verbal.csv ... 12146 2024-10-31 00:25:37 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 reading /usr/share/mecab/dic/ipadic/Noun.adverbal.csv ... 795 2024-10-31 00:25:37 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 reading /usr/share/mecab/dic/ipadic/Noun.csv ... 60477 2024-10-31 00:25:37 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 reading /usr/share/mecab/dic/ipadic/Noun.name.csv ... 34202 2024-10-31 00:25:37 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 reading /usr/share/mecab/dic/ipadic/Noun.demonst.csv ... 120 2024-10-31 00:25:37 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 reading /usr/share/mecab/dic/ipadic/Suffix.csv ... 1393 2024-10-31 00:25:37 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 reading /usr/share/mecab/dic/ipadic/Noun.others.csv ... 151 2024-10-31 00:25:37 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 reading /usr/share/mecab/dic/ipadic/Prefix.csv ... 221 2024-10-31 00:25:37 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 reading /usr/share/mecab/dic/ipadic/Noun.proper.csv ... 27328 2024-10-31 00:25:37 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 reading /usr/share/mecab/dic/ipadic/Noun.adjv.csv ... 3328 2024-10-31 00:25:37 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 reading /usr/share/mecab/dic/ipadic/Noun.org.csv ... 16668 2024-10-31 00:25:37 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 reading /usr/share/mecab/dic/ipadic/Auxil.csv ... 199 2024-10-31 00:25:37 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 reading /usr/share/mecab/dic/ipadic/Noun.nai.csv ... 42 2024-10-31 00:25:37 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 reading /usr/share/mecab/dic/ipadic/Symbol.csv ... 208 2024-10-31 00:25:37 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 reading /usr/share/mecab/dic/ipadic/Adj.csv ... 27210 2024-10-31 00:25:37 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 reading /usr/share/mecab/dic/ipadic/Postp.csv ... 146 2024-10-31 00:25:37 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 emitting double-array: 0% | | emitting double-array: 1% | | emitting double-array: 2% | | emitting double-array: 3% |# | emitting double-array: 4% |# | emitting double-array: 5% |## | emitting double-array: 6% |## | emitting double-array: 7% |### | emitting double-array: 8% |### | emitting double-array: 9% |### | emitting double-array: 10% |#### | emitting double-array: 11% |#### | emitting double-array: 12% |##### | emitting double-array: 13% |##### | emitting double-array: 14% |###### | emitting double-array: 15% |###### | emitting double-array: 16% |###### | emitting double-array: 17% |####### | emitting double-array: 18% |####### | emitting double-array: 19% |######## | emitting double-array: 20% |######## | emitting double-array: 21% |######### | emitting double-array: 22% |######### | emitting double-array: 23% |######### | emitting double-array: 24% |########## | emitting double-array: 25% |########## | emitting double-array: 26% |########### | emitting double-array: 27% |########### | emitting double-array: 28% |############ | emitting double-array: 29% |############ | emitting double-array: 30% |############ | emitting double-array: 31% |############# | emitting double-array: 32% |############# | emitting double-array: 33% |############## | emitting double-array: 34% |############## | emitting double-array: 35% |############### | emitting double-array: 36% |############### | emitting double-array: 37% |############### | emitting double-array: 38% |################ | emitting double-array: 39% |################ | emitting double-array: 40% |################# | emitting double-array: 41% |################# | emitting double-array: 42% |################## | emitting double-array: 43% |################## | emitting double-array: 44% |################## | emitting double-array: 45% |################### | emitting double-array: 46% |################### | emitting double-array: 47% |#################### | emitting double-array: 48% |#################### | emitting double-array: 49% |##################### | emitting double-array: 50% |##################### | emitting double-array: 51% |##################### | emitting double-array: 52% |###################### | emitting double-array: 53% |###################### | emitting double-array: 54% |################# 2024-10-31 00:25:38 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 ###### | emitting double-array: 55% |####################### | emitting double-array: 56% |######################## | emitting double-array: 57% |######################## | emitting double-array: 58% |######################## | emitting double-array: 59% |######################### | emitting double-array: 60% |######################### | emitting double-array: 61% |########################## | emitting double-array: 62% |########################## | emitting double-array: 63% |########################### | emitting double-array: 64% |########################### | emitting double-array: 65% |########################### | emitting double-array: 66% |############################ | emitting double-array: 67% |############################ | emitting double-array: 68% |############################# | emitting double-array: 69% |############################# | emitting double-array: 70% |############################## | emitting double-array: 71% |############################## | emitting double-array: 72% |############################## | emitting double-array: 73% |############################### | emitting double-array: 74% |############################### | emitting double-array: 75% |################################ | emitting double-array: 76% |################################ | emitting double-array: 77% |################################# | emitting double-array: 78% |################################# | emitting double-array: 79% |################################# | emitting double-array: 80% |################################## | emitting double-array: 81% |################################## | emitting double-array: 82% |################################### | emitting double-array: 83% |################################### | emitting double-array: 84% |#################################### | emitting double-array: 85% |#################################### | emitting double-array: 86% |#################################### | emitting double-array: 87% |##################################### | emitting double-array: 88% |##################################### | emitting double-array: 89% |###################################### | emitting double-array: 90% |###################################### | emitting double-array: 91% |####################################### | emitting double-array: 92% |####################################### | emitting double-array: 93% |####################################### | emitting double-array: 94% |######################################## | emitting double-array: 95% |######################################## | emitting double-array: 96% |######################################### | emitting double-array: 97% |######################################### | emitting double-array: 98% |########################################## | emitting double-array: 99% |########################################## | emitting double-array: 100% |###########################################| 2024-10-31 00:25:38 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 reading /usr/share/mecab/dic/ipadic/matrix.def ... 1316x1316 2024-10-31 00:25:38 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 emitting matrix : 0% | | emitting matrix : 1% | | emitting matrix : 2% | | emitting matrix : 3% |# | emitting matrix : 4% |# | emitting matrix : 5% |## | emitting matrix : 6% |## | emitting matrix : 7% |### | emitting matrix : 8% |### | emitting matrix : 9% |### | emitting matrix : 10% |#### | emitting matrix : 11% |#### | emitting matrix : 12% |##### | emitting matrix : 13% |##### | emitting matrix : 14% |###### | emitting matrix : 15% |###### | emitting matrix : 16% |###### | emitting matrix : 17% |####### | emitting matrix : 18% |####### | emitting matrix : 19% |######## | emitting matrix : 20% |######## | emitting matrix : 21% |######### | emitting matrix : 22% |######### | emitting matrix : 23% |######### | emitting matrix : 24% |########## | emitting matrix : 25% |########## | emitting matrix : 26% |########### | emitting matrix : 27% |########### | emitting matrix : 28% |############ | emitting matrix : 29% |############ | emitting matrix : 30% |############ | emitting matrix : 31% |############# | emitting matrix : 32% |############# | emitting matrix : 33% |############## | emitting matrix : 34% |############## | emitting matrix : 35% |############### | emitting matrix : 36% |############### | emitting matrix : 37% |############### | emitting matrix : 38% |################ | emitting matrix : 39% |################ | emitting matrix : 40% |################# | emitting matrix : 41% |################# | emitting matrix : 42% |################## | emitting matrix : 43% |################## | emitting matrix : 44% |################## | emitting matrix : 45% |################### | emitting matrix : 46% |################### | emitting matrix : 47% |#################### | emitting matrix : 48% |#################### | emitting matrix : 49% |##################### | emitting matrix : 50% |##################### | emitting matrix : 51% |##################### | emitting matrix : 52% |###################### | emitting matrix : 53% |###################### | emitting matrix : 54% |################# 2024-10-31 00:25:38 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 ###### | emitting matrix : 55% |####################### | emitting matrix : 56% |######################## | emitting matrix : 57% |######################## | emitting matrix : 58% |######################## | emitting matrix : 59% |######################### | emitting matrix : 60% |######################### | emitting matrix : 61% |########################## | emitting matrix : 62% |########################## | emitting matrix : 63% |########################### | emitting matrix : 64% |########################### | emitting matrix : 65% |########################### | emitting matrix : 66% |############################ | emitting matrix : 67% |############################ | emitting matrix : 68% |############################# | emitting matrix : 69% |############################# | emitting matrix : 70% |############################## | emitting matrix : 71% |############################## | emitting matrix : 72% |############################## | emitting matrix : 73% |############################### | emitting matrix : 74% |############################### | emitting matrix : 75% |################################ | emitting matrix : 76% |################################ | emitting matrix : 77% |################################# | emitting matrix : 78% |################################# | emitting matrix : 79% |################################# | emitting matrix : 80% |################################## | emitting matrix : 81% |################################## | emitting matrix : 82% |################################### | emitting matrix : 83% |################################### | emitting matrix : 84% |#################################### | emitting matrix : 85% |#################################### | emitting matrix : 86% |#################################### | emitting matrix : 87% |##################################### | emitting matrix : 88% |##################################### | emitting matrix : 89% |###################################### | emitting matrix : 90% |###################################### | emitting matrix : 91% |####################################### | emitting matrix : 92% |####################################### | emitting matrix : 93% |####################################### | emitting matrix : 94% |######################################## | emitting matrix : 95% |######################################## | emitting matrix : 96% |######################################### | emitting matrix : 97% |######################################### | emitting matrix : 98% |########################################## | emitting matrix : 99% |########################################## | emitting matrix : 100% |###########################################| 2024-10-31 00:25:38 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 2024-10-31 00:25:38 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 done! 2024-10-31 00:25:38 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 update-alternatives: using /var/lib/mecab/dic/ipadic-utf8 to provide /var/lib/mecab/dic/debian (mecab-dictionary) in auto mode 2024-10-31 00:25:38 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Setting up libhtml-parser-perl:amd64 (3.76-1build2) ... 2024-10-31 00:25:38 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Setting up mysql-router (8.0.36-0ubuntu0.22.04.1) ... 2024-10-31 00:25:38 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Setting up libhttp-message-perl (6.36-1) ... 2024-10-31 00:25:38 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Setting up mysql-server-8.0 (8.0.36-0ubuntu0.22.04.1) ... 2024-10-31 00:25:38 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 update-alternatives: using /etc/mysql/mysql.cnf to provide /etc/mysql/my.cnf (my.cnf) in auto mode 2024-10-31 00:25:39 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Renaming removed key_buffer and myisam-recover options (if present) 2024-10-31 00:25:45 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for mysql-innodb-cluster/2: ok=true 2024-10-31 00:25:46 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for mysql-innodb-cluster/2: ok=true 2024-10-31 00:25:46 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for mysql-innodb-cluster/2: ok=true 2024-10-31 00:25:47 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for mysql-innodb-cluster/2 : {3 {map[mysql-innodb-cluster/0:{0}] map[] []}} 2024-10-31 00:25:49 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for mysql-innodb-cluster/2 : {4 {map[mysql-innodb-cluster/0:{0}] map[] []}} 2024-10-31 00:25:54 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 mysqld will log errors to /var/log/mysql/error.log 2024-10-31 00:25:55 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for mysql-innodb-cluster/2 : {4 {map[mysql-innodb-cluster/0:{1}] map[] []}} 2024-10-31 00:25:56 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 mysqld is running as pid 8028 2024-10-31 00:25:59 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Created symlink /etc/systemd/system/multi-user.target.wants/mysql.service → /lib/systemd/system/mysql.service. 2024-10-31 00:26:03 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Setting up libpython2.7:amd64 (2.7.18-13ubuntu1.2) ... 2024-10-31 00:26:03 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Setting up libcgi-pm-perl (4.54-1) ... 2024-10-31 00:26:03 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Setting up libhtml-template-perl (2.97-1.1) ... 2024-10-31 00:26:03 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Setting up libcgi-fast-perl (1:2.15-1) ... 2024-10-31 00:26:03 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Processing triggers for man-db (2.10.2-1) ... 2024-10-31 00:26:03 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 Processing triggers for libc-bin (2.35-0ubuntu3.7) ... 2024-10-31 00:26:04 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-created logger.go:60 NEEDRESTART-VER: 3.5 2024-10-31 00:26:08 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag mysql-innodb-cluster-installed 2024-10-31 00:26:08 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Configuring TLS with certificates interface=None 2024-10-31 00:26:08 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Writing file /etc/mysql/mysql.conf.d/mysqld.cnf root:mysql 640 2024-10-31 00:26:11 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer> tracer: set flag charm.installed tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:70:create_local_cluster_user tracer: -- dequeue handler reactive/mysql_innodb_cluster_handlers.py:54:non_leader_install 2024-10-31 00:26:11 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:26:11 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:70:create_local_cluster_user 2024-10-31 00:26:11 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Creating local cluster user. 2024-10-31 00:26:11 WARNING unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: This instance is not yet clustered: cannot determine the cluster status. 2024-10-31 00:26:11 WARNING unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Cannot determine the cluster primary RW node for writes. 2024-10-31 00:26:11 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Opening db connection for root@None 2024-10-31 00:26:12 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Revoke all privileges for use 'clusteruser'@'252.17.137.230' 2024-10-31 00:26:12 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Grant ALL PRIVILEGES for use 'clusteruser'@'252.17.137.230' 2024-10-31 00:26:12 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Revoke all privileges for use 'clusteruser'@'localhost' 2024-10-31 00:26:12 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Grant ALL PRIVILEGES for use 'clusteruser'@'localhost' 2024-10-31 00:26:12 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer> tracer: set flag local.cluster.user-created tracer: -- dequeue handler reactive/mysql_innodb_cluster_handlers.py:70:create_local_cluster_user 2024-10-31 00:26:12 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Running _assess_status() 2024-10-31 00:26:13 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: coordinator.DelayedActionCoordinator Publishing state 2024-10-31 00:26:14 INFO juju.worker.uniter.operation runhook.go:159 ran "db-router-relation-created" hook (via explicit, bespoke hook script) 2024-10-31 00:26:14 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-created (43; app: dashboard-mysql-router) hook" for mysql-innodb-cluster/2 2024-10-31 00:26:14 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 00:26:14 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run relation-created (43; app: dashboard-mysql-router) hook) 2024-10-31 00:26:14 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 00:26:14 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-created (41; app: neutron-mysql-router) hook for mysql-innodb-cluster/2 2024-10-31 00:26:14 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run relation-created (41; app: neutron-mysql-router) hook) 2024-10-31 00:26:14 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run relation-created (41; app: neutron-mysql-router) hook) 2024-10-31 00:26:14 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-created (41; app: neutron-mysql-router) hook" for mysql-innodb-cluster/2 2024-10-31 00:26:14 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-created (41; app: neutron-mysql-router) hook" for mysql-innodb-cluster/2 2024-10-31 00:26:14 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 00:26:14 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for mysql-innodb-cluster/2 : {4 {map[mysql-innodb-cluster/1:{1}] map[] []}} 2024-10-31 00:26:15 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: Reactive main running for hook db-router-relation-created 2024-10-31 00:26:16 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:26:16 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.ssl_cert 2024-10-31 00:26:16 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.ssl_key 2024-10-31 00:26:16 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.ssl_ca 2024-10-31 00:26:16 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.set.source 2024-10-31 00:26:16 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.source 2024-10-31 00:26:16 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.set.cluster-name 2024-10-31 00:26:16 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.cluster-name 2024-10-31 00:26:16 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.set.auto-rejoin-tries 2024-10-31 00:26:16 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.auto-rejoin-tries 2024-10-31 00:26:16 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.set.expel-timeout 2024-10-31 00:26:16 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.expel-timeout 2024-10-31 00:26:16 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.set.innodb-buffer-pool-size 2024-10-31 00:26:16 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.set.innodb-change-buffering 2024-10-31 00:26:16 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.innodb-change-buffering 2024-10-31 00:26:16 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.set.innodb-io-capacity 2024-10-31 00:26:16 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.innodb-io-capacity 2024-10-31 00:26:16 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.set.innodb-file-per-table 2024-10-31 00:26:16 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.innodb-file-per-table 2024-10-31 00:26:16 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.set.tuning-level 2024-10-31 00:26:16 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.tuning-level 2024-10-31 00:26:17 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.set.table-open-cache 2024-10-31 00:26:17 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.table-open-cache 2024-10-31 00:26:17 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.set.max-connections 2024-10-31 00:26:17 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.enable-binlogs 2024-10-31 00:26:17 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.set.binlogs-path 2024-10-31 00:26:17 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.binlogs-path 2024-10-31 00:26:17 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.set.binlogs-max-size 2024-10-31 00:26:17 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.binlogs-max-size 2024-10-31 00:26:17 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.set.binlogs-expire-days 2024-10-31 00:26:17 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.binlogs-expire-days 2024-10-31 00:26:17 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.prefer-ipv6 2024-10-31 00:26:17 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.set.wait-timeout 2024-10-31 00:26:17 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.wait-timeout 2024-10-31 00:26:17 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.os-db-router-hostname 2024-10-31 00:26:17 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: Initializing Snap Layer 2024-10-31 00:26:18 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: coordinator.DelayedActionCoordinator Loading state 2024-10-31 00:26:18 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: Coordinator: Initializing coordinator layer 2024-10-31 00:26:18 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: Initializing Leadership Layer (is follower) 2024-10-31 00:26:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag leadership.changed.cluster-password 2024-10-31 00:26:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag leadership.set.cluster-password 2024-10-31 00:26:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag leadership.changed.coordinator 2024-10-31 00:26:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag leadership.set.coordinator 2024-10-31 00:26:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag leadership.changed.coordinator-released-locks-counts 2024-10-31 00:26:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag leadership.set.coordinator-released-locks-counts 2024-10-31 00:26:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: cleared flag leadership.changed.mysql.passwd 2024-10-31 00:26:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer> tracer: starting handler dispatch, 50 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag leadership.changed tracer: set flag leadership.changed.cluster-password tracer: set flag leadership.changed.coordinator tracer: set flag leadership.changed.coordinator-released-locks-counts tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 00:26:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: hooks phase, 0 handlers queued 2024-10-31 00:26:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer> tracer: main dispatch loop, 1 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:26:18 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:26:18 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: coordinator.DelayedActionCoordinator Publishing state 2024-10-31 00:26:19 INFO juju.worker.uniter.operation runhook.go:159 ran "db-router-relation-created" hook (via explicit, bespoke hook script) 2024-10-31 00:26:19 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-created (41; app: neutron-mysql-router) hook" for mysql-innodb-cluster/2 2024-10-31 00:26:20 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 00:26:20 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run relation-created (41; app: neutron-mysql-router) hook) 2024-10-31 00:26:20 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 00:26:20 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-created (45; app: heat-mysql-router) hook for mysql-innodb-cluster/2 2024-10-31 00:26:20 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run relation-created (45; app: heat-mysql-router) hook) 2024-10-31 00:26:20 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run relation-created (45; app: heat-mysql-router) hook) 2024-10-31 00:26:20 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-created (45; app: heat-mysql-router) hook" for mysql-innodb-cluster/2 2024-10-31 00:26:20 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-created (45; app: heat-mysql-router) hook" for mysql-innodb-cluster/2 2024-10-31 00:26:20 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 00:26:21 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: Reactive main running for hook db-router-relation-created 2024-10-31 00:26:21 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:26:21 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.ssl_cert 2024-10-31 00:26:21 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.ssl_key 2024-10-31 00:26:22 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.ssl_ca 2024-10-31 00:26:22 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.set.source 2024-10-31 00:26:22 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.source 2024-10-31 00:26:22 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.set.cluster-name 2024-10-31 00:26:22 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.cluster-name 2024-10-31 00:26:22 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.set.auto-rejoin-tries 2024-10-31 00:26:22 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.auto-rejoin-tries 2024-10-31 00:26:22 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.set.expel-timeout 2024-10-31 00:26:22 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.expel-timeout 2024-10-31 00:26:22 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.set.innodb-buffer-pool-size 2024-10-31 00:26:22 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.set.innodb-change-buffering 2024-10-31 00:26:22 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.innodb-change-buffering 2024-10-31 00:26:22 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.set.innodb-io-capacity 2024-10-31 00:26:22 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.innodb-io-capacity 2024-10-31 00:26:22 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.set.innodb-file-per-table 2024-10-31 00:26:22 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.innodb-file-per-table 2024-10-31 00:26:22 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.set.tuning-level 2024-10-31 00:26:22 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.tuning-level 2024-10-31 00:26:22 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.set.table-open-cache 2024-10-31 00:26:22 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.table-open-cache 2024-10-31 00:26:22 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.set.max-connections 2024-10-31 00:26:22 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.enable-binlogs 2024-10-31 00:26:22 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.set.binlogs-path 2024-10-31 00:26:22 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.binlogs-path 2024-10-31 00:26:23 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.set.binlogs-max-size 2024-10-31 00:26:23 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.binlogs-max-size 2024-10-31 00:26:23 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.set.binlogs-expire-days 2024-10-31 00:26:23 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.binlogs-expire-days 2024-10-31 00:26:23 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.prefer-ipv6 2024-10-31 00:26:23 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.set.wait-timeout 2024-10-31 00:26:23 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.wait-timeout 2024-10-31 00:26:23 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.os-db-router-hostname 2024-10-31 00:26:23 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: Initializing Snap Layer 2024-10-31 00:26:23 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: coordinator.DelayedActionCoordinator Loading state 2024-10-31 00:26:23 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: Coordinator: Initializing coordinator layer 2024-10-31 00:26:23 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: Initializing Leadership Layer (is follower) 2024-10-31 00:26:23 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: cleared flag leadership.changed.cluster-password 2024-10-31 00:26:23 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: cleared flag leadership.changed.coordinator 2024-10-31 00:26:24 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: cleared flag leadership.changed.coordinator-released-locks-counts 2024-10-31 00:26:24 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: cleared flag leadership.changed 2024-10-31 00:26:24 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer> tracer: starting handler dispatch, 46 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 00:26:24 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: hooks phase, 0 handlers queued 2024-10-31 00:26:24 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer> tracer: main dispatch loop, 1 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:26:24 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:26:24 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: coordinator.DelayedActionCoordinator Publishing state 2024-10-31 00:26:24 INFO juju.worker.uniter.operation runhook.go:159 ran "db-router-relation-created" hook (via explicit, bespoke hook script) 2024-10-31 00:26:24 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-created (45; app: heat-mysql-router) hook" for mysql-innodb-cluster/2 2024-10-31 00:26:24 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 00:26:24 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run relation-created (45; app: heat-mysql-router) hook) 2024-10-31 00:26:24 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 00:26:24 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-created (39; app: nova-mysql-router) hook for mysql-innodb-cluster/2 2024-10-31 00:26:24 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run relation-created (39; app: nova-mysql-router) hook) 2024-10-31 00:26:24 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run relation-created (39; app: nova-mysql-router) hook) 2024-10-31 00:26:24 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-created (39; app: nova-mysql-router) hook" for mysql-innodb-cluster/2 2024-10-31 00:26:25 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-created (39; app: nova-mysql-router) hook" for mysql-innodb-cluster/2 2024-10-31 00:26:25 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 00:26:25 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for mysql-innodb-cluster/2 2024-10-31 00:26:25 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: Reactive main running for hook db-router-relation-created 2024-10-31 00:26:26 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:26:26 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.ssl_cert 2024-10-31 00:26:26 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.ssl_key 2024-10-31 00:26:26 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.ssl_ca 2024-10-31 00:26:26 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.set.source 2024-10-31 00:26:26 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.source 2024-10-31 00:26:26 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.set.cluster-name 2024-10-31 00:26:26 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.cluster-name 2024-10-31 00:26:27 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.set.auto-rejoin-tries 2024-10-31 00:26:27 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.auto-rejoin-tries 2024-10-31 00:26:27 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.set.expel-timeout 2024-10-31 00:26:27 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.expel-timeout 2024-10-31 00:26:27 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.set.innodb-buffer-pool-size 2024-10-31 00:26:27 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.set.innodb-change-buffering 2024-10-31 00:26:27 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.innodb-change-buffering 2024-10-31 00:26:27 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.set.innodb-io-capacity 2024-10-31 00:26:27 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.innodb-io-capacity 2024-10-31 00:26:27 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.set.innodb-file-per-table 2024-10-31 00:26:27 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.innodb-file-per-table 2024-10-31 00:26:27 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.set.tuning-level 2024-10-31 00:26:27 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.tuning-level 2024-10-31 00:26:27 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.set.table-open-cache 2024-10-31 00:26:27 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.table-open-cache 2024-10-31 00:26:27 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.set.max-connections 2024-10-31 00:26:27 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.enable-binlogs 2024-10-31 00:26:27 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.set.binlogs-path 2024-10-31 00:26:27 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.binlogs-path 2024-10-31 00:26:27 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.set.binlogs-max-size 2024-10-31 00:26:28 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.binlogs-max-size 2024-10-31 00:26:28 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.set.binlogs-expire-days 2024-10-31 00:26:28 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.binlogs-expire-days 2024-10-31 00:26:28 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.prefer-ipv6 2024-10-31 00:26:28 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.set.wait-timeout 2024-10-31 00:26:28 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.wait-timeout 2024-10-31 00:26:28 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.os-db-router-hostname 2024-10-31 00:26:28 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: Initializing Snap Layer 2024-10-31 00:26:28 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: coordinator.DelayedActionCoordinator Loading state 2024-10-31 00:26:28 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: Coordinator: Initializing coordinator layer 2024-10-31 00:26:28 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: Initializing Leadership Layer (is follower) 2024-10-31 00:26:28 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer> tracer: starting handler dispatch, 46 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 00:26:28 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: hooks phase, 0 handlers queued 2024-10-31 00:26:28 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer> tracer: main dispatch loop, 1 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:26:28 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:26:28 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: coordinator.DelayedActionCoordinator Publishing state 2024-10-31 00:26:29 INFO juju.worker.uniter.operation runhook.go:159 ran "db-router-relation-created" hook (via explicit, bespoke hook script) 2024-10-31 00:26:29 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-created (39; app: nova-mysql-router) hook" for mysql-innodb-cluster/2 2024-10-31 00:26:29 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 00:26:29 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run relation-created (39; app: nova-mysql-router) hook) 2024-10-31 00:26:29 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 00:26:29 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-created (37; app: glance-mysql-router) hook for mysql-innodb-cluster/2 2024-10-31 00:26:29 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run relation-created (37; app: glance-mysql-router) hook) 2024-10-31 00:26:29 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run relation-created (37; app: glance-mysql-router) hook) 2024-10-31 00:26:29 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-created (37; app: glance-mysql-router) hook" for mysql-innodb-cluster/2 2024-10-31 00:26:29 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-created (37; app: glance-mysql-router) hook" for mysql-innodb-cluster/2 2024-10-31 00:26:29 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 00:26:30 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: Reactive main running for hook db-router-relation-created 2024-10-31 00:26:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:26:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.ssl_cert 2024-10-31 00:26:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.ssl_key 2024-10-31 00:26:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.ssl_ca 2024-10-31 00:26:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.set.source 2024-10-31 00:26:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.source 2024-10-31 00:26:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.set.cluster-name 2024-10-31 00:26:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.cluster-name 2024-10-31 00:26:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.set.auto-rejoin-tries 2024-10-31 00:26:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.auto-rejoin-tries 2024-10-31 00:26:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.set.expel-timeout 2024-10-31 00:26:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.expel-timeout 2024-10-31 00:26:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.set.innodb-buffer-pool-size 2024-10-31 00:26:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.set.innodb-change-buffering 2024-10-31 00:26:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.innodb-change-buffering 2024-10-31 00:26:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.set.innodb-io-capacity 2024-10-31 00:26:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.innodb-io-capacity 2024-10-31 00:26:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.set.innodb-file-per-table 2024-10-31 00:26:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.innodb-file-per-table 2024-10-31 00:26:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.set.tuning-level 2024-10-31 00:26:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.tuning-level 2024-10-31 00:26:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.set.table-open-cache 2024-10-31 00:26:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.table-open-cache 2024-10-31 00:26:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.set.max-connections 2024-10-31 00:26:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.enable-binlogs 2024-10-31 00:26:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.set.binlogs-path 2024-10-31 00:26:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.binlogs-path 2024-10-31 00:26:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.set.binlogs-max-size 2024-10-31 00:26:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.binlogs-max-size 2024-10-31 00:26:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.set.binlogs-expire-days 2024-10-31 00:26:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.binlogs-expire-days 2024-10-31 00:26:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.prefer-ipv6 2024-10-31 00:26:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.set.wait-timeout 2024-10-31 00:26:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.wait-timeout 2024-10-31 00:26:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.os-db-router-hostname 2024-10-31 00:26:32 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: Initializing Snap Layer 2024-10-31 00:26:33 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: coordinator.DelayedActionCoordinator Loading state 2024-10-31 00:26:33 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: Coordinator: Initializing coordinator layer 2024-10-31 00:26:33 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: Initializing Leadership Layer (is follower) 2024-10-31 00:26:33 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer> tracer: starting handler dispatch, 46 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 00:26:33 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: hooks phase, 0 handlers queued 2024-10-31 00:26:33 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer> tracer: main dispatch loop, 1 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:26:33 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:26:33 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: coordinator.DelayedActionCoordinator Publishing state 2024-10-31 00:26:33 INFO juju.worker.uniter.operation runhook.go:159 ran "db-router-relation-created" hook (via explicit, bespoke hook script) 2024-10-31 00:26:33 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-created (37; app: glance-mysql-router) hook" for mysql-innodb-cluster/2 2024-10-31 00:26:33 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 00:26:33 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run relation-created (37; app: glance-mysql-router) hook) 2024-10-31 00:26:33 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 00:26:33 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-created (35; app: keystone-mysql-router) hook for mysql-innodb-cluster/2 2024-10-31 00:26:33 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run relation-created (35; app: keystone-mysql-router) hook) 2024-10-31 00:26:33 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run relation-created (35; app: keystone-mysql-router) hook) 2024-10-31 00:26:33 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-created (35; app: keystone-mysql-router) hook" for mysql-innodb-cluster/2 2024-10-31 00:26:33 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-created (35; app: keystone-mysql-router) hook" for mysql-innodb-cluster/2 2024-10-31 00:26:33 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 00:26:34 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: Reactive main running for hook db-router-relation-created 2024-10-31 00:26:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:26:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.ssl_cert 2024-10-31 00:26:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.ssl_key 2024-10-31 00:26:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.ssl_ca 2024-10-31 00:26:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.set.source 2024-10-31 00:26:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.source 2024-10-31 00:26:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.set.cluster-name 2024-10-31 00:26:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.cluster-name 2024-10-31 00:26:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.set.auto-rejoin-tries 2024-10-31 00:26:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.auto-rejoin-tries 2024-10-31 00:26:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.set.expel-timeout 2024-10-31 00:26:36 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.expel-timeout 2024-10-31 00:26:36 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.set.innodb-buffer-pool-size 2024-10-31 00:26:36 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.set.innodb-change-buffering 2024-10-31 00:26:36 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.innodb-change-buffering 2024-10-31 00:26:36 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.set.innodb-io-capacity 2024-10-31 00:26:36 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.innodb-io-capacity 2024-10-31 00:26:36 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.set.innodb-file-per-table 2024-10-31 00:26:36 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.innodb-file-per-table 2024-10-31 00:26:36 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.set.tuning-level 2024-10-31 00:26:36 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.tuning-level 2024-10-31 00:26:36 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.set.table-open-cache 2024-10-31 00:26:36 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.table-open-cache 2024-10-31 00:26:36 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.set.max-connections 2024-10-31 00:26:36 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.enable-binlogs 2024-10-31 00:26:36 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.set.binlogs-path 2024-10-31 00:26:36 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.binlogs-path 2024-10-31 00:26:36 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.set.binlogs-max-size 2024-10-31 00:26:36 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.binlogs-max-size 2024-10-31 00:26:36 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.set.binlogs-expire-days 2024-10-31 00:26:36 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.binlogs-expire-days 2024-10-31 00:26:36 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.prefer-ipv6 2024-10-31 00:26:36 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.set.wait-timeout 2024-10-31 00:26:36 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.wait-timeout 2024-10-31 00:26:36 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.os-db-router-hostname 2024-10-31 00:26:36 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: Initializing Snap Layer 2024-10-31 00:26:37 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: coordinator.DelayedActionCoordinator Loading state 2024-10-31 00:26:37 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: Coordinator: Initializing coordinator layer 2024-10-31 00:26:37 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: Initializing Leadership Layer (is follower) 2024-10-31 00:26:37 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer> tracer: starting handler dispatch, 46 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 00:26:37 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: hooks phase, 0 handlers queued 2024-10-31 00:26:37 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer> tracer: main dispatch loop, 1 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:26:37 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:26:37 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: coordinator.DelayedActionCoordinator Publishing state 2024-10-31 00:26:37 INFO juju.worker.uniter.operation runhook.go:159 ran "db-router-relation-created" hook (via explicit, bespoke hook script) 2024-10-31 00:26:37 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-created (35; app: keystone-mysql-router) hook" for mysql-innodb-cluster/2 2024-10-31 00:26:37 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 00:26:37 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run relation-created (35; app: keystone-mysql-router) hook) 2024-10-31 00:26:37 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 00:26:37 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-created (4; app: mysql-innodb-cluster) hook for mysql-innodb-cluster/2 2024-10-31 00:26:37 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run relation-created (4; app: mysql-innodb-cluster) hook) 2024-10-31 00:26:37 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run relation-created (4; app: mysql-innodb-cluster) hook) 2024-10-31 00:26:37 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-created (4; app: mysql-innodb-cluster) hook" for mysql-innodb-cluster/2 2024-10-31 00:26:38 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-created (4; app: mysql-innodb-cluster) hook" for mysql-innodb-cluster/2 2024-10-31 00:26:38 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running coordinator-relation-created hook 2024-10-31 00:26:38 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 00:26:38 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: Reactive main running for hook coordinator-relation-created 2024-10-31 00:26:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:26:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.default.ssl_cert 2024-10-31 00:26:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.default.ssl_key 2024-10-31 00:26:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.default.ssl_ca 2024-10-31 00:26:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.set.source 2024-10-31 00:26:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.default.source 2024-10-31 00:26:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.set.cluster-name 2024-10-31 00:26:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.default.cluster-name 2024-10-31 00:26:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.set.auto-rejoin-tries 2024-10-31 00:26:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.default.auto-rejoin-tries 2024-10-31 00:26:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.set.expel-timeout 2024-10-31 00:26:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.default.expel-timeout 2024-10-31 00:26:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.set.innodb-buffer-pool-size 2024-10-31 00:26:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.set.innodb-change-buffering 2024-10-31 00:26:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.default.innodb-change-buffering 2024-10-31 00:26:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.set.innodb-io-capacity 2024-10-31 00:26:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.default.innodb-io-capacity 2024-10-31 00:26:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.set.innodb-file-per-table 2024-10-31 00:26:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.default.innodb-file-per-table 2024-10-31 00:26:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.set.tuning-level 2024-10-31 00:26:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.default.tuning-level 2024-10-31 00:26:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.set.table-open-cache 2024-10-31 00:26:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.default.table-open-cache 2024-10-31 00:26:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.set.max-connections 2024-10-31 00:26:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.default.enable-binlogs 2024-10-31 00:26:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.set.binlogs-path 2024-10-31 00:26:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.default.binlogs-path 2024-10-31 00:26:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.set.binlogs-max-size 2024-10-31 00:26:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.default.binlogs-max-size 2024-10-31 00:26:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.set.binlogs-expire-days 2024-10-31 00:26:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.default.binlogs-expire-days 2024-10-31 00:26:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.default.prefer-ipv6 2024-10-31 00:26:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.set.wait-timeout 2024-10-31 00:26:41 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.default.wait-timeout 2024-10-31 00:26:41 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.default.os-db-router-hostname 2024-10-31 00:26:41 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: Initializing Snap Layer 2024-10-31 00:26:41 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: coordinator.DelayedActionCoordinator Loading state 2024-10-31 00:26:41 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: Coordinator: Initializing coordinator layer 2024-10-31 00:26:41 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: Initializing Leadership Layer (is follower) 2024-10-31 00:26:41 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer> tracer: starting handler dispatch, 46 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 00:26:41 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: hooks phase, 0 handlers queued 2024-10-31 00:26:41 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer> tracer: main dispatch loop, 1 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:26:41 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:26:41 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: coordinator.DelayedActionCoordinator Publishing state 2024-10-31 00:26:42 INFO juju.worker.uniter.operation runhook.go:159 ran "coordinator-relation-created" hook (via explicit, bespoke hook script) 2024-10-31 00:26:42 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-created (4; app: mysql-innodb-cluster) hook" for mysql-innodb-cluster/2 2024-10-31 00:26:42 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 00:26:42 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run relation-created (4; app: mysql-innodb-cluster) hook) 2024-10-31 00:26:42 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 00:26:42 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-created (3; app: mysql-innodb-cluster) hook for mysql-innodb-cluster/2 2024-10-31 00:26:42 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run relation-created (3; app: mysql-innodb-cluster) hook) 2024-10-31 00:26:42 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run relation-created (3; app: mysql-innodb-cluster) hook) 2024-10-31 00:26:42 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-created (3; app: mysql-innodb-cluster) hook" for mysql-innodb-cluster/2 2024-10-31 00:26:42 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-created (3; app: mysql-innodb-cluster) hook" for mysql-innodb-cluster/2 2024-10-31 00:26:42 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running cluster-relation-created hook 2024-10-31 00:26:42 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 00:26:43 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Reactive main running for hook cluster-relation-created 2024-10-31 00:26:43 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:26:44 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.ssl_cert 2024-10-31 00:26:44 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.ssl_key 2024-10-31 00:26:44 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.ssl_ca 2024-10-31 00:26:44 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.source 2024-10-31 00:26:44 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.source 2024-10-31 00:26:44 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.cluster-name 2024-10-31 00:26:44 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.cluster-name 2024-10-31 00:26:44 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.auto-rejoin-tries 2024-10-31 00:26:44 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.auto-rejoin-tries 2024-10-31 00:26:44 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.expel-timeout 2024-10-31 00:26:44 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.expel-timeout 2024-10-31 00:26:44 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.innodb-buffer-pool-size 2024-10-31 00:26:44 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.innodb-change-buffering 2024-10-31 00:26:44 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.innodb-change-buffering 2024-10-31 00:26:44 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.innodb-io-capacity 2024-10-31 00:26:44 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.innodb-io-capacity 2024-10-31 00:26:44 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.innodb-file-per-table 2024-10-31 00:26:44 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.innodb-file-per-table 2024-10-31 00:26:44 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.tuning-level 2024-10-31 00:26:44 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.tuning-level 2024-10-31 00:26:44 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.table-open-cache 2024-10-31 00:26:44 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.table-open-cache 2024-10-31 00:26:44 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.max-connections 2024-10-31 00:26:44 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.enable-binlogs 2024-10-31 00:26:44 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.binlogs-path 2024-10-31 00:26:44 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.binlogs-path 2024-10-31 00:26:44 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.binlogs-max-size 2024-10-31 00:26:45 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.binlogs-max-size 2024-10-31 00:26:45 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.binlogs-expire-days 2024-10-31 00:26:45 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.binlogs-expire-days 2024-10-31 00:26:45 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.prefer-ipv6 2024-10-31 00:26:45 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.wait-timeout 2024-10-31 00:26:45 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.wait-timeout 2024-10-31 00:26:45 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.os-db-router-hostname 2024-10-31 00:26:45 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Initializing Snap Layer 2024-10-31 00:26:45 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: coordinator.DelayedActionCoordinator Loading state 2024-10-31 00:26:45 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Coordinator: Initializing coordinator layer 2024-10-31 00:26:45 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Initializing Leadership Layer (is follower) 2024-10-31 00:26:45 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer> tracer: starting handler dispatch, 46 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 00:26:45 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: hooks phase, 0 handlers queued 2024-10-31 00:26:45 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer> tracer: main dispatch loop, 1 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:26:45 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:26:45 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: coordinator.DelayedActionCoordinator Publishing state 2024-10-31 00:26:46 INFO juju.worker.uniter.operation runhook.go:159 ran "cluster-relation-created" hook (via explicit, bespoke hook script) 2024-10-31 00:26:46 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-created (3; app: mysql-innodb-cluster) hook" for mysql-innodb-cluster/2 2024-10-31 00:26:46 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 00:26:46 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run relation-created (3; app: mysql-innodb-cluster) hook) 2024-10-31 00:26:46 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 00:26:46 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-created (47; app: placement-mysql-router) hook for mysql-innodb-cluster/2 2024-10-31 00:26:46 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run relation-created (47; app: placement-mysql-router) hook) 2024-10-31 00:26:46 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run relation-created (47; app: placement-mysql-router) hook) 2024-10-31 00:26:46 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-created (47; app: placement-mysql-router) hook" for mysql-innodb-cluster/2 2024-10-31 00:26:46 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-created (47; app: placement-mysql-router) hook" for mysql-innodb-cluster/2 2024-10-31 00:26:46 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running db-router-relation-created hook 2024-10-31 00:26:46 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 00:26:47 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: Reactive main running for hook db-router-relation-created 2024-10-31 00:26:48 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:26:48 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.ssl_cert 2024-10-31 00:26:48 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.ssl_key 2024-10-31 00:26:48 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.ssl_ca 2024-10-31 00:26:48 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.set.source 2024-10-31 00:26:48 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.source 2024-10-31 00:26:48 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.set.cluster-name 2024-10-31 00:26:48 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.cluster-name 2024-10-31 00:26:48 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.set.auto-rejoin-tries 2024-10-31 00:26:48 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.auto-rejoin-tries 2024-10-31 00:26:48 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.set.expel-timeout 2024-10-31 00:26:48 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.expel-timeout 2024-10-31 00:26:48 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.set.innodb-buffer-pool-size 2024-10-31 00:26:48 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.set.innodb-change-buffering 2024-10-31 00:26:48 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.innodb-change-buffering 2024-10-31 00:26:48 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.set.innodb-io-capacity 2024-10-31 00:26:48 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.innodb-io-capacity 2024-10-31 00:26:48 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.set.innodb-file-per-table 2024-10-31 00:26:48 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.innodb-file-per-table 2024-10-31 00:26:48 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.set.tuning-level 2024-10-31 00:26:48 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.tuning-level 2024-10-31 00:26:48 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.set.table-open-cache 2024-10-31 00:26:48 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for mysql-innodb-cluster/2 : {3 {map[mysql-innodb-cluster/0:{1}] map[] []}} 2024-10-31 00:26:49 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.table-open-cache 2024-10-31 00:26:49 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.set.max-connections 2024-10-31 00:26:49 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.enable-binlogs 2024-10-31 00:26:49 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.set.binlogs-path 2024-10-31 00:26:49 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.binlogs-path 2024-10-31 00:26:49 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.set.binlogs-max-size 2024-10-31 00:26:49 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.binlogs-max-size 2024-10-31 00:26:49 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.set.binlogs-expire-days 2024-10-31 00:26:49 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.binlogs-expire-days 2024-10-31 00:26:49 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.prefer-ipv6 2024-10-31 00:26:49 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.set.wait-timeout 2024-10-31 00:26:49 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.wait-timeout 2024-10-31 00:26:49 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.os-db-router-hostname 2024-10-31 00:26:49 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: Initializing Snap Layer 2024-10-31 00:26:50 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: coordinator.DelayedActionCoordinator Loading state 2024-10-31 00:26:50 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: Coordinator: Initializing coordinator layer 2024-10-31 00:26:50 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: Initializing Leadership Layer (is follower) 2024-10-31 00:26:50 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer> tracer: starting handler dispatch, 46 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 00:26:50 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: hooks phase, 0 handlers queued 2024-10-31 00:26:50 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer> tracer: main dispatch loop, 1 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:26:50 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:26:50 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: coordinator.DelayedActionCoordinator Publishing state 2024-10-31 00:26:50 INFO juju.worker.uniter.operation runhook.go:159 ran "db-router-relation-created" hook (via explicit, bespoke hook script) 2024-10-31 00:26:50 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-created (47; app: placement-mysql-router) hook" for mysql-innodb-cluster/2 2024-10-31 00:26:50 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 00:26:50 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run relation-created (47; app: placement-mysql-router) hook) 2024-10-31 00:26:50 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 00:26:50 DEBUG juju.worker.uniter.operation executor.go:85 running operation run leader-settings-changed hook for mysql-innodb-cluster/2 2024-10-31 00:26:50 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run leader-settings-changed hook) 2024-10-31 00:26:50 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run leader-settings-changed hook) 2024-10-31 00:26:50 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run leader-settings-changed hook" for mysql-innodb-cluster/2 2024-10-31 00:26:50 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run leader-settings-changed hook" for mysql-innodb-cluster/2 2024-10-31 00:26:50 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running leader-settings-changed hook 2024-10-31 00:26:51 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 00:26:51 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Reactive main running for hook leader-settings-changed 2024-10-31 00:26:52 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Initializing Snap Layer 2024-10-31 00:26:52 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator.DelayedActionCoordinator Loading state 2024-10-31 00:26:52 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Coordinator: Initializing coordinator layer 2024-10-31 00:26:52 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Initializing Leadership Layer (is follower) 2024-10-31 00:26:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: starting handler dispatch, 11 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 00:26:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-10-31 00:26:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: main dispatch loop, 1 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:26:52 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:26:53 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator.DelayedActionCoordinator Publishing state 2024-10-31 00:26:53 INFO juju.worker.uniter.operation runhook.go:159 ran "leader-settings-changed" hook (via explicit, bespoke hook script) 2024-10-31 00:26:53 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run leader-settings-changed hook" for mysql-innodb-cluster/2 2024-10-31 00:26:53 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 00:26:53 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run leader-settings-changed hook) 2024-10-31 00:26:53 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 00:26:53 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 00:26:53 DEBUG juju.worker.uniter.operation executor.go:85 running operation run config-changed hook for mysql-innodb-cluster/2 2024-10-31 00:26:53 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run config-changed hook) 2024-10-31 00:26:53 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run config-changed hook) 2024-10-31 00:26:53 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run config-changed hook" for mysql-innodb-cluster/2 2024-10-31 00:26:53 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run config-changed hook" for mysql-innodb-cluster/2 2024-10-31 00:26:53 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running config-changed hook 2024-10-31 00:26:53 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 00:26:54 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Reactive main running for hook config-changed 2024-10-31 00:26:55 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:26:55 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.ssl_cert 2024-10-31 00:26:55 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.ssl_key 2024-10-31 00:26:55 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.ssl_ca 2024-10-31 00:26:55 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.source 2024-10-31 00:26:55 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.source 2024-10-31 00:26:55 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.cluster-name 2024-10-31 00:26:55 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.cluster-name 2024-10-31 00:26:55 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.auto-rejoin-tries 2024-10-31 00:26:55 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.auto-rejoin-tries 2024-10-31 00:26:55 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.expel-timeout 2024-10-31 00:26:55 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.expel-timeout 2024-10-31 00:26:55 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-buffer-pool-size 2024-10-31 00:26:55 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-change-buffering 2024-10-31 00:26:55 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.innodb-change-buffering 2024-10-31 00:26:55 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-io-capacity 2024-10-31 00:26:56 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.innodb-io-capacity 2024-10-31 00:26:56 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-file-per-table 2024-10-31 00:26:56 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.innodb-file-per-table 2024-10-31 00:26:56 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.tuning-level 2024-10-31 00:26:56 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.tuning-level 2024-10-31 00:26:56 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.table-open-cache 2024-10-31 00:26:56 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.table-open-cache 2024-10-31 00:26:56 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.max-connections 2024-10-31 00:26:56 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.enable-binlogs 2024-10-31 00:26:56 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.binlogs-path 2024-10-31 00:26:56 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.binlogs-path 2024-10-31 00:26:56 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.binlogs-max-size 2024-10-31 00:26:56 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.binlogs-max-size 2024-10-31 00:26:56 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.binlogs-expire-days 2024-10-31 00:26:56 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.binlogs-expire-days 2024-10-31 00:26:56 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.prefer-ipv6 2024-10-31 00:26:56 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.wait-timeout 2024-10-31 00:26:56 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.wait-timeout 2024-10-31 00:26:56 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.os-db-router-hostname 2024-10-31 00:26:56 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Initializing Snap Layer 2024-10-31 00:26:57 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator.DelayedActionCoordinator Loading state 2024-10-31 00:26:57 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Coordinator: Initializing coordinator layer 2024-10-31 00:26:57 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Initializing Leadership Layer (is follower) 2024-10-31 00:26:57 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: starting handler dispatch, 46 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 00:26:57 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-10-31 00:26:57 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: main dispatch loop, 1 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:26:57 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:26:57 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator.DelayedActionCoordinator Publishing state 2024-10-31 00:26:58 INFO juju.worker.uniter.operation runhook.go:159 ran "config-changed" hook (via explicit, bespoke hook script) 2024-10-31 00:26:58 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run config-changed hook" for mysql-innodb-cluster/2 2024-10-31 00:26:58 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 00:26:58 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run config-changed hook) 2024-10-31 00:26:58 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 00:26:58 INFO juju.worker.uniter resolver.go:159 found queued "start" hook 2024-10-31 00:26:58 DEBUG juju.worker.uniter.operation executor.go:85 running operation run start hook for mysql-innodb-cluster/2 2024-10-31 00:26:58 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run start hook) 2024-10-31 00:26:58 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run start hook) 2024-10-31 00:26:58 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run start hook" for mysql-innodb-cluster/2 2024-10-31 00:26:58 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run start hook" for mysql-innodb-cluster/2 2024-10-31 00:26:58 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running start hook 2024-10-31 00:26:58 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 00:26:59 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Reactive main running for hook start 2024-10-31 00:26:59 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:26:59 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.ssl_cert 2024-10-31 00:27:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.ssl_key 2024-10-31 00:27:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.ssl_ca 2024-10-31 00:27:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.source 2024-10-31 00:27:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.source 2024-10-31 00:27:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.cluster-name 2024-10-31 00:27:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.cluster-name 2024-10-31 00:27:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.auto-rejoin-tries 2024-10-31 00:27:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.auto-rejoin-tries 2024-10-31 00:27:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.expel-timeout 2024-10-31 00:27:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.expel-timeout 2024-10-31 00:27:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-buffer-pool-size 2024-10-31 00:27:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-change-buffering 2024-10-31 00:27:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.innodb-change-buffering 2024-10-31 00:27:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-io-capacity 2024-10-31 00:27:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.innodb-io-capacity 2024-10-31 00:27:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-file-per-table 2024-10-31 00:27:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.innodb-file-per-table 2024-10-31 00:27:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.tuning-level 2024-10-31 00:27:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.tuning-level 2024-10-31 00:27:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.table-open-cache 2024-10-31 00:27:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.table-open-cache 2024-10-31 00:27:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.max-connections 2024-10-31 00:27:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.enable-binlogs 2024-10-31 00:27:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.binlogs-path 2024-10-31 00:27:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.binlogs-path 2024-10-31 00:27:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.binlogs-max-size 2024-10-31 00:27:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.binlogs-max-size 2024-10-31 00:27:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.binlogs-expire-days 2024-10-31 00:27:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.binlogs-expire-days 2024-10-31 00:27:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.prefer-ipv6 2024-10-31 00:27:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.wait-timeout 2024-10-31 00:27:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.wait-timeout 2024-10-31 00:27:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.os-db-router-hostname 2024-10-31 00:27:01 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Initializing Snap Layer 2024-10-31 00:27:01 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator.DelayedActionCoordinator Loading state 2024-10-31 00:27:01 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Coordinator: Initializing coordinator layer 2024-10-31 00:27:02 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Initializing Leadership Layer (is follower) 2024-10-31 00:27:02 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: starting handler dispatch, 46 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 00:27:02 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-10-31 00:27:02 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: main dispatch loop, 1 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:27:02 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:27:02 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator.DelayedActionCoordinator Publishing state 2024-10-31 00:27:02 INFO juju.worker.uniter.operation runhook.go:159 ran "start" hook (via explicit, bespoke hook script) 2024-10-31 00:27:02 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run start hook" for mysql-innodb-cluster/2 2024-10-31 00:27:02 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 00:27:02 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run start hook) 2024-10-31 00:27:02 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 00:27:02 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 00:27:02 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-joined (4; unit: mysql-innodb-cluster/0) hook for mysql-innodb-cluster/2 2024-10-31 00:27:02 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run relation-joined (4; unit: mysql-innodb-cluster/0) hook) 2024-10-31 00:27:02 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run relation-joined (4; unit: mysql-innodb-cluster/0) hook) 2024-10-31 00:27:02 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-joined (4; unit: mysql-innodb-cluster/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:27:02 DEBUG juju.worker.dependency engine.go:580 "metric-collect" manifold worker started at 2024-10-31 00:27:02.805086436 +0000 UTC 2024-10-31 00:27:02 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-joined (4; unit: mysql-innodb-cluster/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:27:02 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running coordinator-relation-joined hook for mysql-innodb-cluster/0 2024-10-31 00:27:02 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 00:27:03 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: Reactive main running for hook coordinator-relation-joined 2024-10-31 00:27:03 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer> tracer: set flag endpoint.coordinator.joined tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:27:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag endpoint.coordinator.changed 2024-10-31 00:27:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag endpoint.coordinator.changed.coordinator 2024-10-31 00:27:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag endpoint.coordinator.changed.egress-subnets 2024-10-31 00:27:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag endpoint.coordinator.changed.ingress-address 2024-10-31 00:27:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag endpoint.coordinator.changed.private-address 2024-10-31 00:27:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.default.snapd_refresh 2024-10-31 00:27:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.default.ssl_cert 2024-10-31 00:27:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.default.ssl_key 2024-10-31 00:27:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.default.ssl_ca 2024-10-31 00:27:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.set.source 2024-10-31 00:27:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.default.source 2024-10-31 00:27:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.set.cluster-name 2024-10-31 00:27:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.default.cluster-name 2024-10-31 00:27:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.set.auto-rejoin-tries 2024-10-31 00:27:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.default.auto-rejoin-tries 2024-10-31 00:27:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.set.expel-timeout 2024-10-31 00:27:05 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.default.expel-timeout 2024-10-31 00:27:05 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.set.innodb-buffer-pool-size 2024-10-31 00:27:05 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.set.innodb-change-buffering 2024-10-31 00:27:05 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.default.innodb-change-buffering 2024-10-31 00:27:05 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.set.innodb-io-capacity 2024-10-31 00:27:05 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.default.innodb-io-capacity 2024-10-31 00:27:05 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.set.innodb-file-per-table 2024-10-31 00:27:05 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.default.innodb-file-per-table 2024-10-31 00:27:05 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.set.tuning-level 2024-10-31 00:27:05 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.default.tuning-level 2024-10-31 00:27:05 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.set.table-open-cache 2024-10-31 00:27:05 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.default.table-open-cache 2024-10-31 00:27:05 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.set.max-connections 2024-10-31 00:27:05 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.default.enable-binlogs 2024-10-31 00:27:05 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.set.binlogs-path 2024-10-31 00:27:05 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.default.binlogs-path 2024-10-31 00:27:05 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.set.binlogs-max-size 2024-10-31 00:27:05 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.default.binlogs-max-size 2024-10-31 00:27:05 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.set.binlogs-expire-days 2024-10-31 00:27:06 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.default.binlogs-expire-days 2024-10-31 00:27:06 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.default.prefer-ipv6 2024-10-31 00:27:06 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.set.wait-timeout 2024-10-31 00:27:06 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.default.wait-timeout 2024-10-31 00:27:06 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.default.os-db-router-hostname 2024-10-31 00:27:06 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: Initializing Snap Layer 2024-10-31 00:27:06 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: coordinator.DelayedActionCoordinator Loading state 2024-10-31 00:27:06 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: Coordinator: Initializing coordinator layer 2024-10-31 00:27:06 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: Initializing Leadership Layer (is follower) 2024-10-31 00:27:06 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer> tracer: starting handler dispatch, 52 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 00:27:06 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: hooks phase, 0 handlers queued 2024-10-31 00:27:06 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer> tracer: main dispatch loop, 1 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:27:06 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:27:06 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: coordinator.DelayedActionCoordinator Publishing state 2024-10-31 00:27:07 INFO juju.worker.uniter.operation runhook.go:159 ran "coordinator-relation-joined" hook (via explicit, bespoke hook script) 2024-10-31 00:27:07 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-joined (4; unit: mysql-innodb-cluster/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:27:07 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 00:27:07 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run relation-joined (4; unit: mysql-innodb-cluster/0) hook) 2024-10-31 00:27:07 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 00:27:07 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 00:27:07 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (4; unit: mysql-innodb-cluster/0) hook for mysql-innodb-cluster/2 2024-10-31 00:27:07 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run relation-changed (4; unit: mysql-innodb-cluster/0) hook) 2024-10-31 00:27:07 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run relation-changed (4; unit: mysql-innodb-cluster/0) hook) 2024-10-31 00:27:07 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (4; unit: mysql-innodb-cluster/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:27:07 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (4; unit: mysql-innodb-cluster/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:27:07 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running coordinator-relation-changed hook for mysql-innodb-cluster/0 2024-10-31 00:27:07 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 00:27:08 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: Reactive main running for hook coordinator-relation-changed 2024-10-31 00:27:08 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: Initializing Snap Layer 2024-10-31 00:27:09 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: coordinator.DelayedActionCoordinator Loading state 2024-10-31 00:27:09 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: Coordinator: Initializing coordinator layer 2024-10-31 00:27:09 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: Initializing Leadership Layer (is follower) 2024-10-31 00:27:09 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer> tracer: starting handler dispatch, 17 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 00:27:09 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: hooks phase, 0 handlers queued 2024-10-31 00:27:09 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer> tracer: main dispatch loop, 1 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:27:09 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:27:09 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: coordinator.DelayedActionCoordinator Publishing state 2024-10-31 00:27:09 INFO juju.worker.uniter.operation runhook.go:159 ran "coordinator-relation-changed" hook (via explicit, bespoke hook script) 2024-10-31 00:27:09 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (4; unit: mysql-innodb-cluster/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:27:10 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 00:27:10 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run relation-changed (4; unit: mysql-innodb-cluster/0) hook) 2024-10-31 00:27:10 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 00:27:10 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 00:27:10 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-joined (3; unit: mysql-innodb-cluster/0) hook for mysql-innodb-cluster/2 2024-10-31 00:27:10 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run relation-joined (3; unit: mysql-innodb-cluster/0) hook) 2024-10-31 00:27:10 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run relation-joined (3; unit: mysql-innodb-cluster/0) hook) 2024-10-31 00:27:10 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-joined (3; unit: mysql-innodb-cluster/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:27:10 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-joined (3; unit: mysql-innodb-cluster/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:27:10 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running cluster-relation-joined hook for mysql-innodb-cluster/0 2024-10-31 00:27:10 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 00:27:11 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Reactive main running for hook cluster-relation-joined 2024-10-31 00:27:11 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer> tracer: set flag endpoint.cluster.joined tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:27:11 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer> tracer: set flag endpoint.cluster.changed tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-10-31 00:27:11 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag endpoint.cluster.changed.cluster-address 2024-10-31 00:27:11 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag endpoint.cluster.changed.cluster-password 2024-10-31 00:27:11 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag endpoint.cluster.changed.cluster-user 2024-10-31 00:27:11 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag endpoint.cluster.changed.egress-subnets 2024-10-31 00:27:11 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag endpoint.cluster.changed.ingress-address 2024-10-31 00:27:11 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag endpoint.cluster.changed.private-address 2024-10-31 00:27:11 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.snapd_refresh 2024-10-31 00:27:12 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.ssl_cert 2024-10-31 00:27:12 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.ssl_key 2024-10-31 00:27:12 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.ssl_ca 2024-10-31 00:27:12 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.source 2024-10-31 00:27:12 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.source 2024-10-31 00:27:12 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.cluster-name 2024-10-31 00:27:12 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.cluster-name 2024-10-31 00:27:12 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.auto-rejoin-tries 2024-10-31 00:27:12 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.auto-rejoin-tries 2024-10-31 00:27:12 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.expel-timeout 2024-10-31 00:27:12 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.expel-timeout 2024-10-31 00:27:12 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.innodb-buffer-pool-size 2024-10-31 00:27:12 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.innodb-change-buffering 2024-10-31 00:27:12 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.innodb-change-buffering 2024-10-31 00:27:12 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.innodb-io-capacity 2024-10-31 00:27:12 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.innodb-io-capacity 2024-10-31 00:27:12 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.innodb-file-per-table 2024-10-31 00:27:12 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.innodb-file-per-table 2024-10-31 00:27:12 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.tuning-level 2024-10-31 00:27:12 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.tuning-level 2024-10-31 00:27:12 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.table-open-cache 2024-10-31 00:27:12 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.table-open-cache 2024-10-31 00:27:12 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.max-connections 2024-10-31 00:27:12 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.enable-binlogs 2024-10-31 00:27:13 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.binlogs-path 2024-10-31 00:27:13 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.binlogs-path 2024-10-31 00:27:13 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.binlogs-max-size 2024-10-31 00:27:13 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.binlogs-max-size 2024-10-31 00:27:13 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.binlogs-expire-days 2024-10-31 00:27:13 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.binlogs-expire-days 2024-10-31 00:27:13 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.prefer-ipv6 2024-10-31 00:27:13 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.wait-timeout 2024-10-31 00:27:13 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.wait-timeout 2024-10-31 00:27:13 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.os-db-router-hostname 2024-10-31 00:27:13 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Initializing Snap Layer 2024-10-31 00:27:13 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: coordinator.DelayedActionCoordinator Loading state 2024-10-31 00:27:13 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Coordinator: Initializing coordinator layer 2024-10-31 00:27:13 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Initializing Leadership Layer (is follower) 2024-10-31 00:27:13 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer> tracer: starting handler dispatch, 60 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.cluster-address tracer: set flag endpoint.cluster.changed.cluster-password tracer: set flag endpoint.cluster.changed.cluster-user tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 00:27:13 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: hooks phase, 0 handlers queued 2024-10-31 00:27:13 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer> tracer: main dispatch loop, 3 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:27:13 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-10-31 00:27:14 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer> tracer: set flag cluster.connected tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:88:send_cluster_connection_info 2024-10-31 00:27:14 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-10-31 00:27:14 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:27:14 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:88:send_cluster_connection_info 2024-10-31 00:27:14 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Send cluster connection information. 2024-10-31 00:27:14 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Running _assess_status() 2024-10-31 00:27:15 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: coordinator.DelayedActionCoordinator Publishing state 2024-10-31 00:27:15 INFO juju.worker.uniter.operation runhook.go:159 ran "cluster-relation-joined" hook (via explicit, bespoke hook script) 2024-10-31 00:27:15 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-joined (3; unit: mysql-innodb-cluster/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:27:16 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 00:27:16 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run relation-joined (3; unit: mysql-innodb-cluster/0) hook) 2024-10-31 00:27:16 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 00:27:16 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 00:27:16 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (3; unit: mysql-innodb-cluster/0) hook for mysql-innodb-cluster/2 2024-10-31 00:27:16 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run relation-changed (3; unit: mysql-innodb-cluster/0) hook) 2024-10-31 00:27:16 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run relation-changed (3; unit: mysql-innodb-cluster/0) hook) 2024-10-31 00:27:16 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (3; unit: mysql-innodb-cluster/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:27:16 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (3; unit: mysql-innodb-cluster/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:27:16 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running cluster-relation-changed hook for mysql-innodb-cluster/0 2024-10-31 00:27:16 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 00:27:17 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Reactive main running for hook cluster-relation-changed 2024-10-31 00:27:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:88:send_cluster_connection_info 2024-10-31 00:27:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.ssl_cert 2024-10-31 00:27:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.ssl_key 2024-10-31 00:27:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.ssl_ca 2024-10-31 00:27:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.source 2024-10-31 00:27:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.source 2024-10-31 00:27:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.cluster-name 2024-10-31 00:27:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.cluster-name 2024-10-31 00:27:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.auto-rejoin-tries 2024-10-31 00:27:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.auto-rejoin-tries 2024-10-31 00:27:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.expel-timeout 2024-10-31 00:27:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.expel-timeout 2024-10-31 00:27:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.innodb-buffer-pool-size 2024-10-31 00:27:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.innodb-change-buffering 2024-10-31 00:27:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.innodb-change-buffering 2024-10-31 00:27:19 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.innodb-io-capacity 2024-10-31 00:27:19 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.innodb-io-capacity 2024-10-31 00:27:19 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.innodb-file-per-table 2024-10-31 00:27:19 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.innodb-file-per-table 2024-10-31 00:27:19 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.tuning-level 2024-10-31 00:27:19 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.tuning-level 2024-10-31 00:27:19 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.table-open-cache 2024-10-31 00:27:19 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.table-open-cache 2024-10-31 00:27:19 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.max-connections 2024-10-31 00:27:19 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.enable-binlogs 2024-10-31 00:27:19 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.binlogs-path 2024-10-31 00:27:19 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.binlogs-path 2024-10-31 00:27:19 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.binlogs-max-size 2024-10-31 00:27:19 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.binlogs-max-size 2024-10-31 00:27:19 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.binlogs-expire-days 2024-10-31 00:27:19 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.binlogs-expire-days 2024-10-31 00:27:20 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.prefer-ipv6 2024-10-31 00:27:20 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.wait-timeout 2024-10-31 00:27:20 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.wait-timeout 2024-10-31 00:27:20 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.os-db-router-hostname 2024-10-31 00:27:20 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Initializing Snap Layer 2024-10-31 00:27:20 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: coordinator.DelayedActionCoordinator Loading state 2024-10-31 00:27:20 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Coordinator: Initializing coordinator layer 2024-10-31 00:27:20 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Initializing Leadership Layer (is follower) 2024-10-31 00:27:20 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer> tracer: starting handler dispatch, 61 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.cluster-address tracer: set flag endpoint.cluster.changed.cluster-password tracer: set flag endpoint.cluster.changed.cluster-user tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 00:27:20 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: hooks phase, 0 handlers queued 2024-10-31 00:27:20 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer> tracer: main dispatch loop, 4 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:88:send_cluster_connection_info 2024-10-31 00:27:20 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:88:send_cluster_connection_info 2024-10-31 00:27:20 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Send cluster connection information. 2024-10-31 00:27:21 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-10-31 00:27:21 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-10-31 00:27:21 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:27:21 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Running _assess_status() 2024-10-31 00:27:21 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: coordinator.DelayedActionCoordinator Publishing state 2024-10-31 00:27:22 INFO juju.worker.uniter.operation runhook.go:159 ran "cluster-relation-changed" hook (via explicit, bespoke hook script) 2024-10-31 00:27:22 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (3; unit: mysql-innodb-cluster/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:27:22 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 00:27:22 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run relation-changed (3; unit: mysql-innodb-cluster/0) hook) 2024-10-31 00:27:22 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 00:27:22 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 00:27:22 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 00:27:22 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-joined (3; unit: mysql-innodb-cluster/1) hook for mysql-innodb-cluster/2 2024-10-31 00:27:22 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run relation-joined (3; unit: mysql-innodb-cluster/1) hook) 2024-10-31 00:27:22 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run relation-joined (3; unit: mysql-innodb-cluster/1) hook) 2024-10-31 00:27:22 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-joined (3; unit: mysql-innodb-cluster/1) hook" for mysql-innodb-cluster/2 2024-10-31 00:27:22 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-joined (3; unit: mysql-innodb-cluster/1) hook" for mysql-innodb-cluster/2 2024-10-31 00:27:22 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running cluster-relation-joined hook for mysql-innodb-cluster/1 2024-10-31 00:27:22 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 00:27:23 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for mysql-innodb-cluster/2 : {3 {map[mysql-innodb-cluster/1:{1}] map[] []}} 2024-10-31 00:27:23 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Reactive main running for hook cluster-relation-joined 2024-10-31 00:27:24 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:88:send_cluster_connection_info 2024-10-31 00:27:24 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.ssl_cert 2024-10-31 00:27:24 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.ssl_key 2024-10-31 00:27:24 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.ssl_ca 2024-10-31 00:27:24 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.source 2024-10-31 00:27:24 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.source 2024-10-31 00:27:24 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.cluster-name 2024-10-31 00:27:24 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.cluster-name 2024-10-31 00:27:24 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.auto-rejoin-tries 2024-10-31 00:27:24 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.auto-rejoin-tries 2024-10-31 00:27:24 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.expel-timeout 2024-10-31 00:27:25 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.expel-timeout 2024-10-31 00:27:25 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.innodb-buffer-pool-size 2024-10-31 00:27:25 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.innodb-change-buffering 2024-10-31 00:27:25 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.innodb-change-buffering 2024-10-31 00:27:25 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.innodb-io-capacity 2024-10-31 00:27:25 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.innodb-io-capacity 2024-10-31 00:27:25 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.innodb-file-per-table 2024-10-31 00:27:25 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.innodb-file-per-table 2024-10-31 00:27:25 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.tuning-level 2024-10-31 00:27:25 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.tuning-level 2024-10-31 00:27:25 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.table-open-cache 2024-10-31 00:27:25 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.table-open-cache 2024-10-31 00:27:25 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.max-connections 2024-10-31 00:27:25 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.enable-binlogs 2024-10-31 00:27:25 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.binlogs-path 2024-10-31 00:27:25 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.binlogs-path 2024-10-31 00:27:25 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.binlogs-max-size 2024-10-31 00:27:25 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.binlogs-max-size 2024-10-31 00:27:25 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.binlogs-expire-days 2024-10-31 00:27:26 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.binlogs-expire-days 2024-10-31 00:27:26 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.prefer-ipv6 2024-10-31 00:27:26 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.wait-timeout 2024-10-31 00:27:26 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.wait-timeout 2024-10-31 00:27:26 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.os-db-router-hostname 2024-10-31 00:27:26 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Initializing Snap Layer 2024-10-31 00:27:26 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: coordinator.DelayedActionCoordinator Loading state 2024-10-31 00:27:26 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Coordinator: Initializing coordinator layer 2024-10-31 00:27:26 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Initializing Leadership Layer (is follower) 2024-10-31 00:27:26 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer> tracer: starting handler dispatch, 61 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.cluster-address tracer: set flag endpoint.cluster.changed.cluster-password tracer: set flag endpoint.cluster.changed.cluster-user tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 00:27:26 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: hooks phase, 0 handlers queued 2024-10-31 00:27:26 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer> tracer: main dispatch loop, 4 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:88:send_cluster_connection_info 2024-10-31 00:27:26 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:88:send_cluster_connection_info 2024-10-31 00:27:26 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Send cluster connection information. 2024-10-31 00:27:27 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-10-31 00:27:27 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer> tracer: set flag cluster.available tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:110:create_remote_cluster_user tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: -- dequeue handler reactive/mysql_innodb_cluster_handlers.py:88:send_cluster_connection_info 2024-10-31 00:27:27 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-10-31 00:27:27 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:27:27 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:110:create_remote_cluster_user 2024-10-31 00:27:27 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Creating remote users. 2024-10-31 00:27:27 WARNING unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: This instance is not yet clustered: cannot determine the cluster status. 2024-10-31 00:27:27 WARNING unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Cannot determine the cluster primary RW node for writes. 2024-10-31 00:27:27 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Opening db connection for root@None 2024-10-31 00:27:27 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Revoke all privileges for use 'clusteruser'@'252.17.134.150' 2024-10-31 00:27:27 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Grant ALL PRIVILEGES for use 'clusteruser'@'252.17.134.150' 2024-10-31 00:27:27 WARNING unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: This instance is not yet clustered: cannot determine the cluster status. 2024-10-31 00:27:27 WARNING unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Cannot determine the cluster primary RW node for writes. 2024-10-31 00:27:27 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Opening db connection for root@None 2024-10-31 00:27:27 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Revoke all privileges for use 'clusteruser'@'252.17.186.134' 2024-10-31 00:27:27 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Grant ALL PRIVILEGES for use 'clusteruser'@'252.17.186.134' 2024-10-31 00:27:27 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer> tracer: set flag local.cluster.all-users-created tracer: -- dequeue handler reactive/mysql_innodb_cluster_handlers.py:110:create_remote_cluster_user 2024-10-31 00:27:27 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-10-31 00:27:27 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Found peers: 252.17.134.150,252.17.186.134 2024-10-31 00:27:27 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Expect 2 peers 2024-10-31 00:27:27 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Reached quorum 2024-10-31 00:27:27 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag local.cluster.quorum-reached 2024-10-31 00:27:27 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Running _assess_status() 2024-10-31 00:27:28 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: coordinator.DelayedActionCoordinator Publishing state 2024-10-31 00:27:29 INFO juju.worker.uniter.operation runhook.go:159 ran "cluster-relation-joined" hook (via explicit, bespoke hook script) 2024-10-31 00:27:29 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-joined (3; unit: mysql-innodb-cluster/1) hook" for mysql-innodb-cluster/2 2024-10-31 00:27:29 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 00:27:29 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run relation-joined (3; unit: mysql-innodb-cluster/1) hook) 2024-10-31 00:27:29 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 00:27:29 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 00:27:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 00:27:29 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-joined (4; unit: mysql-innodb-cluster/1) hook for mysql-innodb-cluster/2 2024-10-31 00:27:29 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run relation-joined (4; unit: mysql-innodb-cluster/1) hook) 2024-10-31 00:27:29 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run relation-joined (4; unit: mysql-innodb-cluster/1) hook) 2024-10-31 00:27:29 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-joined (4; unit: mysql-innodb-cluster/1) hook" for mysql-innodb-cluster/2 2024-10-31 00:27:29 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-joined (4; unit: mysql-innodb-cluster/1) hook" for mysql-innodb-cluster/2 2024-10-31 00:27:29 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running coordinator-relation-joined hook for mysql-innodb-cluster/1 2024-10-31 00:27:29 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 00:27:30 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: Reactive main running for hook coordinator-relation-joined 2024-10-31 00:27:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-10-31 00:27:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.default.ssl_cert 2024-10-31 00:27:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.default.ssl_key 2024-10-31 00:27:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.default.ssl_ca 2024-10-31 00:27:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.set.source 2024-10-31 00:27:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.default.source 2024-10-31 00:27:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.set.cluster-name 2024-10-31 00:27:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.default.cluster-name 2024-10-31 00:27:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.set.auto-rejoin-tries 2024-10-31 00:27:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.default.auto-rejoin-tries 2024-10-31 00:27:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.set.expel-timeout 2024-10-31 00:27:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.default.expel-timeout 2024-10-31 00:27:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.set.innodb-buffer-pool-size 2024-10-31 00:27:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.set.innodb-change-buffering 2024-10-31 00:27:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.default.innodb-change-buffering 2024-10-31 00:27:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.set.innodb-io-capacity 2024-10-31 00:27:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.default.innodb-io-capacity 2024-10-31 00:27:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.set.innodb-file-per-table 2024-10-31 00:27:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.default.innodb-file-per-table 2024-10-31 00:27:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.set.tuning-level 2024-10-31 00:27:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.default.tuning-level 2024-10-31 00:27:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.set.table-open-cache 2024-10-31 00:27:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.default.table-open-cache 2024-10-31 00:27:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.set.max-connections 2024-10-31 00:27:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.default.enable-binlogs 2024-10-31 00:27:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.set.binlogs-path 2024-10-31 00:27:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.default.binlogs-path 2024-10-31 00:27:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.set.binlogs-max-size 2024-10-31 00:27:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.default.binlogs-max-size 2024-10-31 00:27:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.set.binlogs-expire-days 2024-10-31 00:27:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.default.binlogs-expire-days 2024-10-31 00:27:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.default.prefer-ipv6 2024-10-31 00:27:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.set.wait-timeout 2024-10-31 00:27:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.default.wait-timeout 2024-10-31 00:27:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: set flag config.default.os-db-router-hostname 2024-10-31 00:27:32 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: Initializing Snap Layer 2024-10-31 00:27:32 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: coordinator.DelayedActionCoordinator Loading state 2024-10-31 00:27:33 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: Coordinator: Initializing coordinator layer 2024-10-31 00:27:33 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: Initializing Leadership Layer (is follower) 2024-10-31 00:27:33 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer> tracer: starting handler dispatch, 64 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.cluster-address tracer: set flag endpoint.cluster.changed.cluster-password tracer: set flag endpoint.cluster.changed.cluster-user tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 00:27:33 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: hooks phase, 0 handlers queued 2024-10-31 00:27:33 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer> tracer: main dispatch loop, 4 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-10-31 00:27:33 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-10-31 00:27:33 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: Found peers: 252.17.134.150,252.17.186.134 2024-10-31 00:27:33 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: Expect 2 peers 2024-10-31 00:27:33 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: Reached quorum 2024-10-31 00:27:33 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-10-31 00:27:33 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-10-31 00:27:33 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:27:33 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: coordinator.DelayedActionCoordinator Publishing state 2024-10-31 00:27:33 INFO juju.worker.uniter.operation runhook.go:159 ran "coordinator-relation-joined" hook (via explicit, bespoke hook script) 2024-10-31 00:27:34 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-joined (4; unit: mysql-innodb-cluster/1) hook" for mysql-innodb-cluster/2 2024-10-31 00:27:34 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 00:27:34 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run relation-joined (4; unit: mysql-innodb-cluster/1) hook) 2024-10-31 00:27:34 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 00:27:34 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 00:27:34 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (3; unit: mysql-innodb-cluster/1) hook for mysql-innodb-cluster/2 2024-10-31 00:27:34 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run relation-changed (3; unit: mysql-innodb-cluster/1) hook) 2024-10-31 00:27:34 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run relation-changed (3; unit: mysql-innodb-cluster/1) hook) 2024-10-31 00:27:34 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (3; unit: mysql-innodb-cluster/1) hook" for mysql-innodb-cluster/2 2024-10-31 00:27:34 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (3; unit: mysql-innodb-cluster/1) hook" for mysql-innodb-cluster/2 2024-10-31 00:27:34 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running cluster-relation-changed hook for mysql-innodb-cluster/1 2024-10-31 00:27:34 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 00:27:35 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Reactive main running for hook cluster-relation-changed 2024-10-31 00:27:35 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for mysql-innodb-cluster/2 : {3 {map[mysql-innodb-cluster/1:{2}] map[] []}} 2024-10-31 00:27:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer> tracer: set flag endpoint.cluster.changed.unit-configure-ready tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-10-31 00:27:36 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.snapd_refresh 2024-10-31 00:27:36 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.ssl_cert 2024-10-31 00:27:36 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.ssl_key 2024-10-31 00:27:36 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.ssl_ca 2024-10-31 00:27:36 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.source 2024-10-31 00:27:36 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.source 2024-10-31 00:27:36 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.cluster-name 2024-10-31 00:27:36 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.cluster-name 2024-10-31 00:27:36 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.auto-rejoin-tries 2024-10-31 00:27:36 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.auto-rejoin-tries 2024-10-31 00:27:36 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.expel-timeout 2024-10-31 00:27:36 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.expel-timeout 2024-10-31 00:27:36 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.innodb-buffer-pool-size 2024-10-31 00:27:36 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.innodb-change-buffering 2024-10-31 00:27:36 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.innodb-change-buffering 2024-10-31 00:27:36 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.innodb-io-capacity 2024-10-31 00:27:36 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.innodb-io-capacity 2024-10-31 00:27:36 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.innodb-file-per-table 2024-10-31 00:27:36 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.innodb-file-per-table 2024-10-31 00:27:36 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.tuning-level 2024-10-31 00:27:37 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.tuning-level 2024-10-31 00:27:37 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.table-open-cache 2024-10-31 00:27:37 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.table-open-cache 2024-10-31 00:27:37 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.max-connections 2024-10-31 00:27:37 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.enable-binlogs 2024-10-31 00:27:37 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.binlogs-path 2024-10-31 00:27:37 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.binlogs-path 2024-10-31 00:27:37 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.binlogs-max-size 2024-10-31 00:27:37 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.binlogs-max-size 2024-10-31 00:27:37 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.binlogs-expire-days 2024-10-31 00:27:37 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.binlogs-expire-days 2024-10-31 00:27:37 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.prefer-ipv6 2024-10-31 00:27:37 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.wait-timeout 2024-10-31 00:27:37 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.wait-timeout 2024-10-31 00:27:38 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.os-db-router-hostname 2024-10-31 00:27:38 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Initializing Snap Layer 2024-10-31 00:27:38 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: coordinator.DelayedActionCoordinator Loading state 2024-10-31 00:27:38 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Coordinator: Initializing coordinator layer 2024-10-31 00:27:38 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Initializing Leadership Layer (is follower) 2024-10-31 00:27:38 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer> tracer: starting handler dispatch, 65 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.cluster-address tracer: set flag endpoint.cluster.changed.cluster-password tracer: set flag endpoint.cluster.changed.cluster-user tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-configure-ready tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 00:27:38 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: hooks phase, 0 handlers queued 2024-10-31 00:27:38 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer> tracer: main dispatch loop, 4 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-10-31 00:27:38 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-10-31 00:27:38 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Found peers: 252.17.134.150,252.17.186.134 2024-10-31 00:27:38 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Expect 2 peers 2024-10-31 00:27:38 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Reached quorum 2024-10-31 00:27:38 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-10-31 00:27:38 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-10-31 00:27:38 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:27:38 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: coordinator.DelayedActionCoordinator Publishing state 2024-10-31 00:27:39 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for mysql-innodb-cluster/2: ok=true 2024-10-31 00:27:39 INFO juju.worker.uniter.operation runhook.go:159 ran "cluster-relation-changed" hook (via explicit, bespoke hook script) 2024-10-31 00:27:39 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (3; unit: mysql-innodb-cluster/1) hook" for mysql-innodb-cluster/2 2024-10-31 00:27:39 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 00:27:39 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run relation-changed (3; unit: mysql-innodb-cluster/1) hook) 2024-10-31 00:27:39 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 00:27:39 DEBUG juju.worker.uniter.operation executor.go:85 running operation run leader-settings-changed hook for mysql-innodb-cluster/2 2024-10-31 00:27:39 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run leader-settings-changed hook) 2024-10-31 00:27:39 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run leader-settings-changed hook) 2024-10-31 00:27:39 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run leader-settings-changed hook" for mysql-innodb-cluster/2 2024-10-31 00:27:39 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run leader-settings-changed hook" for mysql-innodb-cluster/2 2024-10-31 00:27:39 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running leader-settings-changed hook 2024-10-31 00:27:39 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 00:27:40 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Reactive main running for hook leader-settings-changed 2024-10-31 00:27:40 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Initializing Snap Layer 2024-10-31 00:27:41 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator.DelayedActionCoordinator Loading state 2024-10-31 00:27:41 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Coordinator: Initializing coordinator layer 2024-10-31 00:27:41 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Initializing Leadership Layer (is follower) 2024-10-31 00:27:41 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: set flag leadership.changed.cluster-instance-configured-252-17-134-150 tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-10-31 00:27:41 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag leadership.set.cluster-instance-configured-252-17-134-150 2024-10-31 00:27:41 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag leadership.changed 2024-10-31 00:27:41 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: starting handler dispatch, 33 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.cluster-address tracer: set flag endpoint.cluster.changed.cluster-password tracer: set flag endpoint.cluster.changed.cluster-user tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-configure-ready tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag leadership.changed tracer: set flag leadership.changed.cluster-instance-configured-252-17-134-150 tracer: set flag leadership.set.cluster-instance-configured-252-17-134-150 tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 00:27:41 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-10-31 00:27:41 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: main dispatch loop, 4 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-10-31 00:27:41 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-10-31 00:27:41 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Found peers: 252.17.134.150,252.17.186.134 2024-10-31 00:27:41 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Expect 2 peers 2024-10-31 00:27:41 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Reached quorum 2024-10-31 00:27:41 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-10-31 00:27:41 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-10-31 00:27:41 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:27:41 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator.DelayedActionCoordinator Publishing state 2024-10-31 00:27:42 INFO juju.worker.uniter.operation runhook.go:159 ran "leader-settings-changed" hook (via explicit, bespoke hook script) 2024-10-31 00:27:42 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run leader-settings-changed hook" for mysql-innodb-cluster/2 2024-10-31 00:27:42 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 00:27:42 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run leader-settings-changed hook) 2024-10-31 00:27:42 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 00:27:42 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 00:27:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 00:27:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 00:27:42 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (3; unit: mysql-innodb-cluster/1) hook for mysql-innodb-cluster/2 2024-10-31 00:27:42 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run relation-changed (3; unit: mysql-innodb-cluster/1) hook) 2024-10-31 00:27:42 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run relation-changed (3; unit: mysql-innodb-cluster/1) hook) 2024-10-31 00:27:42 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (3; unit: mysql-innodb-cluster/1) hook" for mysql-innodb-cluster/2 2024-10-31 00:27:42 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (3; unit: mysql-innodb-cluster/1) hook" for mysql-innodb-cluster/2 2024-10-31 00:27:42 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running cluster-relation-changed hook for mysql-innodb-cluster/1 2024-10-31 00:27:42 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 00:27:43 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Reactive main running for hook cluster-relation-changed 2024-10-31 00:27:43 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for mysql-innodb-cluster/2: ok=true 2024-10-31 00:27:44 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-10-31 00:27:44 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.ssl_cert 2024-10-31 00:27:44 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.ssl_key 2024-10-31 00:27:44 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.ssl_ca 2024-10-31 00:27:44 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.source 2024-10-31 00:27:44 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.source 2024-10-31 00:27:44 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.cluster-name 2024-10-31 00:27:44 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.cluster-name 2024-10-31 00:27:44 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.auto-rejoin-tries 2024-10-31 00:27:44 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.auto-rejoin-tries 2024-10-31 00:27:44 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.expel-timeout 2024-10-31 00:27:44 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for mysql-innodb-cluster/2 : {3 {map[mysql-innodb-cluster/0:{2}] map[] []}} 2024-10-31 00:27:44 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.expel-timeout 2024-10-31 00:27:44 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.innodb-buffer-pool-size 2024-10-31 00:27:44 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.innodb-change-buffering 2024-10-31 00:27:44 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.innodb-change-buffering 2024-10-31 00:27:44 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.innodb-io-capacity 2024-10-31 00:27:44 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.innodb-io-capacity 2024-10-31 00:27:44 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.innodb-file-per-table 2024-10-31 00:27:44 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.innodb-file-per-table 2024-10-31 00:27:44 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.tuning-level 2024-10-31 00:27:45 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.tuning-level 2024-10-31 00:27:45 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.table-open-cache 2024-10-31 00:27:45 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.table-open-cache 2024-10-31 00:27:45 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.max-connections 2024-10-31 00:27:45 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.enable-binlogs 2024-10-31 00:27:45 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.binlogs-path 2024-10-31 00:27:45 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.binlogs-path 2024-10-31 00:27:45 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.binlogs-max-size 2024-10-31 00:27:45 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.binlogs-max-size 2024-10-31 00:27:45 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.binlogs-expire-days 2024-10-31 00:27:45 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.binlogs-expire-days 2024-10-31 00:27:45 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.prefer-ipv6 2024-10-31 00:27:45 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.wait-timeout 2024-10-31 00:27:45 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.wait-timeout 2024-10-31 00:27:45 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.os-db-router-hostname 2024-10-31 00:27:45 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Initializing Snap Layer 2024-10-31 00:27:46 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: coordinator.DelayedActionCoordinator Loading state 2024-10-31 00:27:46 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Coordinator: Initializing coordinator layer 2024-10-31 00:27:46 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Initializing Leadership Layer (is follower) 2024-10-31 00:27:46 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag leadership.changed.cluster-created 2024-10-31 00:27:46 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer> tracer: set flag leadership.set.cluster-created tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:27:46 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag leadership.changed.cluster-instance-clustered-252-17-134-150 2024-10-31 00:27:46 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag leadership.set.cluster-instance-clustered-252-17-134-150 2024-10-31 00:27:46 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: cleared flag leadership.changed.cluster-instance-configured-252-17-134-150 2024-10-31 00:27:46 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer> tracer: starting handler dispatch, 71 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.cluster-address tracer: set flag endpoint.cluster.changed.cluster-password tracer: set flag endpoint.cluster.changed.cluster-user tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-configure-ready tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag leadership.changed tracer: set flag leadership.changed.cluster-created tracer: set flag leadership.changed.cluster-instance-clustered-252-17-134-150 tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-17-134-150 tracer: set flag leadership.set.cluster-instance-configured-252-17-134-150 tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 00:27:46 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: hooks phase, 0 handlers queued 2024-10-31 00:27:46 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer> tracer: main dispatch loop, 5 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:27:46 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-10-31 00:27:46 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Found peers: 252.17.134.150,252.17.186.134 2024-10-31 00:27:46 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Expect 2 peers 2024-10-31 00:27:46 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Reached quorum 2024-10-31 00:27:46 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:27:46 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-10-31 00:27:46 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-10-31 00:27:46 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:27:46 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Running _assess_status() 2024-10-31 00:27:47 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: coordinator.DelayedActionCoordinator Publishing state 2024-10-31 00:27:48 INFO juju.worker.uniter.operation runhook.go:159 ran "cluster-relation-changed" hook (via explicit, bespoke hook script) 2024-10-31 00:27:48 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (3; unit: mysql-innodb-cluster/1) hook" for mysql-innodb-cluster/2 2024-10-31 00:27:48 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 00:27:48 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run relation-changed (3; unit: mysql-innodb-cluster/1) hook) 2024-10-31 00:27:48 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 00:27:48 DEBUG juju.worker.uniter.operation executor.go:85 running operation run leader-settings-changed hook for mysql-innodb-cluster/2 2024-10-31 00:27:48 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run leader-settings-changed hook) 2024-10-31 00:27:48 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run leader-settings-changed hook) 2024-10-31 00:27:48 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run leader-settings-changed hook" for mysql-innodb-cluster/2 2024-10-31 00:27:48 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run leader-settings-changed hook" for mysql-innodb-cluster/2 2024-10-31 00:27:48 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running leader-settings-changed hook 2024-10-31 00:27:48 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 00:27:49 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Reactive main running for hook leader-settings-changed 2024-10-31 00:27:50 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Initializing Snap Layer 2024-10-31 00:27:50 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator.DelayedActionCoordinator Loading state 2024-10-31 00:27:50 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for mysql-innodb-cluster/2: ok=true 2024-10-31 00:27:50 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Coordinator: Initializing coordinator layer 2024-10-31 00:27:50 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Initializing Leadership Layer (is follower) 2024-10-31 00:27:50 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: cleared flag leadership.changed.cluster-created tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:27:50 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: cleared flag leadership.changed.cluster-instance-clustered-252-17-134-150 2024-10-31 00:27:50 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: cleared flag leadership.changed 2024-10-31 00:27:50 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: starting handler dispatch, 33 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.cluster-address tracer: set flag endpoint.cluster.changed.cluster-password tracer: set flag endpoint.cluster.changed.cluster-user tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-configure-ready tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-17-134-150 tracer: set flag leadership.set.cluster-instance-configured-252-17-134-150 tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 00:27:50 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-10-31 00:27:50 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: main dispatch loop, 5 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:27:50 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-10-31 00:27:50 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Found peers: 252.17.134.150,252.17.186.134 2024-10-31 00:27:50 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Expect 2 peers 2024-10-31 00:27:50 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Reached quorum 2024-10-31 00:27:50 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:27:50 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-10-31 00:27:50 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-10-31 00:27:50 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:27:50 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Running _assess_status() 2024-10-31 00:27:51 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator.DelayedActionCoordinator Publishing state 2024-10-31 00:27:52 INFO juju.worker.uniter.operation runhook.go:159 ran "leader-settings-changed" hook (via explicit, bespoke hook script) 2024-10-31 00:27:52 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run leader-settings-changed hook" for mysql-innodb-cluster/2 2024-10-31 00:27:52 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 00:27:52 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run leader-settings-changed hook) 2024-10-31 00:27:52 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 00:27:52 DEBUG juju.worker.uniter.operation executor.go:85 running operation run leader-settings-changed hook for mysql-innodb-cluster/2 2024-10-31 00:27:52 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run leader-settings-changed hook) 2024-10-31 00:27:52 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run leader-settings-changed hook) 2024-10-31 00:27:52 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run leader-settings-changed hook" for mysql-innodb-cluster/2 2024-10-31 00:27:52 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run leader-settings-changed hook" for mysql-innodb-cluster/2 2024-10-31 00:27:52 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 00:27:53 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Reactive main running for hook leader-settings-changed 2024-10-31 00:27:53 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Initializing Snap Layer 2024-10-31 00:27:53 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator.DelayedActionCoordinator Loading state 2024-10-31 00:27:54 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Coordinator: Initializing coordinator layer 2024-10-31 00:27:54 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Initializing Leadership Layer (is follower) 2024-10-31 00:27:54 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: set flag leadership.changed.cluster-instance-configured-252-17-186-134 tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:27:54 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag leadership.set.cluster-instance-configured-252-17-186-134 2024-10-31 00:27:54 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag leadership.changed 2024-10-31 00:27:54 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: starting handler dispatch, 36 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.cluster-address tracer: set flag endpoint.cluster.changed.cluster-password tracer: set flag endpoint.cluster.changed.cluster-user tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-configure-ready tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag leadership.changed tracer: set flag leadership.changed.cluster-instance-configured-252-17-186-134 tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-17-134-150 tracer: set flag leadership.set.cluster-instance-configured-252-17-134-150 tracer: set flag leadership.set.cluster-instance-configured-252-17-186-134 tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 00:27:54 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-10-31 00:27:54 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: main dispatch loop, 5 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:27:54 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-10-31 00:27:54 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Found peers: 252.17.134.150,252.17.186.134 2024-10-31 00:27:54 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Expect 2 peers 2024-10-31 00:27:54 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Reached quorum 2024-10-31 00:27:54 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:27:54 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-10-31 00:27:54 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-10-31 00:27:54 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:27:54 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Running _assess_status() 2024-10-31 00:27:55 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator.DelayedActionCoordinator Publishing state 2024-10-31 00:27:56 INFO juju.worker.uniter.operation runhook.go:159 ran "leader-settings-changed" hook (via explicit, bespoke hook script) 2024-10-31 00:27:56 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run leader-settings-changed hook" for mysql-innodb-cluster/2 2024-10-31 00:27:56 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 00:27:56 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run leader-settings-changed hook) 2024-10-31 00:27:56 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 00:27:56 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 00:27:56 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (4; unit: mysql-innodb-cluster/1) hook for mysql-innodb-cluster/2 2024-10-31 00:27:56 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run relation-changed (4; unit: mysql-innodb-cluster/1) hook) 2024-10-31 00:27:56 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run relation-changed (4; unit: mysql-innodb-cluster/1) hook) 2024-10-31 00:27:56 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (4; unit: mysql-innodb-cluster/1) hook" for mysql-innodb-cluster/2 2024-10-31 00:27:56 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (4; unit: mysql-innodb-cluster/1) hook" for mysql-innodb-cluster/2 2024-10-31 00:27:56 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running coordinator-relation-changed hook for mysql-innodb-cluster/1 2024-10-31 00:27:56 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 00:27:56 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: Reactive main running for hook coordinator-relation-changed 2024-10-31 00:27:57 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: Initializing Snap Layer 2024-10-31 00:27:57 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: coordinator.DelayedActionCoordinator Loading state 2024-10-31 00:27:58 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: Coordinator: Initializing coordinator layer 2024-10-31 00:27:58 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: Initializing Leadership Layer (is follower) 2024-10-31 00:27:58 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer> tracer: cleared flag leadership.changed.cluster-instance-configured-252-17-186-134 tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:27:58 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: cleared flag leadership.changed 2024-10-31 00:27:58 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer> tracer: starting handler dispatch, 34 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.cluster-address tracer: set flag endpoint.cluster.changed.cluster-password tracer: set flag endpoint.cluster.changed.cluster-user tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-configure-ready tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-17-134-150 tracer: set flag leadership.set.cluster-instance-configured-252-17-134-150 tracer: set flag leadership.set.cluster-instance-configured-252-17-186-134 tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 00:27:58 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer: hooks phase, 0 handlers queued 2024-10-31 00:27:58 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: tracer> tracer: main dispatch loop, 5 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:27:58 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-10-31 00:27:58 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: Found peers: 252.17.134.150,252.17.186.134 2024-10-31 00:27:58 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: Expect 2 peers 2024-10-31 00:27:58 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: Reached quorum 2024-10-31 00:27:58 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:27:58 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-10-31 00:27:58 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-10-31 00:27:58 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:27:58 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: Running _assess_status() 2024-10-31 00:27:59 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator:4: coordinator.DelayedActionCoordinator Publishing state 2024-10-31 00:27:59 INFO juju.worker.uniter.operation runhook.go:159 ran "coordinator-relation-changed" hook (via explicit, bespoke hook script) 2024-10-31 00:27:59 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (4; unit: mysql-innodb-cluster/1) hook" for mysql-innodb-cluster/2 2024-10-31 00:27:59 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 00:27:59 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run relation-changed (4; unit: mysql-innodb-cluster/1) hook) 2024-10-31 00:27:59 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 00:27:59 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 00:27:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 00:27:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 00:27:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 00:27:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 00:27:59 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (3; unit: mysql-innodb-cluster/0) hook for mysql-innodb-cluster/2 2024-10-31 00:27:59 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run relation-changed (3; unit: mysql-innodb-cluster/0) hook) 2024-10-31 00:27:59 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run relation-changed (3; unit: mysql-innodb-cluster/0) hook) 2024-10-31 00:27:59 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (3; unit: mysql-innodb-cluster/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:28:00 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (3; unit: mysql-innodb-cluster/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:28:00 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running cluster-relation-changed hook for mysql-innodb-cluster/0 2024-10-31 00:28:00 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 00:28:00 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Reactive main running for hook cluster-relation-changed 2024-10-31 00:28:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:28:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.ssl_cert 2024-10-31 00:28:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.ssl_key 2024-10-31 00:28:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.ssl_ca 2024-10-31 00:28:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.source 2024-10-31 00:28:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.source 2024-10-31 00:28:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.cluster-name 2024-10-31 00:28:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.cluster-name 2024-10-31 00:28:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.auto-rejoin-tries 2024-10-31 00:28:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.auto-rejoin-tries 2024-10-31 00:28:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.expel-timeout 2024-10-31 00:28:02 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.expel-timeout 2024-10-31 00:28:02 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.innodb-buffer-pool-size 2024-10-31 00:28:02 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.innodb-change-buffering 2024-10-31 00:28:02 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.innodb-change-buffering 2024-10-31 00:28:02 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.innodb-io-capacity 2024-10-31 00:28:02 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.innodb-io-capacity 2024-10-31 00:28:02 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.innodb-file-per-table 2024-10-31 00:28:02 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.innodb-file-per-table 2024-10-31 00:28:02 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.tuning-level 2024-10-31 00:28:02 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.tuning-level 2024-10-31 00:28:02 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.table-open-cache 2024-10-31 00:28:02 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.table-open-cache 2024-10-31 00:28:02 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.max-connections 2024-10-31 00:28:02 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.enable-binlogs 2024-10-31 00:28:02 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.binlogs-path 2024-10-31 00:28:02 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.binlogs-path 2024-10-31 00:28:02 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.binlogs-max-size 2024-10-31 00:28:02 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.binlogs-max-size 2024-10-31 00:28:03 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.binlogs-expire-days 2024-10-31 00:28:03 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.binlogs-expire-days 2024-10-31 00:28:03 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.prefer-ipv6 2024-10-31 00:28:03 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.wait-timeout 2024-10-31 00:28:03 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.wait-timeout 2024-10-31 00:28:03 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.os-db-router-hostname 2024-10-31 00:28:03 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Initializing Snap Layer 2024-10-31 00:28:03 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: coordinator.DelayedActionCoordinator Loading state 2024-10-31 00:28:03 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Coordinator: Initializing coordinator layer 2024-10-31 00:28:03 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Initializing Leadership Layer (is follower) 2024-10-31 00:28:03 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer> tracer: starting handler dispatch, 69 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.cluster-address tracer: set flag endpoint.cluster.changed.cluster-password tracer: set flag endpoint.cluster.changed.cluster-user tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-configure-ready tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-17-134-150 tracer: set flag leadership.set.cluster-instance-configured-252-17-134-150 tracer: set flag leadership.set.cluster-instance-configured-252-17-186-134 tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 00:28:03 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: hooks phase, 0 handlers queued 2024-10-31 00:28:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer> tracer: main dispatch loop, 5 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:28:04 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-10-31 00:28:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Found peers: 252.17.134.150,252.17.186.134 2024-10-31 00:28:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Expect 2 peers 2024-10-31 00:28:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Reached quorum 2024-10-31 00:28:04 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:28:04 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-10-31 00:28:04 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-10-31 00:28:04 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:28:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Running _assess_status() 2024-10-31 00:28:05 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: coordinator.DelayedActionCoordinator Publishing state 2024-10-31 00:28:05 INFO juju.worker.uniter.operation runhook.go:159 ran "cluster-relation-changed" hook (via explicit, bespoke hook script) 2024-10-31 00:28:05 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (3; unit: mysql-innodb-cluster/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:28:05 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 00:28:05 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run relation-changed (3; unit: mysql-innodb-cluster/0) hook) 2024-10-31 00:28:05 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 00:28:05 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 00:28:05 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 00:28:05 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 00:28:05 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 00:28:05 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 00:28:05 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 2024-10-31 00:28:05 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 00:28:05 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 00:28:05 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 00:28:05 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 00:28:05 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 00:28:12 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for mysql-innodb-cluster/2: ok=true 2024-10-31 00:28:12 DEBUG juju.worker.uniter.operation executor.go:85 running operation run leader-settings-changed hook for mysql-innodb-cluster/2 2024-10-31 00:28:12 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run leader-settings-changed hook) 2024-10-31 00:28:12 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run leader-settings-changed hook) 2024-10-31 00:28:12 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run leader-settings-changed hook" for mysql-innodb-cluster/2 2024-10-31 00:28:12 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run leader-settings-changed hook" for mysql-innodb-cluster/2 2024-10-31 00:28:12 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running leader-settings-changed hook 2024-10-31 00:28:12 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 00:28:13 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Reactive main running for hook leader-settings-changed 2024-10-31 00:28:13 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for mysql-innodb-cluster/2 : {35 {map[keystone-mysql-router/0:{0}] map[] []}} 2024-10-31 00:28:14 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Initializing Snap Layer 2024-10-31 00:28:14 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator.DelayedActionCoordinator Loading state 2024-10-31 00:28:14 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Coordinator: Initializing coordinator layer 2024-10-31 00:28:14 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Initializing Leadership Layer (is follower) 2024-10-31 00:28:14 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: set flag leadership.changed.cluster-instance-clustered-252-17-186-134 tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:28:14 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag leadership.set.cluster-instance-clustered-252-17-186-134 2024-10-31 00:28:14 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag leadership.changed 2024-10-31 00:28:14 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: starting handler dispatch, 37 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.cluster-address tracer: set flag endpoint.cluster.changed.cluster-password tracer: set flag endpoint.cluster.changed.cluster-user tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-configure-ready tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag leadership.changed tracer: set flag leadership.changed.cluster-instance-clustered-252-17-186-134 tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-17-134-150 tracer: set flag leadership.set.cluster-instance-clustered-252-17-186-134 tracer: set flag leadership.set.cluster-instance-configured-252-17-134-150 tracer: set flag leadership.set.cluster-instance-configured-252-17-186-134 tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 00:28:14 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-10-31 00:28:14 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: main dispatch loop, 5 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:28:14 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-10-31 00:28:14 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Found peers: 252.17.134.150,252.17.186.134 2024-10-31 00:28:15 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Expect 2 peers 2024-10-31 00:28:15 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Reached quorum 2024-10-31 00:28:15 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:28:15 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-10-31 00:28:15 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-10-31 00:28:15 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:28:15 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Running _assess_status() 2024-10-31 00:28:16 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator.DelayedActionCoordinator Publishing state 2024-10-31 00:28:16 INFO juju.worker.uniter.operation runhook.go:159 ran "leader-settings-changed" hook (via explicit, bespoke hook script) 2024-10-31 00:28:16 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run leader-settings-changed hook" for mysql-innodb-cluster/2 2024-10-31 00:28:16 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 00:28:16 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run leader-settings-changed hook) 2024-10-31 00:28:16 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 00:28:16 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 00:28:16 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 00:28:16 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 00:28:16 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-joined (35; unit: keystone-mysql-router/0) hook for mysql-innodb-cluster/2 2024-10-31 00:28:16 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run relation-joined (35; unit: keystone-mysql-router/0) hook) 2024-10-31 00:28:16 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run relation-joined (35; unit: keystone-mysql-router/0) hook) 2024-10-31 00:28:16 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-joined (35; unit: keystone-mysql-router/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:28:16 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-joined (35; unit: keystone-mysql-router/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:28:16 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running db-router-relation-joined hook for keystone-mysql-router/0 2024-10-31 00:28:16 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 00:28:16 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for mysql-innodb-cluster/2 : {3 {map[mysql-innodb-cluster/1:{3}] map[] []}} 2024-10-31 00:28:17 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: Reactive main running for hook db-router-relation-joined 2024-10-31 00:28:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer> tracer: set flag endpoint.db-router.joined tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:28:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer> tracer: set flag endpoint.db-router.changed tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router 2024-10-31 00:28:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag endpoint.db-router.changed.egress-subnets 2024-10-31 00:28:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag endpoint.db-router.changed.ingress-address 2024-10-31 00:28:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag endpoint.db-router.changed.private-address 2024-10-31 00:28:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.snapd_refresh 2024-10-31 00:28:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.ssl_cert 2024-10-31 00:28:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.ssl_key 2024-10-31 00:28:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.ssl_ca 2024-10-31 00:28:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.set.source 2024-10-31 00:28:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.source 2024-10-31 00:28:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.set.cluster-name 2024-10-31 00:28:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.cluster-name 2024-10-31 00:28:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.set.auto-rejoin-tries 2024-10-31 00:28:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.auto-rejoin-tries 2024-10-31 00:28:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.set.expel-timeout 2024-10-31 00:28:19 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.expel-timeout 2024-10-31 00:28:19 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.set.innodb-buffer-pool-size 2024-10-31 00:28:19 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.set.innodb-change-buffering 2024-10-31 00:28:19 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.innodb-change-buffering 2024-10-31 00:28:19 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.set.innodb-io-capacity 2024-10-31 00:28:19 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.innodb-io-capacity 2024-10-31 00:28:19 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.set.innodb-file-per-table 2024-10-31 00:28:19 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.innodb-file-per-table 2024-10-31 00:28:19 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.set.tuning-level 2024-10-31 00:28:19 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.tuning-level 2024-10-31 00:28:19 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.set.table-open-cache 2024-10-31 00:28:19 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.table-open-cache 2024-10-31 00:28:19 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for mysql-innodb-cluster/2: ok=true 2024-10-31 00:28:19 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.set.max-connections 2024-10-31 00:28:19 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.enable-binlogs 2024-10-31 00:28:19 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.set.binlogs-path 2024-10-31 00:28:19 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.binlogs-path 2024-10-31 00:28:20 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.set.binlogs-max-size 2024-10-31 00:28:20 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.binlogs-max-size 2024-10-31 00:28:20 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.set.binlogs-expire-days 2024-10-31 00:28:20 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.binlogs-expire-days 2024-10-31 00:28:20 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.prefer-ipv6 2024-10-31 00:28:20 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.set.wait-timeout 2024-10-31 00:28:20 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.wait-timeout 2024-10-31 00:28:20 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.os-db-router-hostname 2024-10-31 00:28:20 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: Initializing Snap Layer 2024-10-31 00:28:21 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: coordinator.DelayedActionCoordinator Loading state 2024-10-31 00:28:21 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: Coordinator: Initializing coordinator layer 2024-10-31 00:28:21 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: Initializing Leadership Layer (is follower) 2024-10-31 00:28:21 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: cleared flag leadership.changed.cluster-instance-clustered-252-17-186-134 2024-10-31 00:28:21 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: cleared flag leadership.changed 2024-10-31 00:28:21 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer> tracer: starting handler dispatch, 75 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.cluster-address tracer: set flag endpoint.cluster.changed.cluster-password tracer: set flag endpoint.cluster.changed.cluster-user tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-configure-ready tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-17-134-150 tracer: set flag leadership.set.cluster-instance-clustered-252-17-186-134 tracer: set flag leadership.set.cluster-instance-configured-252-17-134-150 tracer: set flag leadership.set.cluster-instance-configured-252-17-186-134 tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 00:28:21 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: hooks phase, 0 handlers queued 2024-10-31 00:28:21 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:28:21 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-10-31 00:28:21 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: Found peers: 252.17.134.150,252.17.186.134 2024-10-31 00:28:21 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: Expect 2 peers 2024-10-31 00:28:21 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: Reached quorum 2024-10-31 00:28:21 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:28:21 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-10-31 00:28:21 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-10-31 00:28:21 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-10-31 00:28:21 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag db-router.connected 2024-10-31 00:28:21 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router 2024-10-31 00:28:21 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:28:21 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: Running _assess_status() 2024-10-31 00:28:22 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: coordinator.DelayedActionCoordinator Publishing state 2024-10-31 00:28:23 INFO juju.worker.uniter.operation runhook.go:159 ran "db-router-relation-joined" hook (via explicit, bespoke hook script) 2024-10-31 00:28:23 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-joined (35; unit: keystone-mysql-router/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:28:23 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 00:28:23 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run relation-joined (35; unit: keystone-mysql-router/0) hook) 2024-10-31 00:28:23 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 00:28:23 DEBUG juju.worker.uniter.operation executor.go:85 running operation run leader-settings-changed hook for mysql-innodb-cluster/2 2024-10-31 00:28:23 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run leader-settings-changed hook) 2024-10-31 00:28:23 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run leader-settings-changed hook) 2024-10-31 00:28:23 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run leader-settings-changed hook" for mysql-innodb-cluster/2 2024-10-31 00:28:23 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run leader-settings-changed hook" for mysql-innodb-cluster/2 2024-10-31 00:28:23 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running leader-settings-changed hook 2024-10-31 00:28:23 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 00:28:24 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Reactive main running for hook leader-settings-changed 2024-10-31 00:28:25 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Initializing Snap Layer 2024-10-31 00:28:26 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator.DelayedActionCoordinator Loading state 2024-10-31 00:28:26 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Coordinator: Initializing coordinator layer 2024-10-31 00:28:26 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Initializing Leadership Layer (is follower) 2024-10-31 00:28:26 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: set flag leadership.changed.cluster-instance-configured-252-17-137-230 tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:28:26 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag leadership.set.cluster-instance-configured-252-17-137-230 2024-10-31 00:28:26 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag leadership.changed 2024-10-31 00:28:26 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: starting handler dispatch, 44 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.connected tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.cluster-address tracer: set flag endpoint.cluster.changed.cluster-password tracer: set flag endpoint.cluster.changed.cluster-user tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-configure-ready tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.changed tracer: set flag leadership.changed.cluster-instance-configured-252-17-137-230 tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-17-134-150 tracer: set flag leadership.set.cluster-instance-clustered-252-17-186-134 tracer: set flag leadership.set.cluster-instance-configured-252-17-134-150 tracer: set flag leadership.set.cluster-instance-configured-252-17-137-230 tracer: set flag leadership.set.cluster-instance-configured-252-17-186-134 tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 00:28:26 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-10-31 00:28:26 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:28:26 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-10-31 00:28:26 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Found peers: 252.17.134.150,252.17.186.134 2024-10-31 00:28:26 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Expect 2 peers 2024-10-31 00:28:26 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Reached quorum 2024-10-31 00:28:26 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:28:26 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-10-31 00:28:26 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-10-31 00:28:26 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-10-31 00:28:26 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router 2024-10-31 00:28:26 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:28:26 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Running _assess_status() 2024-10-31 00:28:27 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator.DelayedActionCoordinator Publishing state 2024-10-31 00:28:28 INFO juju.worker.uniter.operation runhook.go:159 ran "leader-settings-changed" hook (via explicit, bespoke hook script) 2024-10-31 00:28:28 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run leader-settings-changed hook" for mysql-innodb-cluster/2 2024-10-31 00:28:28 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 00:28:28 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run leader-settings-changed hook) 2024-10-31 00:28:28 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 00:28:28 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 00:28:28 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 00:28:28 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 00:28:28 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 00:28:28 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 00:28:28 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (3; unit: mysql-innodb-cluster/1) hook for mysql-innodb-cluster/2 2024-10-31 00:28:28 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run relation-changed (3; unit: mysql-innodb-cluster/1) hook) 2024-10-31 00:28:28 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run relation-changed (3; unit: mysql-innodb-cluster/1) hook) 2024-10-31 00:28:28 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (3; unit: mysql-innodb-cluster/1) hook" for mysql-innodb-cluster/2 2024-10-31 00:28:28 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (3; unit: mysql-innodb-cluster/1) hook" for mysql-innodb-cluster/2 2024-10-31 00:28:28 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running cluster-relation-changed hook for mysql-innodb-cluster/1 2024-10-31 00:28:28 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 00:28:29 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Reactive main running for hook cluster-relation-changed 2024-10-31 00:28:29 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer> tracer: set flag endpoint.cluster.changed.unit-clustered tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:28:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.snapd_refresh 2024-10-31 00:28:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.ssl_cert 2024-10-31 00:28:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.ssl_key 2024-10-31 00:28:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.ssl_ca 2024-10-31 00:28:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.source 2024-10-31 00:28:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.source 2024-10-31 00:28:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.cluster-name 2024-10-31 00:28:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.cluster-name 2024-10-31 00:28:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.auto-rejoin-tries 2024-10-31 00:28:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.auto-rejoin-tries 2024-10-31 00:28:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.expel-timeout 2024-10-31 00:28:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.expel-timeout 2024-10-31 00:28:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.innodb-buffer-pool-size 2024-10-31 00:28:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.innodb-change-buffering 2024-10-31 00:28:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.innodb-change-buffering 2024-10-31 00:28:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.innodb-io-capacity 2024-10-31 00:28:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.innodb-io-capacity 2024-10-31 00:28:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.innodb-file-per-table 2024-10-31 00:28:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.innodb-file-per-table 2024-10-31 00:28:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.tuning-level 2024-10-31 00:28:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.tuning-level 2024-10-31 00:28:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.table-open-cache 2024-10-31 00:28:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.table-open-cache 2024-10-31 00:28:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.max-connections 2024-10-31 00:28:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.enable-binlogs 2024-10-31 00:28:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.binlogs-path 2024-10-31 00:28:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.binlogs-path 2024-10-31 00:28:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.binlogs-max-size 2024-10-31 00:28:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.binlogs-max-size 2024-10-31 00:28:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.binlogs-expire-days 2024-10-31 00:28:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.binlogs-expire-days 2024-10-31 00:28:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.prefer-ipv6 2024-10-31 00:28:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.set.wait-timeout 2024-10-31 00:28:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.wait-timeout 2024-10-31 00:28:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: set flag config.default.os-db-router-hostname 2024-10-31 00:28:31 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Initializing Snap Layer 2024-10-31 00:28:31 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: coordinator.DelayedActionCoordinator Loading state 2024-10-31 00:28:31 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Coordinator: Initializing coordinator layer 2024-10-31 00:28:31 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Initializing Leadership Layer (is follower) 2024-10-31 00:28:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: cleared flag leadership.changed.cluster-instance-configured-252-17-137-230 2024-10-31 00:28:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: cleared flag leadership.changed 2024-10-31 00:28:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer> tracer: starting handler dispatch, 78 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.cluster-address tracer: set flag endpoint.cluster.changed.cluster-password tracer: set flag endpoint.cluster.changed.cluster-user tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.changed.unit-configure-ready tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-17-134-150 tracer: set flag leadership.set.cluster-instance-clustered-252-17-186-134 tracer: set flag leadership.set.cluster-instance-configured-252-17-134-150 tracer: set flag leadership.set.cluster-instance-configured-252-17-137-230 tracer: set flag leadership.set.cluster-instance-configured-252-17-186-134 tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 00:28:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: hooks phase, 0 handlers queued 2024-10-31 00:28:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:28:32 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-10-31 00:28:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Found peers: 252.17.134.150,252.17.186.134 2024-10-31 00:28:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Expect 2 peers 2024-10-31 00:28:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Reached quorum 2024-10-31 00:28:32 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:28:32 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-10-31 00:28:32 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-10-31 00:28:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: cleared flag endpoint.cluster.changed.cluster-address 2024-10-31 00:28:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: cleared flag endpoint.cluster.changed.cluster-user 2024-10-31 00:28:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: cleared flag endpoint.cluster.changed.cluster-password 2024-10-31 00:28:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: cleared flag endpoint.cluster.changed.unit-configure-ready 2024-10-31 00:28:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: tracer: cleared flag endpoint.cluster.changed.unit-clustered 2024-10-31 00:28:32 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-10-31 00:28:33 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router 2024-10-31 00:28:33 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:28:33 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: Running _assess_status() 2024-10-31 00:28:34 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 cluster:3: coordinator.DelayedActionCoordinator Publishing state 2024-10-31 00:28:34 INFO juju.worker.uniter.operation runhook.go:159 ran "cluster-relation-changed" hook (via explicit, bespoke hook script) 2024-10-31 00:28:35 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (3; unit: mysql-innodb-cluster/1) hook" for mysql-innodb-cluster/2 2024-10-31 00:28:35 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 00:28:35 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run relation-changed (3; unit: mysql-innodb-cluster/1) hook) 2024-10-31 00:28:35 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 00:28:35 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 00:28:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 00:28:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 00:28:35 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (35; unit: keystone-mysql-router/0) hook for mysql-innodb-cluster/2 2024-10-31 00:28:35 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run relation-changed (35; unit: keystone-mysql-router/0) hook) 2024-10-31 00:28:35 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run relation-changed (35; unit: keystone-mysql-router/0) hook) 2024-10-31 00:28:35 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (35; unit: keystone-mysql-router/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:28:35 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (35; unit: keystone-mysql-router/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:28:35 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running db-router-relation-changed hook for keystone-mysql-router/0 2024-10-31 00:28:35 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 00:28:36 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: Reactive main running for hook db-router-relation-changed 2024-10-31 00:28:36 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:28:37 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.ssl_cert 2024-10-31 00:28:37 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.ssl_key 2024-10-31 00:28:37 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.ssl_ca 2024-10-31 00:28:37 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.set.source 2024-10-31 00:28:37 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.source 2024-10-31 00:28:37 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.set.cluster-name 2024-10-31 00:28:37 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.cluster-name 2024-10-31 00:28:37 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.set.auto-rejoin-tries 2024-10-31 00:28:37 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.auto-rejoin-tries 2024-10-31 00:28:37 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.set.expel-timeout 2024-10-31 00:28:37 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.expel-timeout 2024-10-31 00:28:37 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.set.innodb-buffer-pool-size 2024-10-31 00:28:37 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.set.innodb-change-buffering 2024-10-31 00:28:37 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.innodb-change-buffering 2024-10-31 00:28:37 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.set.innodb-io-capacity 2024-10-31 00:28:37 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.innodb-io-capacity 2024-10-31 00:28:37 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.set.innodb-file-per-table 2024-10-31 00:28:37 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.innodb-file-per-table 2024-10-31 00:28:37 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.set.tuning-level 2024-10-31 00:28:37 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.tuning-level 2024-10-31 00:28:37 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.set.table-open-cache 2024-10-31 00:28:37 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.table-open-cache 2024-10-31 00:28:37 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.set.max-connections 2024-10-31 00:28:37 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.enable-binlogs 2024-10-31 00:28:37 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.set.binlogs-path 2024-10-31 00:28:37 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.binlogs-path 2024-10-31 00:28:38 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.set.binlogs-max-size 2024-10-31 00:28:38 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.binlogs-max-size 2024-10-31 00:28:38 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.set.binlogs-expire-days 2024-10-31 00:28:38 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.binlogs-expire-days 2024-10-31 00:28:38 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.prefer-ipv6 2024-10-31 00:28:38 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.set.wait-timeout 2024-10-31 00:28:38 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.wait-timeout 2024-10-31 00:28:38 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.os-db-router-hostname 2024-10-31 00:28:38 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: Initializing Snap Layer 2024-10-31 00:28:38 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: coordinator.DelayedActionCoordinator Loading state 2024-10-31 00:28:38 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: Coordinator: Initializing coordinator layer 2024-10-31 00:28:38 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: Initializing Leadership Layer (is follower) 2024-10-31 00:28:38 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer> tracer: starting handler dispatch, 73 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-17-134-150 tracer: set flag leadership.set.cluster-instance-clustered-252-17-186-134 tracer: set flag leadership.set.cluster-instance-configured-252-17-134-150 tracer: set flag leadership.set.cluster-instance-configured-252-17-137-230 tracer: set flag leadership.set.cluster-instance-configured-252-17-186-134 tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 00:28:38 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: hooks phase, 0 handlers queued 2024-10-31 00:28:38 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:28:38 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-10-31 00:28:38 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: Found peers: 252.17.134.150,252.17.186.134 2024-10-31 00:28:38 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: Expect 2 peers 2024-10-31 00:28:38 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: Reached quorum 2024-10-31 00:28:38 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:28:38 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-10-31 00:28:38 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-10-31 00:28:38 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-10-31 00:28:39 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router 2024-10-31 00:28:39 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:28:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: Running _assess_status() 2024-10-31 00:28:39 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: coordinator.DelayedActionCoordinator Publishing state 2024-10-31 00:28:40 INFO juju.worker.uniter.operation runhook.go:159 ran "db-router-relation-changed" hook (via explicit, bespoke hook script) 2024-10-31 00:28:40 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (35; unit: keystone-mysql-router/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:28:40 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 00:28:40 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run relation-changed (35; unit: keystone-mysql-router/0) hook) 2024-10-31 00:28:40 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 00:28:40 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 00:28:40 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 00:28:40 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 00:28:40 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 00:28:40 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 00:28:40 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-10-31 00:28:40 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 2024-10-31 00:28:40 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 00:28:40 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-10-31 00:28:40 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 00:28:40 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 00:28:40 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 00:28:40 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 00:28:41 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for mysql-innodb-cluster/2: ok=true 2024-10-31 00:28:41 DEBUG juju.worker.uniter.operation executor.go:85 running operation run leader-settings-changed hook for mysql-innodb-cluster/2 2024-10-31 00:28:41 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run leader-settings-changed hook) 2024-10-31 00:28:41 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run leader-settings-changed hook) 2024-10-31 00:28:41 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run leader-settings-changed hook" for mysql-innodb-cluster/2 2024-10-31 00:28:41 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run leader-settings-changed hook" for mysql-innodb-cluster/2 2024-10-31 00:28:41 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running leader-settings-changed hook 2024-10-31 00:28:41 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 00:28:41 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for mysql-innodb-cluster/2: ok=true 2024-10-31 00:28:42 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Reactive main running for hook leader-settings-changed 2024-10-31 00:28:42 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Initializing Snap Layer 2024-10-31 00:28:43 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator.DelayedActionCoordinator Loading state 2024-10-31 00:28:43 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Coordinator: Initializing coordinator layer 2024-10-31 00:28:43 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Initializing Leadership Layer (is follower) 2024-10-31 00:28:43 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: set flag leadership.changed.cluster-instance-clustered-252-17-137-230 tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:28:43 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag leadership.set.cluster-instance-clustered-252-17-137-230 2024-10-31 00:28:43 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag leadership.changed.cluster-instances-clustered 2024-10-31 00:28:43 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag leadership.set.cluster-instances-clustered 2024-10-31 00:28:43 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag leadership.changed.cluster-instances-configured 2024-10-31 00:28:43 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag leadership.set.cluster-instances-configured 2024-10-31 00:28:43 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag leadership.changed 2024-10-31 00:28:43 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: starting handler dispatch, 45 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.connected tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.changed tracer: set flag leadership.changed.cluster-instance-clustered-252-17-137-230 tracer: set flag leadership.changed.cluster-instances-clustered tracer: set flag leadership.changed.cluster-instances-configured tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-17-134-150 tracer: set flag leadership.set.cluster-instance-clustered-252-17-137-230 tracer: set flag leadership.set.cluster-instance-clustered-252-17-186-134 tracer: set flag leadership.set.cluster-instance-configured-252-17-134-150 tracer: set flag leadership.set.cluster-instance-configured-252-17-137-230 tracer: set flag leadership.set.cluster-instance-configured-252-17-186-134 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 00:28:43 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-10-31 00:28:43 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:28:43 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-10-31 00:28:43 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Found peers: 252.17.134.150,252.17.186.134 2024-10-31 00:28:43 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Expect 2 peers 2024-10-31 00:28:43 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Reached quorum 2024-10-31 00:28:43 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:28:44 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-10-31 00:28:44 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-10-31 00:28:44 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-10-31 00:28:44 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router 2024-10-31 00:28:44 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:28:44 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Running _assess_status() 2024-10-31 00:28:44 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-10-31 00:28:44 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 active 2024-10-31 00:28:45 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Opening db connection for root@localhost 2024-10-31 00:28:45 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Checking cluster status. 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 MySQL Shell 8.0.23 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 Copyright (c) 2016, 2021, Oracle and/or its affiliates. 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 Oracle is a registered trademark of Oracle Corporation and/or its affiliates. 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 Other names may be trademarks of their respective owners. 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 Usage: mysqlsh [OPTIONS] [URI] 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 mysqlsh [OPTIONS] [URI] -f [...] 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 mysqlsh [OPTIONS] [URI] --dba enableXProtocol 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 mysqlsh [OPTIONS] [URI] --cluster 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 mysqlsh [OPTIONS] [URI] -- [...] 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 mysqlsh [OPTIONS] [URI] --import {|-} [|] 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 -?, --help Display this help and exit. 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 -- Triggers API Command Line integration, which 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 allows execution of methods of the Shell 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 global objects from command line using 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 syntax: 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 -- [arguments] 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 For more details execute '\? cmdline' inside 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 of the Shell. 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 -e, --execute= Execute command and quit. 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 -f, --file= Specify a file to process in batch mode. Any 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 options specified after this are used as 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 arguments of the processed file. 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 --uri= Connect to Uniform Resource Identifier. 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 Format: [user[:pass]@]host[:port][/db] 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 -h, --host= Connect to host. 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 -P, --port=<#> Port number to use for connection. 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 --connect-timeout= Connection timeout in milliseconds. 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 -S, --socket[=] Socket name to use. If no value is provided 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 will use default UNIX socket path. 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 -u, --user= User for the connection to the server. 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 --password=[] Password to use when connecting to server. If 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 password is empty, connection will be made 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 without using a password. 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 -p, --password Request password prompt to set the password 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 -C, --compress[=] Use compression in client/server protocol. 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 Valid values: 'REQUIRED', 'PREFFERED', 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 'DISABLED', 'True', 'False', '1', and '0'. 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 Boolean values map to REQUIRED and DISABLED 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 respectively. By default compression is set 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 to DISABLED in classic protocol and PREFERRED 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 in X protocol connections. 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 --compression-algorithms= Use compression algorithm in server/client 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 protocol. Expects comma separated list of 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 algorithms. Supported algorithms include 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 'zstd', 'zlib', 'lz4' (X protocol only), and 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 'uncompressed', which if appears in a list, 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 causes connection to succeed even if 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 compression negotiation fails. 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 --compression-level= Use this compression level in the 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 --zstd-compression-level= client/server protocol. Supported by X 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 protocol and zstd compression in classic 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 protocol. 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 --import Import JSON documents from file to collection 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 --import
or table in MySQL Server. Set file to - if 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 you want to read the data from stdin. 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 Requires a default schema on the connection 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 options. 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 -D, --schema= Schema to use. 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 --database= Same as --schema. 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 --recreate-schema Drop and recreate the specified schema. 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 Schema will be deleted if it exists! 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 --mx, --mysqlx Uses connection data to create an X protocol 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 session. 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 --mc, --mysql Uses connection data to create a classic 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 session. 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 --redirect-primary Ensure that the target server is part of an 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 InnoDB cluster or ReplicaSet and if it is not 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 a primary, find the primary and connect to it. 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 --redirect-secondary Ensure that the target server is part of an 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 InnoDB cluster or ReplicaSet and if it is not 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 a secondary, find a secondary and connect to 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 it. 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 --cluster Ensure that the target server is part of an 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 InnoDB cluster and if so, set the cluster 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 global variable. 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 --replicaset Ensure that the target server is part of an 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 InnoDB ReplicaSet and if so, set the rs 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 global variable. 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 --sql Start in SQL mode, auto-detecting the 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 protocol to use if it is not specified as 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 part of the connection information. 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 --sqlc Start in SQL mode using a classic session. 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 --sqlx Start in SQL mode using an X protocol session. 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 --js, --javascript Start in JavaScript mode. 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 --py, --python Start in Python mode. 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 --pym Run Python library module as a script. 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 Remaining args are forwarded to it. 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 --json[=] Produce output in JSON format. Allowed 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 values: raw, pretty, and off. If no format is 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 specified pretty format is produced. 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 --table Produce output in table format (default for 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 interactive mode). This option can be used to 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 force that format when running in batch mode. 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 --tabbed Produce output in tab separated format 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 (default for batch mode). This option can be 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 used to force that format when running in 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 interactive mode. 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 -E, --vertical Print the output of a query (rows) vertically. 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 --result-format= Determines format of results. Allowed values: 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 [table, tabbed, vertical, json, ndjson, 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 json/raw, json/array, json/pretty]. 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 --get-server-public-key Request public key from the server required 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 for RSA key pair-based password exchange. Use 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 when connecting to MySQL 8.0 servers with 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 classic sessions with SSL mode DISABLED. 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 --server-public-key-path=

The path name to a file containing a 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 client-side copy of the public key required 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 by the server for RSA key pair-based password 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 exchange. Use when connecting to MySQL 8.0 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 servers with classic sessions with SSL mode 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 DISABLED. 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 -i, --interactive[=full] To use in batch mode. It forces emulation of 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 interactive mode processing. Each line on the 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 batch is processed as if it were in 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 interactive mode. 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 --force In SQL batch mode, forces processing to 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 continue if an error is found. 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 --log-level= Set logging level. The log level value must 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 be an integer between 1 and 8 or any of 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 [none, internal, error, warning, info, debug, 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 debug2, debug3] respectively. 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 --dba-log-sql[={0|1|2}] Log SQL statements executed by AdminAPI 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 operations: 0 - logging disabled; 1 - log 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 statements other than SELECT and SHOW; 2 - 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 log all statements. 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 --verbose[={0|1|2|3|4}] Enable diagnostic message output to the 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 console: 0 - display no messages; 1 - display 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 error, warning and informational messages; 2, 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 3, 4 - include higher levels of debug 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 messages. If level is not given, 1 is assumed. 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 --passwords-from-stdin Read passwords from stdin instead of the 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 console. 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 --show-warnings={true|false} Automatically display SQL warnings on SQL 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 mode if available. 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 --column-type-info Display column type information in SQL mode. 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 Please be aware that output may depend on the 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 protocol you are using to connect to the 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 server, e.g. DbType field is approximated 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 when using X protocol. 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 --histignore= Shell's history ignore list. 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 --pager= Pager used to display text output of 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 statements executed in SQL mode as well as 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 some other selected commands. Pager can be 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 manually enabled in scripting modes. If you 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 don't supply an option, the default pager is 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 taken from your ENV variable PAGER. This 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 option only works in interactive mode. This 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 option is disabled by default. 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 --name-cache Enable database name caching for 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 autocompletion and DevAPI (default). 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 -A, --no-name-cache Disable automatic database name caching for 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 autocompletion and DevAPI. Use \rehash to 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 load DB names manually. 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 --nw, --no-wizard Disables wizard mode. 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 --no-password Sets empty password and disables prompt for 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 password. 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 -V, --version Prints the version of MySQL Shell. 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 --ssl-key= The path to the SSL private key file in PEM 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 format. 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 --ssl-cert= The path to the SSL public key certificate 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 file in PEM format. 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 --ssl-ca= The path to the certificate authority file in 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 PEM format. 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 --ssl-capath= The path to the directory that contains the 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 certificate authority files in PEM format. 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 --ssl-cipher= The list of permissible encryption ciphers 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 for connections that use TLS protocols up 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 through TLSv1.2. 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 --ssl-crl= The path to the file containing certificate 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 revocation lists in PEM format. 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 --ssl-crlpath= The path to the directory that contains 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 certificate revocation-list files in PEM 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 format. 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 --ssl-mode= SSL mode to use. Allowed values: 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 DISABLED,PREFERRED, REQUIRED, VERIFY_CA, 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 VERIFY_IDENTITY. 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 --tls-version= TLS version to use. Allowed values: TLSv1, 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 TLSv1.1, TLSv1.2, TLSv1.3. 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 --tls-ciphersuites= TLS v1.3 cipher to use. 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 --auth-method= Authentication method to use. In case of 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 classic session, this is the name of the 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 authentication plugin to use, i.e. 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 caching_sha2_password. In case of X protocol 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 session, it should be one of: AUTO, 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 FROM_CAPABILITIES, FALLBACK, MYSQL41, PLAIN, 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 SHA256_MEMORY. 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 --dba=enableXProtocol Enable the X protocol in the target server. 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 Requires a connection using classic session. 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 --quiet-start[={1|2}] Avoids printing information when the shell is 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 started. A value of 1 will prevent printing 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 the shell version information. A value of 2 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 will prevent printing any information unless 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 it is an error. If no value is specified uses 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 1 as default. 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 --oci[=] Starts the shell ready to work with OCI. A 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 wizard to configure the given profile will be 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 launched if the profile is not configured. If 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 no profile is specified the value of shell 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 option oci.profile will be used. 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 --credential-store-helper= Specifies the helper which is going to be 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 used to store/retrieve the passwords. 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 --save-passwords= Controls automatic storage of passwords. 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 Allowed values are: always, prompt, never. 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 Usage examples: 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 $ mysqlsh root@localhost/schema 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 $ mysqlsh mysqlx://root@some.server:3307/world_x 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 $ mysqlsh --uri root@localhost --py -f sample.py sample param 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 $ mysqlsh root@targethost:33070 -s world_x -f sample.js 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 $ mysqlsh -- util check-for-server-upgrade root@localhost --output-format=JSON 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 $ mysqlsh mysqlx://user@host/db --import ~/products.json shop 2024-10-31 00:28:49 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 2024-10-31 00:28:51 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Opening db connection for root@None 2024-10-31 00:28:51 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator.DelayedActionCoordinator Publishing state 2024-10-31 00:28:52 INFO juju.worker.uniter.operation runhook.go:159 ran "leader-settings-changed" hook (via explicit, bespoke hook script) 2024-10-31 00:28:52 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run leader-settings-changed hook" for mysql-innodb-cluster/2 2024-10-31 00:28:52 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 00:28:52 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run leader-settings-changed hook) 2024-10-31 00:28:52 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 00:28:52 DEBUG juju.worker.uniter.operation executor.go:85 running operation run leader-settings-changed hook for mysql-innodb-cluster/2 2024-10-31 00:28:52 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run leader-settings-changed hook) 2024-10-31 00:28:52 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run leader-settings-changed hook) 2024-10-31 00:28:52 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run leader-settings-changed hook" for mysql-innodb-cluster/2 2024-10-31 00:28:52 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run leader-settings-changed hook" for mysql-innodb-cluster/2 2024-10-31 00:28:52 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 00:28:52 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Reactive main running for hook leader-settings-changed 2024-10-31 00:28:53 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Initializing Snap Layer 2024-10-31 00:28:53 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator.DelayedActionCoordinator Loading state 2024-10-31 00:28:54 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Coordinator: Initializing coordinator layer 2024-10-31 00:28:54 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Initializing Leadership Layer (is follower) 2024-10-31 00:28:54 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: cleared flag leadership.changed.cluster-instance-clustered-252-17-137-230 tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:28:54 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: cleared flag leadership.changed.cluster-instances-clustered 2024-10-31 00:28:54 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: cleared flag leadership.changed.cluster-instances-configured 2024-10-31 00:28:54 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: cleared flag leadership.changed 2024-10-31 00:28:54 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: starting handler dispatch, 41 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.connected tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-17-134-150 tracer: set flag leadership.set.cluster-instance-clustered-252-17-137-230 tracer: set flag leadership.set.cluster-instance-clustered-252-17-186-134 tracer: set flag leadership.set.cluster-instance-configured-252-17-134-150 tracer: set flag leadership.set.cluster-instance-configured-252-17-137-230 tracer: set flag leadership.set.cluster-instance-configured-252-17-186-134 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 00:28:54 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-10-31 00:28:54 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:28:54 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-10-31 00:28:54 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Found peers: 252.17.134.150,252.17.186.134 2024-10-31 00:28:54 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Expect 2 peers 2024-10-31 00:28:54 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Reached quorum 2024-10-31 00:28:54 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:28:54 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-10-31 00:28:54 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-10-31 00:28:54 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-10-31 00:28:54 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router 2024-10-31 00:28:54 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:28:54 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Running _assess_status() 2024-10-31 00:28:55 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-10-31 00:28:55 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 active 2024-10-31 00:28:55 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Opening db connection for root@localhost 2024-10-31 00:28:55 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Checking cluster status. 2024-10-31 00:28:56 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Opening db connection for root@None 2024-10-31 00:28:56 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator.DelayedActionCoordinator Publishing state 2024-10-31 00:28:57 INFO juju.worker.uniter.operation runhook.go:159 ran "leader-settings-changed" hook (via explicit, bespoke hook script) 2024-10-31 00:28:57 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run leader-settings-changed hook" for mysql-innodb-cluster/2 2024-10-31 00:28:57 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 00:28:57 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run leader-settings-changed hook) 2024-10-31 00:28:57 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 00:28:57 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 00:28:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 00:28:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 00:28:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 00:28:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 00:28:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-10-31 00:28:57 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 2024-10-31 00:28:57 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 00:28:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-10-31 00:28:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 00:28:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 00:28:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 00:28:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 00:29:30 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for mysql-innodb-cluster/2 : {43 {map[dashboard-mysql-router/0:{0}] map[] []}} 2024-10-31 00:29:30 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 00:29:30 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 00:29:30 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 00:29:30 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-joined (43; unit: dashboard-mysql-router/0) hook for mysql-innodb-cluster/2 2024-10-31 00:29:30 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run relation-joined (43; unit: dashboard-mysql-router/0) hook) 2024-10-31 00:29:30 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run relation-joined (43; unit: dashboard-mysql-router/0) hook) 2024-10-31 00:29:30 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-joined (43; unit: dashboard-mysql-router/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:29:30 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-joined (43; unit: dashboard-mysql-router/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:29:30 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running db-router-relation-joined hook for dashboard-mysql-router/0 2024-10-31 00:29:30 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 00:29:31 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Reactive main running for hook db-router-relation-joined 2024-10-31 00:29:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:29:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.ssl_cert 2024-10-31 00:29:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.ssl_key 2024-10-31 00:29:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.ssl_ca 2024-10-31 00:29:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.set.source 2024-10-31 00:29:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.source 2024-10-31 00:29:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.set.cluster-name 2024-10-31 00:29:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.cluster-name 2024-10-31 00:29:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.set.auto-rejoin-tries 2024-10-31 00:29:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.auto-rejoin-tries 2024-10-31 00:29:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.set.expel-timeout 2024-10-31 00:29:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.expel-timeout 2024-10-31 00:29:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.set.innodb-buffer-pool-size 2024-10-31 00:29:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.set.innodb-change-buffering 2024-10-31 00:29:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.innodb-change-buffering 2024-10-31 00:29:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.set.innodb-io-capacity 2024-10-31 00:29:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.innodb-io-capacity 2024-10-31 00:29:33 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.set.innodb-file-per-table 2024-10-31 00:29:33 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.innodb-file-per-table 2024-10-31 00:29:33 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.set.tuning-level 2024-10-31 00:29:33 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.tuning-level 2024-10-31 00:29:33 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.set.table-open-cache 2024-10-31 00:29:33 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.table-open-cache 2024-10-31 00:29:33 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.set.max-connections 2024-10-31 00:29:33 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.enable-binlogs 2024-10-31 00:29:33 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.set.binlogs-path 2024-10-31 00:29:33 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.binlogs-path 2024-10-31 00:29:33 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.set.binlogs-max-size 2024-10-31 00:29:33 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.binlogs-max-size 2024-10-31 00:29:33 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.set.binlogs-expire-days 2024-10-31 00:29:33 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.binlogs-expire-days 2024-10-31 00:29:33 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.prefer-ipv6 2024-10-31 00:29:33 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.set.wait-timeout 2024-10-31 00:29:33 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.wait-timeout 2024-10-31 00:29:33 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.os-db-router-hostname 2024-10-31 00:29:33 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Initializing Snap Layer 2024-10-31 00:29:34 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: coordinator.DelayedActionCoordinator Loading state 2024-10-31 00:29:34 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Coordinator: Initializing coordinator layer 2024-10-31 00:29:34 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Initializing Leadership Layer (is follower) 2024-10-31 00:29:34 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer> tracer: starting handler dispatch, 76 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-17-134-150 tracer: set flag leadership.set.cluster-instance-clustered-252-17-137-230 tracer: set flag leadership.set.cluster-instance-clustered-252-17-186-134 tracer: set flag leadership.set.cluster-instance-configured-252-17-134-150 tracer: set flag leadership.set.cluster-instance-configured-252-17-137-230 tracer: set flag leadership.set.cluster-instance-configured-252-17-186-134 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 00:29:34 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: hooks phase, 0 handlers queued 2024-10-31 00:29:34 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:29:34 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-10-31 00:29:34 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Found peers: 252.17.134.150,252.17.186.134 2024-10-31 00:29:34 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Expect 2 peers 2024-10-31 00:29:34 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Reached quorum 2024-10-31 00:29:34 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:29:34 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-10-31 00:29:34 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-10-31 00:29:34 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-10-31 00:29:34 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router 2024-10-31 00:29:34 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:29:34 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Running _assess_status() 2024-10-31 00:29:35 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-10-31 00:29:35 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-joined logger.go:60 active 2024-10-31 00:29:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Opening db connection for root@localhost 2024-10-31 00:29:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Checking cluster status. 2024-10-31 00:29:37 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Opening db connection for root@None 2024-10-31 00:29:37 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: coordinator.DelayedActionCoordinator Publishing state 2024-10-31 00:29:38 INFO juju.worker.uniter.operation runhook.go:159 ran "db-router-relation-joined" hook (via explicit, bespoke hook script) 2024-10-31 00:29:38 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-joined (43; unit: dashboard-mysql-router/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:29:38 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 00:29:38 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run relation-joined (43; unit: dashboard-mysql-router/0) hook) 2024-10-31 00:29:38 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 00:29:38 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 00:29:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 00:29:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 00:29:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 00:29:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 00:29:38 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (43; unit: dashboard-mysql-router/0) hook for mysql-innodb-cluster/2 2024-10-31 00:29:38 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run relation-changed (43; unit: dashboard-mysql-router/0) hook) 2024-10-31 00:29:38 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run relation-changed (43; unit: dashboard-mysql-router/0) hook) 2024-10-31 00:29:38 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (43; unit: dashboard-mysql-router/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:29:38 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (43; unit: dashboard-mysql-router/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:29:38 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running db-router-relation-changed hook for dashboard-mysql-router/0 2024-10-31 00:29:38 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 00:29:39 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Reactive main running for hook db-router-relation-changed 2024-10-31 00:29:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:29:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.ssl_cert 2024-10-31 00:29:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.ssl_key 2024-10-31 00:29:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.ssl_ca 2024-10-31 00:29:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.set.source 2024-10-31 00:29:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.source 2024-10-31 00:29:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.set.cluster-name 2024-10-31 00:29:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.cluster-name 2024-10-31 00:29:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.set.auto-rejoin-tries 2024-10-31 00:29:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.auto-rejoin-tries 2024-10-31 00:29:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.set.expel-timeout 2024-10-31 00:29:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.expel-timeout 2024-10-31 00:29:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.set.innodb-buffer-pool-size 2024-10-31 00:29:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.set.innodb-change-buffering 2024-10-31 00:29:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.innodb-change-buffering 2024-10-31 00:29:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.set.innodb-io-capacity 2024-10-31 00:29:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.innodb-io-capacity 2024-10-31 00:29:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.set.innodb-file-per-table 2024-10-31 00:29:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.innodb-file-per-table 2024-10-31 00:29:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.set.tuning-level 2024-10-31 00:29:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.tuning-level 2024-10-31 00:29:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.set.table-open-cache 2024-10-31 00:29:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.table-open-cache 2024-10-31 00:29:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.set.max-connections 2024-10-31 00:29:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.enable-binlogs 2024-10-31 00:29:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.set.binlogs-path 2024-10-31 00:29:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.binlogs-path 2024-10-31 00:29:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.set.binlogs-max-size 2024-10-31 00:29:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.binlogs-max-size 2024-10-31 00:29:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.set.binlogs-expire-days 2024-10-31 00:29:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.binlogs-expire-days 2024-10-31 00:29:41 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.prefer-ipv6 2024-10-31 00:29:41 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.set.wait-timeout 2024-10-31 00:29:41 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.wait-timeout 2024-10-31 00:29:41 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.os-db-router-hostname 2024-10-31 00:29:41 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Initializing Snap Layer 2024-10-31 00:29:41 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: coordinator.DelayedActionCoordinator Loading state 2024-10-31 00:29:41 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Coordinator: Initializing coordinator layer 2024-10-31 00:29:41 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Initializing Leadership Layer (is follower) 2024-10-31 00:29:41 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer> tracer: starting handler dispatch, 76 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-17-134-150 tracer: set flag leadership.set.cluster-instance-clustered-252-17-137-230 tracer: set flag leadership.set.cluster-instance-clustered-252-17-186-134 tracer: set flag leadership.set.cluster-instance-configured-252-17-134-150 tracer: set flag leadership.set.cluster-instance-configured-252-17-137-230 tracer: set flag leadership.set.cluster-instance-configured-252-17-186-134 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 00:29:41 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: hooks phase, 0 handlers queued 2024-10-31 00:29:41 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:29:41 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-10-31 00:29:41 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Found peers: 252.17.134.150,252.17.186.134 2024-10-31 00:29:41 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Expect 2 peers 2024-10-31 00:29:41 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Reached quorum 2024-10-31 00:29:41 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:29:41 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-10-31 00:29:41 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-10-31 00:29:41 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-10-31 00:29:41 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router 2024-10-31 00:29:41 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:29:41 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Running _assess_status() 2024-10-31 00:29:42 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-10-31 00:29:42 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-changed logger.go:60 active 2024-10-31 00:29:42 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Opening db connection for root@localhost 2024-10-31 00:29:42 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Checking cluster status. 2024-10-31 00:29:43 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Opening db connection for root@None 2024-10-31 00:29:44 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: coordinator.DelayedActionCoordinator Publishing state 2024-10-31 00:29:44 INFO juju.worker.uniter.operation runhook.go:159 ran "db-router-relation-changed" hook (via explicit, bespoke hook script) 2024-10-31 00:29:44 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (43; unit: dashboard-mysql-router/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:29:44 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 00:29:44 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run relation-changed (43; unit: dashboard-mysql-router/0) hook) 2024-10-31 00:29:44 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 00:29:44 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 00:29:44 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-10-31 00:29:44 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-10-31 00:29:44 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 00:29:44 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 00:29:44 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 00:29:44 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 00:29:44 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 2024-10-31 00:30:03 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for mysql-innodb-cluster/2 : {35 {map[keystone-mysql-router/0:{1}] map[] []}} 2024-10-31 00:30:03 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 00:30:03 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 00:30:03 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 00:30:03 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-10-31 00:30:03 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (35; unit: keystone-mysql-router/0) hook for mysql-innodb-cluster/2 2024-10-31 00:30:03 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run relation-changed (35; unit: keystone-mysql-router/0) hook) 2024-10-31 00:30:03 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run relation-changed (35; unit: keystone-mysql-router/0) hook) 2024-10-31 00:30:03 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (35; unit: keystone-mysql-router/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:30:03 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (35; unit: keystone-mysql-router/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:30:03 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running db-router-relation-changed hook for keystone-mysql-router/0 2024-10-31 00:30:04 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 00:30:04 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: Reactive main running for hook db-router-relation-changed 2024-10-31 00:30:05 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer> tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:30:05 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag endpoint.db-router.changed.mysqlrouter_username 2024-10-31 00:30:05 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.snapd_refresh 2024-10-31 00:30:05 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.ssl_cert 2024-10-31 00:30:05 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.ssl_key 2024-10-31 00:30:05 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.ssl_ca 2024-10-31 00:30:06 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.set.source 2024-10-31 00:30:06 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.source 2024-10-31 00:30:06 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.set.cluster-name 2024-10-31 00:30:06 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.cluster-name 2024-10-31 00:30:06 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.set.auto-rejoin-tries 2024-10-31 00:30:06 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.auto-rejoin-tries 2024-10-31 00:30:06 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.set.expel-timeout 2024-10-31 00:30:06 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.expel-timeout 2024-10-31 00:30:06 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.set.innodb-buffer-pool-size 2024-10-31 00:30:06 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.set.innodb-change-buffering 2024-10-31 00:30:06 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.innodb-change-buffering 2024-10-31 00:30:06 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.set.innodb-io-capacity 2024-10-31 00:30:06 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.innodb-io-capacity 2024-10-31 00:30:06 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.set.innodb-file-per-table 2024-10-31 00:30:06 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.innodb-file-per-table 2024-10-31 00:30:06 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.set.tuning-level 2024-10-31 00:30:06 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.tuning-level 2024-10-31 00:30:06 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.set.table-open-cache 2024-10-31 00:30:06 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.table-open-cache 2024-10-31 00:30:07 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.set.max-connections 2024-10-31 00:30:07 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.enable-binlogs 2024-10-31 00:30:07 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.set.binlogs-path 2024-10-31 00:30:07 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.binlogs-path 2024-10-31 00:30:07 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.set.binlogs-max-size 2024-10-31 00:30:07 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.binlogs-max-size 2024-10-31 00:30:07 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.set.binlogs-expire-days 2024-10-31 00:30:07 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.binlogs-expire-days 2024-10-31 00:30:07 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.prefer-ipv6 2024-10-31 00:30:07 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.set.wait-timeout 2024-10-31 00:30:07 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.wait-timeout 2024-10-31 00:30:07 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.os-db-router-hostname 2024-10-31 00:30:07 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: Initializing Snap Layer 2024-10-31 00:30:08 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: coordinator.DelayedActionCoordinator Loading state 2024-10-31 00:30:08 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: Coordinator: Initializing coordinator layer 2024-10-31 00:30:08 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: Initializing Leadership Layer (is follower) 2024-10-31 00:30:08 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer> tracer: starting handler dispatch, 78 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-17-134-150 tracer: set flag leadership.set.cluster-instance-clustered-252-17-137-230 tracer: set flag leadership.set.cluster-instance-clustered-252-17-186-134 tracer: set flag leadership.set.cluster-instance-configured-252-17-134-150 tracer: set flag leadership.set.cluster-instance-configured-252-17-137-230 tracer: set flag leadership.set.cluster-instance-configured-252-17-186-134 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 00:30:08 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: hooks phase, 0 handlers queued 2024-10-31 00:30:08 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:30:08 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-10-31 00:30:08 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: Found peers: 252.17.134.150,252.17.186.134 2024-10-31 00:30:08 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: Expect 2 peers 2024-10-31 00:30:08 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: Reached quorum 2024-10-31 00:30:08 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:30:08 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-10-31 00:30:08 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-10-31 00:30:08 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-10-31 00:30:08 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag db-router.available 2024-10-31 00:30:08 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router 2024-10-31 00:30:08 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:30:08 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: Running _assess_status() 2024-10-31 00:30:09 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-10-31 00:30:09 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-changed logger.go:60 active 2024-10-31 00:30:09 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: Opening db connection for root@localhost 2024-10-31 00:30:09 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: Checking cluster status. 2024-10-31 00:30:11 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: Opening db connection for root@None 2024-10-31 00:30:11 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: coordinator.DelayedActionCoordinator Publishing state 2024-10-31 00:30:12 INFO juju.worker.uniter.operation runhook.go:159 ran "db-router-relation-changed" hook (via explicit, bespoke hook script) 2024-10-31 00:30:12 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (35; unit: keystone-mysql-router/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:30:12 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 00:30:12 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run relation-changed (35; unit: keystone-mysql-router/0) hook) 2024-10-31 00:30:12 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 00:30:12 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 00:30:12 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-10-31 00:30:12 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 00:30:12 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 00:30:12 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-10-31 00:30:12 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 00:30:12 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 00:30:12 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 2024-10-31 00:30:12 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for mysql-innodb-cluster/2: ok=true 2024-10-31 00:30:12 DEBUG juju.worker.uniter.operation executor.go:85 running operation run leader-settings-changed hook for mysql-innodb-cluster/2 2024-10-31 00:30:12 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run leader-settings-changed hook) 2024-10-31 00:30:12 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run leader-settings-changed hook) 2024-10-31 00:30:12 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run leader-settings-changed hook" for mysql-innodb-cluster/2 2024-10-31 00:30:12 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run leader-settings-changed hook" for mysql-innodb-cluster/2 2024-10-31 00:30:12 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running leader-settings-changed hook 2024-10-31 00:30:13 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 00:30:13 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Reactive main running for hook leader-settings-changed 2024-10-31 00:30:14 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Initializing Snap Layer 2024-10-31 00:30:14 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator.DelayedActionCoordinator Loading state 2024-10-31 00:30:14 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Coordinator: Initializing coordinator layer 2024-10-31 00:30:14 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Initializing Leadership Layer (is follower) 2024-10-31 00:30:14 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: set flag leadership.changed.mysql-mysqlrouteruser.passwd tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:30:15 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd 2024-10-31 00:30:15 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag leadership.changed 2024-10-31 00:30:15 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: starting handler dispatch, 47 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.connected tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.changed tracer: set flag leadership.changed.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-17-134-150 tracer: set flag leadership.set.cluster-instance-clustered-252-17-137-230 tracer: set flag leadership.set.cluster-instance-clustered-252-17-186-134 tracer: set flag leadership.set.cluster-instance-configured-252-17-134-150 tracer: set flag leadership.set.cluster-instance-configured-252-17-137-230 tracer: set flag leadership.set.cluster-instance-configured-252-17-186-134 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 00:30:15 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-10-31 00:30:15 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:30:15 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-10-31 00:30:15 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Found peers: 252.17.134.150,252.17.186.134 2024-10-31 00:30:15 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Expect 2 peers 2024-10-31 00:30:15 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Reached quorum 2024-10-31 00:30:15 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:30:15 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-10-31 00:30:15 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-10-31 00:30:15 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-10-31 00:30:15 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router 2024-10-31 00:30:15 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:30:15 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Running _assess_status() 2024-10-31 00:30:16 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-10-31 00:30:16 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 active 2024-10-31 00:30:16 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Opening db connection for root@localhost 2024-10-31 00:30:16 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Checking cluster status. 2024-10-31 00:30:17 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Opening db connection for root@None 2024-10-31 00:30:17 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator.DelayedActionCoordinator Publishing state 2024-10-31 00:30:18 INFO juju.worker.uniter.operation runhook.go:159 ran "leader-settings-changed" hook (via explicit, bespoke hook script) 2024-10-31 00:30:18 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run leader-settings-changed hook" for mysql-innodb-cluster/2 2024-10-31 00:30:18 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 00:30:18 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run leader-settings-changed hook) 2024-10-31 00:30:18 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 00:30:18 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 00:30:18 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 00:30:18 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 00:30:18 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-10-31 00:30:18 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-10-31 00:30:18 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 00:30:18 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 00:30:18 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 2024-10-31 00:30:18 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for mysql-innodb-cluster/2 : {43 {map[dashboard-mysql-router/0:{1}] map[] []}} 2024-10-31 00:30:18 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 00:30:18 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-10-31 00:30:18 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-10-31 00:30:18 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (43; unit: dashboard-mysql-router/0) hook for mysql-innodb-cluster/2 2024-10-31 00:30:18 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run relation-changed (43; unit: dashboard-mysql-router/0) hook) 2024-10-31 00:30:18 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run relation-changed (43; unit: dashboard-mysql-router/0) hook) 2024-10-31 00:30:18 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (43; unit: dashboard-mysql-router/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:30:18 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (43; unit: dashboard-mysql-router/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:30:18 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running db-router-relation-changed hook for dashboard-mysql-router/0 2024-10-31 00:30:19 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 00:30:19 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Reactive main running for hook db-router-relation-changed 2024-10-31 00:30:20 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:30:20 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.ssl_cert 2024-10-31 00:30:20 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.ssl_key 2024-10-31 00:30:20 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.ssl_ca 2024-10-31 00:30:20 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.set.source 2024-10-31 00:30:20 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.source 2024-10-31 00:30:20 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.set.cluster-name 2024-10-31 00:30:20 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.cluster-name 2024-10-31 00:30:20 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.set.auto-rejoin-tries 2024-10-31 00:30:20 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.auto-rejoin-tries 2024-10-31 00:30:20 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.set.expel-timeout 2024-10-31 00:30:20 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.expel-timeout 2024-10-31 00:30:20 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.set.innodb-buffer-pool-size 2024-10-31 00:30:21 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.set.innodb-change-buffering 2024-10-31 00:30:21 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.innodb-change-buffering 2024-10-31 00:30:21 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.set.innodb-io-capacity 2024-10-31 00:30:21 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.innodb-io-capacity 2024-10-31 00:30:21 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.set.innodb-file-per-table 2024-10-31 00:30:21 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.innodb-file-per-table 2024-10-31 00:30:21 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.set.tuning-level 2024-10-31 00:30:21 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.tuning-level 2024-10-31 00:30:21 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.set.table-open-cache 2024-10-31 00:30:21 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.table-open-cache 2024-10-31 00:30:21 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.set.max-connections 2024-10-31 00:30:21 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.enable-binlogs 2024-10-31 00:30:21 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.set.binlogs-path 2024-10-31 00:30:21 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.binlogs-path 2024-10-31 00:30:21 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.set.binlogs-max-size 2024-10-31 00:30:21 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.binlogs-max-size 2024-10-31 00:30:21 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.set.binlogs-expire-days 2024-10-31 00:30:21 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.binlogs-expire-days 2024-10-31 00:30:21 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.prefer-ipv6 2024-10-31 00:30:21 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.set.wait-timeout 2024-10-31 00:30:21 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.wait-timeout 2024-10-31 00:30:22 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.os-db-router-hostname 2024-10-31 00:30:22 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Initializing Snap Layer 2024-10-31 00:30:22 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: coordinator.DelayedActionCoordinator Loading state 2024-10-31 00:30:22 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Coordinator: Initializing coordinator layer 2024-10-31 00:30:22 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Initializing Leadership Layer (is follower) 2024-10-31 00:30:22 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: cleared flag leadership.changed.mysql-mysqlrouteruser.passwd 2024-10-31 00:30:22 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: cleared flag leadership.changed 2024-10-31 00:30:22 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer> tracer: starting handler dispatch, 80 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-17-134-150 tracer: set flag leadership.set.cluster-instance-clustered-252-17-137-230 tracer: set flag leadership.set.cluster-instance-clustered-252-17-186-134 tracer: set flag leadership.set.cluster-instance-configured-252-17-134-150 tracer: set flag leadership.set.cluster-instance-configured-252-17-137-230 tracer: set flag leadership.set.cluster-instance-configured-252-17-186-134 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 00:30:22 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: hooks phase, 0 handlers queued 2024-10-31 00:30:22 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:30:22 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-10-31 00:30:22 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Found peers: 252.17.134.150,252.17.186.134 2024-10-31 00:30:22 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Expect 2 peers 2024-10-31 00:30:22 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Reached quorum 2024-10-31 00:30:22 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:30:22 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-10-31 00:30:22 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-10-31 00:30:22 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-10-31 00:30:22 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router 2024-10-31 00:30:22 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:30:22 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Running _assess_status() 2024-10-31 00:30:23 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-10-31 00:30:23 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-changed logger.go:60 active 2024-10-31 00:30:23 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Opening db connection for root@localhost 2024-10-31 00:30:23 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Checking cluster status. 2024-10-31 00:30:25 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Opening db connection for root@None 2024-10-31 00:30:25 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: coordinator.DelayedActionCoordinator Publishing state 2024-10-31 00:30:26 INFO juju.worker.uniter.operation runhook.go:159 ran "db-router-relation-changed" hook (via explicit, bespoke hook script) 2024-10-31 00:30:26 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (43; unit: dashboard-mysql-router/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:30:26 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 00:30:26 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run relation-changed (43; unit: dashboard-mysql-router/0) hook) 2024-10-31 00:30:26 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 00:30:26 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 00:30:26 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 00:30:26 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 00:30:26 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-10-31 00:30:26 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-10-31 00:30:26 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 00:30:26 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 00:30:26 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 2024-10-31 00:30:38 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for mysql-innodb-cluster/2 : {43 {map[dashboard-mysql-router/0:{2}] map[] []}} 2024-10-31 00:30:38 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 00:30:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 00:30:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 00:30:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 00:30:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 00:30:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-10-31 00:30:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-10-31 00:30:38 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (43; unit: dashboard-mysql-router/0) hook for mysql-innodb-cluster/2 2024-10-31 00:30:38 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run relation-changed (43; unit: dashboard-mysql-router/0) hook) 2024-10-31 00:30:38 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run relation-changed (43; unit: dashboard-mysql-router/0) hook) 2024-10-31 00:30:38 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (43; unit: dashboard-mysql-router/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:30:38 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (43; unit: dashboard-mysql-router/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:30:38 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running db-router-relation-changed hook for dashboard-mysql-router/0 2024-10-31 00:30:38 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 00:30:39 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Reactive main running for hook db-router-relation-changed 2024-10-31 00:30:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer> tracer: set flag endpoint.db-router.changed.MRUP_database tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:30:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag endpoint.db-router.changed.MRUP_hostname 2024-10-31 00:30:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag endpoint.db-router.changed.MRUP_username 2024-10-31 00:30:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.snapd_refresh 2024-10-31 00:30:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.ssl_cert 2024-10-31 00:30:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.ssl_key 2024-10-31 00:30:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.ssl_ca 2024-10-31 00:30:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.set.source 2024-10-31 00:30:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.source 2024-10-31 00:30:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.set.cluster-name 2024-10-31 00:30:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.cluster-name 2024-10-31 00:30:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.set.auto-rejoin-tries 2024-10-31 00:30:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.auto-rejoin-tries 2024-10-31 00:30:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.set.expel-timeout 2024-10-31 00:30:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.expel-timeout 2024-10-31 00:30:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.set.innodb-buffer-pool-size 2024-10-31 00:30:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.set.innodb-change-buffering 2024-10-31 00:30:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.innodb-change-buffering 2024-10-31 00:30:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.set.innodb-io-capacity 2024-10-31 00:30:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.innodb-io-capacity 2024-10-31 00:30:41 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.set.innodb-file-per-table 2024-10-31 00:30:41 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.innodb-file-per-table 2024-10-31 00:30:41 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.set.tuning-level 2024-10-31 00:30:41 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.tuning-level 2024-10-31 00:30:41 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.set.table-open-cache 2024-10-31 00:30:41 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.table-open-cache 2024-10-31 00:30:41 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.set.max-connections 2024-10-31 00:30:41 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.enable-binlogs 2024-10-31 00:30:41 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.set.binlogs-path 2024-10-31 00:30:41 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.binlogs-path 2024-10-31 00:30:41 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.set.binlogs-max-size 2024-10-31 00:30:41 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.binlogs-max-size 2024-10-31 00:30:41 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.set.binlogs-expire-days 2024-10-31 00:30:41 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.binlogs-expire-days 2024-10-31 00:30:41 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.prefer-ipv6 2024-10-31 00:30:41 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.set.wait-timeout 2024-10-31 00:30:41 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.wait-timeout 2024-10-31 00:30:41 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: set flag config.default.os-db-router-hostname 2024-10-31 00:30:41 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Initializing Snap Layer 2024-10-31 00:30:42 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: coordinator.DelayedActionCoordinator Loading state 2024-10-31 00:30:42 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Coordinator: Initializing coordinator layer 2024-10-31 00:30:42 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Initializing Leadership Layer (is follower) 2024-10-31 00:30:42 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer> tracer: starting handler dispatch, 83 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-17-134-150 tracer: set flag leadership.set.cluster-instance-clustered-252-17-137-230 tracer: set flag leadership.set.cluster-instance-clustered-252-17-186-134 tracer: set flag leadership.set.cluster-instance-configured-252-17-134-150 tracer: set flag leadership.set.cluster-instance-configured-252-17-137-230 tracer: set flag leadership.set.cluster-instance-configured-252-17-186-134 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 00:30:42 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer: hooks phase, 0 handlers queued 2024-10-31 00:30:42 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:30:42 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-10-31 00:30:42 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Found peers: 252.17.134.150,252.17.186.134 2024-10-31 00:30:42 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Expect 2 peers 2024-10-31 00:30:42 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Reached quorum 2024-10-31 00:30:42 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:30:42 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-10-31 00:30:42 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-10-31 00:30:42 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-10-31 00:30:42 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router 2024-10-31 00:30:42 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:30:42 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Running _assess_status() 2024-10-31 00:30:43 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-10-31 00:30:43 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-changed logger.go:60 active 2024-10-31 00:30:43 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Opening db connection for root@localhost 2024-10-31 00:30:43 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Checking cluster status. 2024-10-31 00:30:44 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: Opening db connection for root@None 2024-10-31 00:30:44 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:43: coordinator.DelayedActionCoordinator Publishing state 2024-10-31 00:30:45 INFO juju.worker.uniter.operation runhook.go:159 ran "db-router-relation-changed" hook (via explicit, bespoke hook script) 2024-10-31 00:30:45 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (43; unit: dashboard-mysql-router/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:30:45 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 00:30:45 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run relation-changed (43; unit: dashboard-mysql-router/0) hook) 2024-10-31 00:30:45 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 00:30:45 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 00:30:45 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 00:30:45 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 00:30:45 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-10-31 00:30:45 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 00:30:45 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 00:30:45 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-10-31 00:30:45 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 2024-10-31 00:30:45 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for mysql-innodb-cluster/2: ok=true 2024-10-31 00:30:45 DEBUG juju.worker.uniter.operation executor.go:85 running operation run leader-settings-changed hook for mysql-innodb-cluster/2 2024-10-31 00:30:45 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run leader-settings-changed hook) 2024-10-31 00:30:45 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run leader-settings-changed hook) 2024-10-31 00:30:45 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run leader-settings-changed hook" for mysql-innodb-cluster/2 2024-10-31 00:30:45 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run leader-settings-changed hook" for mysql-innodb-cluster/2 2024-10-31 00:30:45 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running leader-settings-changed hook 2024-10-31 00:30:45 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 00:30:46 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Reactive main running for hook leader-settings-changed 2024-10-31 00:30:46 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Initializing Snap Layer 2024-10-31 00:30:47 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator.DelayedActionCoordinator Loading state 2024-10-31 00:30:47 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Coordinator: Initializing coordinator layer 2024-10-31 00:30:47 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Initializing Leadership Layer (is follower) 2024-10-31 00:30:47 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: set flag leadership.changed.mysql-horizon.passwd tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:30:47 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag leadership.set.mysql-horizon.passwd 2024-10-31 00:30:47 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag leadership.changed 2024-10-31 00:30:47 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: starting handler dispatch, 51 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.connected tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.changed tracer: set flag leadership.changed.mysql-horizon.passwd tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-17-134-150 tracer: set flag leadership.set.cluster-instance-clustered-252-17-137-230 tracer: set flag leadership.set.cluster-instance-clustered-252-17-186-134 tracer: set flag leadership.set.cluster-instance-configured-252-17-134-150 tracer: set flag leadership.set.cluster-instance-configured-252-17-137-230 tracer: set flag leadership.set.cluster-instance-configured-252-17-186-134 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 00:30:47 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-10-31 00:30:47 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:30:47 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-10-31 00:30:47 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Found peers: 252.17.134.150,252.17.186.134 2024-10-31 00:30:47 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Expect 2 peers 2024-10-31 00:30:47 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Reached quorum 2024-10-31 00:30:47 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:30:47 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-10-31 00:30:47 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-10-31 00:30:47 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-10-31 00:30:47 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router 2024-10-31 00:30:47 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for mysql-innodb-cluster/2 2024-10-31 00:30:47 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:30:47 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Running _assess_status() 2024-10-31 00:30:48 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-10-31 00:30:48 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 active 2024-10-31 00:30:48 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Opening db connection for root@localhost 2024-10-31 00:30:48 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Checking cluster status. 2024-10-31 00:30:50 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Opening db connection for root@None 2024-10-31 00:30:50 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator.DelayedActionCoordinator Publishing state 2024-10-31 00:30:50 INFO juju.worker.uniter.operation runhook.go:159 ran "leader-settings-changed" hook (via explicit, bespoke hook script) 2024-10-31 00:30:50 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run leader-settings-changed hook" for mysql-innodb-cluster/2 2024-10-31 00:30:50 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 00:30:50 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run leader-settings-changed hook) 2024-10-31 00:30:50 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 00:30:50 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 00:30:50 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 00:30:50 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 00:30:50 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-10-31 00:30:50 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-10-31 00:30:50 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 00:30:50 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 00:30:50 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for mysql-innodb-cluster/2 2024-10-31 00:30:50 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run update-status hook) 2024-10-31 00:30:50 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run update-status hook) 2024-10-31 00:30:50 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for mysql-innodb-cluster/2 2024-10-31 00:30:51 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for mysql-innodb-cluster/2 2024-10-31 00:30:51 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 00:30:51 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Reactive main running for hook update-status 2024-10-31 00:30:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:30:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.ssl_cert 2024-10-31 00:30:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.ssl_key 2024-10-31 00:30:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.ssl_ca 2024-10-31 00:30:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.source 2024-10-31 00:30:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.source 2024-10-31 00:30:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.cluster-name 2024-10-31 00:30:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.cluster-name 2024-10-31 00:30:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.auto-rejoin-tries 2024-10-31 00:30:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.auto-rejoin-tries 2024-10-31 00:30:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.expel-timeout 2024-10-31 00:30:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.expel-timeout 2024-10-31 00:30:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-buffer-pool-size 2024-10-31 00:30:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-change-buffering 2024-10-31 00:30:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.innodb-change-buffering 2024-10-31 00:30:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-io-capacity 2024-10-31 00:30:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.innodb-io-capacity 2024-10-31 00:30:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-file-per-table 2024-10-31 00:30:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.innodb-file-per-table 2024-10-31 00:30:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.tuning-level 2024-10-31 00:30:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.tuning-level 2024-10-31 00:30:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.table-open-cache 2024-10-31 00:30:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.table-open-cache 2024-10-31 00:30:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.max-connections 2024-10-31 00:30:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.enable-binlogs 2024-10-31 00:30:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.binlogs-path 2024-10-31 00:30:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.binlogs-path 2024-10-31 00:30:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.binlogs-max-size 2024-10-31 00:30:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.binlogs-max-size 2024-10-31 00:30:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.binlogs-expire-days 2024-10-31 00:30:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.binlogs-expire-days 2024-10-31 00:30:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.prefer-ipv6 2024-10-31 00:30:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.wait-timeout 2024-10-31 00:30:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.wait-timeout 2024-10-31 00:30:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.os-db-router-hostname 2024-10-31 00:30:53 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Initializing Snap Layer 2024-10-31 00:30:53 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator.DelayedActionCoordinator Loading state 2024-10-31 00:30:53 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Coordinator: Initializing coordinator layer 2024-10-31 00:30:53 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Initializing Leadership Layer (is follower) 2024-10-31 00:30:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: cleared flag leadership.changed.mysql-horizon.passwd 2024-10-31 00:30:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: cleared flag leadership.changed 2024-10-31 00:30:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: starting handler dispatch, 84 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-17-134-150 tracer: set flag leadership.set.cluster-instance-clustered-252-17-137-230 tracer: set flag leadership.set.cluster-instance-clustered-252-17-186-134 tracer: set flag leadership.set.cluster-instance-configured-252-17-134-150 tracer: set flag leadership.set.cluster-instance-configured-252-17-137-230 tracer: set flag leadership.set.cluster-instance-configured-252-17-186-134 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 00:30:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:64:default_update_status 2024-10-31 00:30:53 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:64:default_update_status 2024-10-31 00:30:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag run-default-update-status 2024-10-31 00:30:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag is-update-status-hook 2024-10-31 00:30:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: main dispatch loop, 9 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:82:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:93:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:30:53 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:82:check_really_is_update_status 2024-10-31 00:30:53 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:93:run_default_update_status 2024-10-31 00:30:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:93:run_default_update_status 2024-10-31 00:30:53 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-10-31 00:30:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Found peers: 252.17.134.150,252.17.186.134 2024-10-31 00:30:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Expect 2 peers 2024-10-31 00:30:54 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Reached quorum 2024-10-31 00:30:54 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:30:54 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-10-31 00:30:54 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-10-31 00:30:54 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-10-31 00:30:54 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router 2024-10-31 00:30:54 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:30:54 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Running _assess_status() 2024-10-31 00:30:54 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-10-31 00:30:54 DEBUG unit.mysql-innodb-cluster/2.update-status logger.go:60 active 2024-10-31 00:30:54 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Opening db connection for root@localhost 2024-10-31 00:30:54 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Checking cluster status. 2024-10-31 00:30:55 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Opening db connection for root@None 2024-10-31 00:30:56 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:30:56 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator.DelayedActionCoordinator Publishing state 2024-10-31 00:30:56 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-10-31 00:30:56 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for mysql-innodb-cluster/2 2024-10-31 00:30:56 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 00:30:56 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run update-status hook) 2024-10-31 00:30:56 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 00:30:56 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 00:30:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 00:30:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 00:30:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-10-31 00:30:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-10-31 00:30:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 00:30:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 00:30:56 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 2024-10-31 00:30:56 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 00:30:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-10-31 00:30:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-10-31 00:30:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 00:30:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 00:30:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 00:30:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 00:31:19 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for mysql-innodb-cluster/2 : {37 {map[glance-mysql-router/0:{0}] map[] []}} 2024-10-31 00:31:19 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 00:31:19 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 00:31:19 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 00:31:19 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-joined (37; unit: glance-mysql-router/0) hook for mysql-innodb-cluster/2 2024-10-31 00:31:19 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run relation-joined (37; unit: glance-mysql-router/0) hook) 2024-10-31 00:31:19 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run relation-joined (37; unit: glance-mysql-router/0) hook) 2024-10-31 00:31:19 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-joined (37; unit: glance-mysql-router/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:31:19 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-joined (37; unit: glance-mysql-router/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:31:19 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running db-router-relation-joined hook for glance-mysql-router/0 2024-10-31 00:31:19 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 00:31:20 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: Reactive main running for hook db-router-relation-joined 2024-10-31 00:31:21 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:31:21 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.ssl_cert 2024-10-31 00:31:21 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.ssl_key 2024-10-31 00:31:21 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.ssl_ca 2024-10-31 00:31:21 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.set.source 2024-10-31 00:31:21 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.source 2024-10-31 00:31:21 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.set.cluster-name 2024-10-31 00:31:21 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.cluster-name 2024-10-31 00:31:21 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.set.auto-rejoin-tries 2024-10-31 00:31:21 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.auto-rejoin-tries 2024-10-31 00:31:21 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.set.expel-timeout 2024-10-31 00:31:21 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.expel-timeout 2024-10-31 00:31:21 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.set.innodb-buffer-pool-size 2024-10-31 00:31:21 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.set.innodb-change-buffering 2024-10-31 00:31:21 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.innodb-change-buffering 2024-10-31 00:31:21 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.set.innodb-io-capacity 2024-10-31 00:31:21 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.innodb-io-capacity 2024-10-31 00:31:21 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.set.innodb-file-per-table 2024-10-31 00:31:21 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.innodb-file-per-table 2024-10-31 00:31:21 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.set.tuning-level 2024-10-31 00:31:21 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.tuning-level 2024-10-31 00:31:21 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.set.table-open-cache 2024-10-31 00:31:21 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.table-open-cache 2024-10-31 00:31:21 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.set.max-connections 2024-10-31 00:31:22 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.enable-binlogs 2024-10-31 00:31:22 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.set.binlogs-path 2024-10-31 00:31:22 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.binlogs-path 2024-10-31 00:31:22 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.set.binlogs-max-size 2024-10-31 00:31:22 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.binlogs-max-size 2024-10-31 00:31:22 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.set.binlogs-expire-days 2024-10-31 00:31:22 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.binlogs-expire-days 2024-10-31 00:31:22 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.prefer-ipv6 2024-10-31 00:31:22 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.set.wait-timeout 2024-10-31 00:31:22 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.wait-timeout 2024-10-31 00:31:22 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.os-db-router-hostname 2024-10-31 00:31:22 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: Initializing Snap Layer 2024-10-31 00:31:22 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: coordinator.DelayedActionCoordinator Loading state 2024-10-31 00:31:22 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: Coordinator: Initializing coordinator layer 2024-10-31 00:31:22 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: Initializing Leadership Layer (is follower) 2024-10-31 00:31:23 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer> tracer: starting handler dispatch, 84 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-17-134-150 tracer: set flag leadership.set.cluster-instance-clustered-252-17-137-230 tracer: set flag leadership.set.cluster-instance-clustered-252-17-186-134 tracer: set flag leadership.set.cluster-instance-configured-252-17-134-150 tracer: set flag leadership.set.cluster-instance-configured-252-17-137-230 tracer: set flag leadership.set.cluster-instance-configured-252-17-186-134 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 00:31:23 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: hooks phase, 0 handlers queued 2024-10-31 00:31:23 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:31:23 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-10-31 00:31:23 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: Found peers: 252.17.134.150,252.17.186.134 2024-10-31 00:31:23 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: Expect 2 peers 2024-10-31 00:31:23 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: Reached quorum 2024-10-31 00:31:23 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:31:23 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-10-31 00:31:23 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-10-31 00:31:23 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-10-31 00:31:23 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router 2024-10-31 00:31:23 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:31:23 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: Running _assess_status() 2024-10-31 00:31:24 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-10-31 00:31:24 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-joined logger.go:60 active 2024-10-31 00:31:24 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: Opening db connection for root@localhost 2024-10-31 00:31:24 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: Checking cluster status. 2024-10-31 00:31:25 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: Opening db connection for root@None 2024-10-31 00:31:25 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: coordinator.DelayedActionCoordinator Publishing state 2024-10-31 00:31:26 INFO juju.worker.uniter.operation runhook.go:159 ran "db-router-relation-joined" hook (via explicit, bespoke hook script) 2024-10-31 00:31:26 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-joined (37; unit: glance-mysql-router/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:31:26 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 00:31:26 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run relation-joined (37; unit: glance-mysql-router/0) hook) 2024-10-31 00:31:26 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 00:31:26 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 00:31:26 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-10-31 00:31:26 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 00:31:26 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 00:31:26 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 00:31:26 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 00:31:26 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-10-31 00:31:26 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (37; unit: glance-mysql-router/0) hook for mysql-innodb-cluster/2 2024-10-31 00:31:26 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run relation-changed (37; unit: glance-mysql-router/0) hook) 2024-10-31 00:31:26 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run relation-changed (37; unit: glance-mysql-router/0) hook) 2024-10-31 00:31:26 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (37; unit: glance-mysql-router/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:31:26 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (37; unit: glance-mysql-router/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:31:26 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running db-router-relation-changed hook for glance-mysql-router/0 2024-10-31 00:31:26 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 00:31:27 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: Reactive main running for hook db-router-relation-changed 2024-10-31 00:31:27 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:31:27 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.ssl_cert 2024-10-31 00:31:27 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.ssl_key 2024-10-31 00:31:27 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.ssl_ca 2024-10-31 00:31:27 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.set.source 2024-10-31 00:31:27 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.source 2024-10-31 00:31:27 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.set.cluster-name 2024-10-31 00:31:28 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.cluster-name 2024-10-31 00:31:28 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.set.auto-rejoin-tries 2024-10-31 00:31:28 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.auto-rejoin-tries 2024-10-31 00:31:28 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.set.expel-timeout 2024-10-31 00:31:28 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.expel-timeout 2024-10-31 00:31:28 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.set.innodb-buffer-pool-size 2024-10-31 00:31:28 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.set.innodb-change-buffering 2024-10-31 00:31:28 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.innodb-change-buffering 2024-10-31 00:31:28 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.set.innodb-io-capacity 2024-10-31 00:31:28 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.innodb-io-capacity 2024-10-31 00:31:28 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.set.innodb-file-per-table 2024-10-31 00:31:28 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.innodb-file-per-table 2024-10-31 00:31:28 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.set.tuning-level 2024-10-31 00:31:28 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.tuning-level 2024-10-31 00:31:28 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.set.table-open-cache 2024-10-31 00:31:28 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.table-open-cache 2024-10-31 00:31:28 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.set.max-connections 2024-10-31 00:31:28 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.enable-binlogs 2024-10-31 00:31:28 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.set.binlogs-path 2024-10-31 00:31:28 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.binlogs-path 2024-10-31 00:31:28 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.set.binlogs-max-size 2024-10-31 00:31:28 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.binlogs-max-size 2024-10-31 00:31:28 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.set.binlogs-expire-days 2024-10-31 00:31:28 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.binlogs-expire-days 2024-10-31 00:31:29 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.prefer-ipv6 2024-10-31 00:31:29 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.set.wait-timeout 2024-10-31 00:31:29 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.wait-timeout 2024-10-31 00:31:29 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.os-db-router-hostname 2024-10-31 00:31:29 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: Initializing Snap Layer 2024-10-31 00:31:29 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: coordinator.DelayedActionCoordinator Loading state 2024-10-31 00:31:29 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: Coordinator: Initializing coordinator layer 2024-10-31 00:31:29 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: Initializing Leadership Layer (is follower) 2024-10-31 00:31:29 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer> tracer: starting handler dispatch, 84 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-17-134-150 tracer: set flag leadership.set.cluster-instance-clustered-252-17-137-230 tracer: set flag leadership.set.cluster-instance-clustered-252-17-186-134 tracer: set flag leadership.set.cluster-instance-configured-252-17-134-150 tracer: set flag leadership.set.cluster-instance-configured-252-17-137-230 tracer: set flag leadership.set.cluster-instance-configured-252-17-186-134 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 00:31:29 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: hooks phase, 0 handlers queued 2024-10-31 00:31:29 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:31:29 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-10-31 00:31:29 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: Found peers: 252.17.134.150,252.17.186.134 2024-10-31 00:31:29 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: Expect 2 peers 2024-10-31 00:31:29 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: Reached quorum 2024-10-31 00:31:29 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:31:29 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-10-31 00:31:29 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-10-31 00:31:29 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-10-31 00:31:29 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router 2024-10-31 00:31:29 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:31:29 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: Running _assess_status() 2024-10-31 00:31:30 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-10-31 00:31:30 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-changed logger.go:60 active 2024-10-31 00:31:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: Opening db connection for root@localhost 2024-10-31 00:31:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: Checking cluster status. 2024-10-31 00:31:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: Opening db connection for root@None 2024-10-31 00:31:32 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: coordinator.DelayedActionCoordinator Publishing state 2024-10-31 00:31:32 INFO juju.worker.uniter.operation runhook.go:159 ran "db-router-relation-changed" hook (via explicit, bespoke hook script) 2024-10-31 00:31:32 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (37; unit: glance-mysql-router/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:31:32 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 00:31:32 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run relation-changed (37; unit: glance-mysql-router/0) hook) 2024-10-31 00:31:32 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 00:31:32 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 00:31:32 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-10-31 00:31:32 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-10-31 00:31:32 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 00:31:32 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 00:31:32 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 00:31:32 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 00:31:32 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-10-31 00:31:32 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 2024-10-31 00:31:37 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for mysql-innodb-cluster/2 : {35 {map[keystone-mysql-router/0:{2}] map[] []}} 2024-10-31 00:31:37 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 00:31:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 00:31:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 00:31:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 00:31:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 00:31:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-10-31 00:31:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-10-31 00:31:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-10-31 00:31:37 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (35; unit: keystone-mysql-router/0) hook for mysql-innodb-cluster/2 2024-10-31 00:31:37 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run relation-changed (35; unit: keystone-mysql-router/0) hook) 2024-10-31 00:31:37 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run relation-changed (35; unit: keystone-mysql-router/0) hook) 2024-10-31 00:31:37 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (35; unit: keystone-mysql-router/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:31:37 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (35; unit: keystone-mysql-router/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:31:37 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running db-router-relation-changed hook for keystone-mysql-router/0 2024-10-31 00:31:37 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 00:31:38 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: Reactive main running for hook db-router-relation-changed 2024-10-31 00:31:38 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:31:38 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.ssl_cert 2024-10-31 00:31:38 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.ssl_key 2024-10-31 00:31:38 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.ssl_ca 2024-10-31 00:31:38 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.set.source 2024-10-31 00:31:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.source 2024-10-31 00:31:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.set.cluster-name 2024-10-31 00:31:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.cluster-name 2024-10-31 00:31:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.set.auto-rejoin-tries 2024-10-31 00:31:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.auto-rejoin-tries 2024-10-31 00:31:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.set.expel-timeout 2024-10-31 00:31:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.expel-timeout 2024-10-31 00:31:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.set.innodb-buffer-pool-size 2024-10-31 00:31:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.set.innodb-change-buffering 2024-10-31 00:31:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.innodb-change-buffering 2024-10-31 00:31:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.set.innodb-io-capacity 2024-10-31 00:31:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.innodb-io-capacity 2024-10-31 00:31:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.set.innodb-file-per-table 2024-10-31 00:31:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.innodb-file-per-table 2024-10-31 00:31:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.set.tuning-level 2024-10-31 00:31:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.tuning-level 2024-10-31 00:31:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.set.table-open-cache 2024-10-31 00:31:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.table-open-cache 2024-10-31 00:31:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.set.max-connections 2024-10-31 00:31:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.enable-binlogs 2024-10-31 00:31:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.set.binlogs-path 2024-10-31 00:31:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.binlogs-path 2024-10-31 00:31:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.set.binlogs-max-size 2024-10-31 00:31:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.binlogs-max-size 2024-10-31 00:31:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.set.binlogs-expire-days 2024-10-31 00:31:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.binlogs-expire-days 2024-10-31 00:31:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.prefer-ipv6 2024-10-31 00:31:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.set.wait-timeout 2024-10-31 00:31:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.wait-timeout 2024-10-31 00:31:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: set flag config.default.os-db-router-hostname 2024-10-31 00:31:40 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: Initializing Snap Layer 2024-10-31 00:31:40 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: coordinator.DelayedActionCoordinator Loading state 2024-10-31 00:31:40 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: Coordinator: Initializing coordinator layer 2024-10-31 00:31:40 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: Initializing Leadership Layer (is follower) 2024-10-31 00:31:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer> tracer: starting handler dispatch, 84 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-17-134-150 tracer: set flag leadership.set.cluster-instance-clustered-252-17-137-230 tracer: set flag leadership.set.cluster-instance-clustered-252-17-186-134 tracer: set flag leadership.set.cluster-instance-configured-252-17-134-150 tracer: set flag leadership.set.cluster-instance-configured-252-17-137-230 tracer: set flag leadership.set.cluster-instance-configured-252-17-186-134 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 00:31:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer: hooks phase, 0 handlers queued 2024-10-31 00:31:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:31:40 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-10-31 00:31:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: Found peers: 252.17.134.150,252.17.186.134 2024-10-31 00:31:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: Expect 2 peers 2024-10-31 00:31:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: Reached quorum 2024-10-31 00:31:40 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:31:40 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-10-31 00:31:40 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-10-31 00:31:40 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-10-31 00:31:40 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router 2024-10-31 00:31:40 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:31:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: Running _assess_status() 2024-10-31 00:31:41 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-10-31 00:31:41 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-changed logger.go:60 active 2024-10-31 00:31:41 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: Opening db connection for root@localhost 2024-10-31 00:31:41 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: Checking cluster status. 2024-10-31 00:31:42 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: Opening db connection for root@None 2024-10-31 00:31:42 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:35: coordinator.DelayedActionCoordinator Publishing state 2024-10-31 00:31:43 INFO juju.worker.uniter.operation runhook.go:159 ran "db-router-relation-changed" hook (via explicit, bespoke hook script) 2024-10-31 00:31:43 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (35; unit: keystone-mysql-router/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:31:43 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for mysql-innodb-cluster/2: ok=true 2024-10-31 00:31:43 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 00:31:43 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run relation-changed (35; unit: keystone-mysql-router/0) hook) 2024-10-31 00:31:43 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 00:31:43 DEBUG juju.worker.uniter.operation executor.go:85 running operation run leader-settings-changed hook for mysql-innodb-cluster/2 2024-10-31 00:31:43 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run leader-settings-changed hook) 2024-10-31 00:31:43 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run leader-settings-changed hook) 2024-10-31 00:31:43 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run leader-settings-changed hook" for mysql-innodb-cluster/2 2024-10-31 00:31:43 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run leader-settings-changed hook" for mysql-innodb-cluster/2 2024-10-31 00:31:43 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running leader-settings-changed hook 2024-10-31 00:31:43 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 00:31:44 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Reactive main running for hook leader-settings-changed 2024-10-31 00:31:44 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Initializing Snap Layer 2024-10-31 00:31:44 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator.DelayedActionCoordinator Loading state 2024-10-31 00:31:44 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Coordinator: Initializing coordinator layer 2024-10-31 00:31:44 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Initializing Leadership Layer (is follower) 2024-10-31 00:31:44 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: set flag leadership.changed.mysql-keystone.passwd tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:31:44 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag leadership.set.mysql-keystone.passwd 2024-10-31 00:31:44 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag leadership.changed 2024-10-31 00:31:44 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: starting handler dispatch, 52 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.connected tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.changed tracer: set flag leadership.changed.mysql-keystone.passwd tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-17-134-150 tracer: set flag leadership.set.cluster-instance-clustered-252-17-137-230 tracer: set flag leadership.set.cluster-instance-clustered-252-17-186-134 tracer: set flag leadership.set.cluster-instance-configured-252-17-134-150 tracer: set flag leadership.set.cluster-instance-configured-252-17-137-230 tracer: set flag leadership.set.cluster-instance-configured-252-17-186-134 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 00:31:44 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-10-31 00:31:45 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:31:45 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-10-31 00:31:45 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Found peers: 252.17.134.150,252.17.186.134 2024-10-31 00:31:45 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Expect 2 peers 2024-10-31 00:31:45 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Reached quorum 2024-10-31 00:31:45 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:31:45 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-10-31 00:31:45 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-10-31 00:31:45 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-10-31 00:31:45 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router 2024-10-31 00:31:45 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:31:45 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Running _assess_status() 2024-10-31 00:31:45 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-10-31 00:31:45 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 active 2024-10-31 00:31:45 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Opening db connection for root@localhost 2024-10-31 00:31:46 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Checking cluster status. 2024-10-31 00:31:46 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for mysql-innodb-cluster/2 : {47 {map[placement-mysql-router/0:{0}] map[] []}} 2024-10-31 00:31:47 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Opening db connection for root@None 2024-10-31 00:31:47 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator.DelayedActionCoordinator Publishing state 2024-10-31 00:31:47 INFO juju.worker.uniter.operation runhook.go:159 ran "leader-settings-changed" hook (via explicit, bespoke hook script) 2024-10-31 00:31:47 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run leader-settings-changed hook" for mysql-innodb-cluster/2 2024-10-31 00:31:47 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 00:31:47 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run leader-settings-changed hook) 2024-10-31 00:31:47 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 00:31:47 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 00:31:47 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 00:31:47 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 00:31:47 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-10-31 00:31:47 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-10-31 00:31:47 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-10-31 00:31:47 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 00:31:47 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 00:31:47 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-joined (47; unit: placement-mysql-router/0) hook for mysql-innodb-cluster/2 2024-10-31 00:31:47 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run relation-joined (47; unit: placement-mysql-router/0) hook) 2024-10-31 00:31:47 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run relation-joined (47; unit: placement-mysql-router/0) hook) 2024-10-31 00:31:47 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-joined (47; unit: placement-mysql-router/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:31:47 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-joined (47; unit: placement-mysql-router/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:31:47 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running db-router-relation-joined hook for placement-mysql-router/0 2024-10-31 00:31:47 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 00:31:48 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: Reactive main running for hook db-router-relation-joined 2024-10-31 00:31:49 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:31:49 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.ssl_cert 2024-10-31 00:31:49 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.ssl_key 2024-10-31 00:31:49 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.ssl_ca 2024-10-31 00:31:49 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.set.source 2024-10-31 00:31:49 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.source 2024-10-31 00:31:49 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.set.cluster-name 2024-10-31 00:31:49 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.cluster-name 2024-10-31 00:31:49 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.set.auto-rejoin-tries 2024-10-31 00:31:49 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.auto-rejoin-tries 2024-10-31 00:31:49 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.set.expel-timeout 2024-10-31 00:31:49 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.expel-timeout 2024-10-31 00:31:49 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.set.innodb-buffer-pool-size 2024-10-31 00:31:49 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.set.innodb-change-buffering 2024-10-31 00:31:49 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.innodb-change-buffering 2024-10-31 00:31:49 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.set.innodb-io-capacity 2024-10-31 00:31:49 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.innodb-io-capacity 2024-10-31 00:31:49 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.set.innodb-file-per-table 2024-10-31 00:31:49 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.innodb-file-per-table 2024-10-31 00:31:49 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.set.tuning-level 2024-10-31 00:31:49 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.tuning-level 2024-10-31 00:31:49 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.set.table-open-cache 2024-10-31 00:31:50 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.table-open-cache 2024-10-31 00:31:50 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.set.max-connections 2024-10-31 00:31:50 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.enable-binlogs 2024-10-31 00:31:50 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.set.binlogs-path 2024-10-31 00:31:50 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.binlogs-path 2024-10-31 00:31:50 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.set.binlogs-max-size 2024-10-31 00:31:50 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.binlogs-max-size 2024-10-31 00:31:50 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.set.binlogs-expire-days 2024-10-31 00:31:50 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.binlogs-expire-days 2024-10-31 00:31:50 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.prefer-ipv6 2024-10-31 00:31:50 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.set.wait-timeout 2024-10-31 00:31:50 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.wait-timeout 2024-10-31 00:31:50 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.os-db-router-hostname 2024-10-31 00:31:50 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: Initializing Snap Layer 2024-10-31 00:31:50 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: coordinator.DelayedActionCoordinator Loading state 2024-10-31 00:31:50 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: Coordinator: Initializing coordinator layer 2024-10-31 00:31:50 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: Initializing Leadership Layer (is follower) 2024-10-31 00:31:50 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: cleared flag leadership.changed.mysql-keystone.passwd 2024-10-31 00:31:50 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: cleared flag leadership.changed 2024-10-31 00:31:50 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer> tracer: starting handler dispatch, 85 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-17-134-150 tracer: set flag leadership.set.cluster-instance-clustered-252-17-137-230 tracer: set flag leadership.set.cluster-instance-clustered-252-17-186-134 tracer: set flag leadership.set.cluster-instance-configured-252-17-134-150 tracer: set flag leadership.set.cluster-instance-configured-252-17-137-230 tracer: set flag leadership.set.cluster-instance-configured-252-17-186-134 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 00:31:51 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: hooks phase, 0 handlers queued 2024-10-31 00:31:51 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:31:51 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-10-31 00:31:51 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: Found peers: 252.17.134.150,252.17.186.134 2024-10-31 00:31:51 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: Expect 2 peers 2024-10-31 00:31:51 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: Reached quorum 2024-10-31 00:31:51 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:31:51 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-10-31 00:31:51 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-10-31 00:31:51 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-10-31 00:31:51 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router 2024-10-31 00:31:51 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:31:51 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: Running _assess_status() 2024-10-31 00:31:52 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-10-31 00:31:52 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-joined logger.go:60 active 2024-10-31 00:31:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: Opening db connection for root@localhost 2024-10-31 00:31:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: Checking cluster status. 2024-10-31 00:31:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: Opening db connection for root@None 2024-10-31 00:31:53 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: coordinator.DelayedActionCoordinator Publishing state 2024-10-31 00:31:54 INFO juju.worker.uniter.operation runhook.go:159 ran "db-router-relation-joined" hook (via explicit, bespoke hook script) 2024-10-31 00:31:54 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-joined (47; unit: placement-mysql-router/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:31:54 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 00:31:54 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run relation-joined (47; unit: placement-mysql-router/0) hook) 2024-10-31 00:31:54 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 00:31:54 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 00:31:54 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (47; unit: placement-mysql-router/0) hook for mysql-innodb-cluster/2 2024-10-31 00:31:54 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run relation-changed (47; unit: placement-mysql-router/0) hook) 2024-10-31 00:31:54 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run relation-changed (47; unit: placement-mysql-router/0) hook) 2024-10-31 00:31:54 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (47; unit: placement-mysql-router/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:31:54 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (47; unit: placement-mysql-router/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:31:54 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running db-router-relation-changed hook for placement-mysql-router/0 2024-10-31 00:31:54 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 00:31:54 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: Reactive main running for hook db-router-relation-changed 2024-10-31 00:31:55 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:31:55 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.ssl_cert 2024-10-31 00:31:55 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.ssl_key 2024-10-31 00:31:55 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.ssl_ca 2024-10-31 00:31:55 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.set.source 2024-10-31 00:31:55 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.source 2024-10-31 00:31:55 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.set.cluster-name 2024-10-31 00:31:55 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.cluster-name 2024-10-31 00:31:55 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.set.auto-rejoin-tries 2024-10-31 00:31:55 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.auto-rejoin-tries 2024-10-31 00:31:55 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.set.expel-timeout 2024-10-31 00:31:55 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.expel-timeout 2024-10-31 00:31:55 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.set.innodb-buffer-pool-size 2024-10-31 00:31:56 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.set.innodb-change-buffering 2024-10-31 00:31:56 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.innodb-change-buffering 2024-10-31 00:31:56 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.set.innodb-io-capacity 2024-10-31 00:31:56 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.innodb-io-capacity 2024-10-31 00:31:56 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.set.innodb-file-per-table 2024-10-31 00:31:56 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.innodb-file-per-table 2024-10-31 00:31:56 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.set.tuning-level 2024-10-31 00:31:56 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.tuning-level 2024-10-31 00:31:56 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.set.table-open-cache 2024-10-31 00:31:56 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.table-open-cache 2024-10-31 00:31:56 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.set.max-connections 2024-10-31 00:31:56 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.enable-binlogs 2024-10-31 00:31:56 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.set.binlogs-path 2024-10-31 00:31:56 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.binlogs-path 2024-10-31 00:31:56 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.set.binlogs-max-size 2024-10-31 00:31:56 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.binlogs-max-size 2024-10-31 00:31:56 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.set.binlogs-expire-days 2024-10-31 00:31:56 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.binlogs-expire-days 2024-10-31 00:31:56 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.prefer-ipv6 2024-10-31 00:31:56 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.set.wait-timeout 2024-10-31 00:31:56 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.wait-timeout 2024-10-31 00:31:56 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.os-db-router-hostname 2024-10-31 00:31:56 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: Initializing Snap Layer 2024-10-31 00:31:57 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: coordinator.DelayedActionCoordinator Loading state 2024-10-31 00:31:57 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: Coordinator: Initializing coordinator layer 2024-10-31 00:31:57 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: Initializing Leadership Layer (is follower) 2024-10-31 00:31:57 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer> tracer: starting handler dispatch, 85 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-17-134-150 tracer: set flag leadership.set.cluster-instance-clustered-252-17-137-230 tracer: set flag leadership.set.cluster-instance-clustered-252-17-186-134 tracer: set flag leadership.set.cluster-instance-configured-252-17-134-150 tracer: set flag leadership.set.cluster-instance-configured-252-17-137-230 tracer: set flag leadership.set.cluster-instance-configured-252-17-186-134 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 00:31:57 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: hooks phase, 0 handlers queued 2024-10-31 00:31:57 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:31:57 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-10-31 00:31:57 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: Found peers: 252.17.134.150,252.17.186.134 2024-10-31 00:31:57 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: Expect 2 peers 2024-10-31 00:31:57 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: Reached quorum 2024-10-31 00:31:57 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:31:57 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-10-31 00:31:57 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-10-31 00:31:57 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-10-31 00:31:57 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router 2024-10-31 00:31:57 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:31:57 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: Running _assess_status() 2024-10-31 00:31:58 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-10-31 00:31:58 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-changed logger.go:60 active 2024-10-31 00:31:58 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: Opening db connection for root@localhost 2024-10-31 00:31:58 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: Checking cluster status. 2024-10-31 00:32:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: Opening db connection for root@None 2024-10-31 00:32:00 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: coordinator.DelayedActionCoordinator Publishing state 2024-10-31 00:32:00 INFO juju.worker.uniter.operation runhook.go:159 ran "db-router-relation-changed" hook (via explicit, bespoke hook script) 2024-10-31 00:32:00 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (47; unit: placement-mysql-router/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:32:00 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 00:32:00 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run relation-changed (47; unit: placement-mysql-router/0) hook) 2024-10-31 00:32:00 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 00:32:00 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 00:32:00 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-10-31 00:32:00 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-10-31 00:32:00 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-10-31 00:32:00 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-10-31 00:32:00 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 00:32:00 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 00:32:00 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 00:32:00 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 00:32:00 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 2024-10-31 00:32:00 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 00:32:00 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-10-31 00:32:00 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-10-31 00:32:00 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-10-31 00:32:00 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 00:32:00 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 00:32:00 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 00:32:00 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 00:32:00 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-10-31 00:32:02 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for mysql-innodb-cluster/2 : {37 {map[glance-mysql-router/0:{1}] map[] []}} 2024-10-31 00:32:02 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 00:32:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 00:32:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 00:32:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-10-31 00:32:02 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (37; unit: glance-mysql-router/0) hook for mysql-innodb-cluster/2 2024-10-31 00:32:02 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run relation-changed (37; unit: glance-mysql-router/0) hook) 2024-10-31 00:32:02 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run relation-changed (37; unit: glance-mysql-router/0) hook) 2024-10-31 00:32:02 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (37; unit: glance-mysql-router/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:32:02 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (37; unit: glance-mysql-router/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:32:02 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running db-router-relation-changed hook for glance-mysql-router/0 2024-10-31 00:32:02 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 00:32:03 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: Reactive main running for hook db-router-relation-changed 2024-10-31 00:32:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:32:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.ssl_cert 2024-10-31 00:32:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.ssl_key 2024-10-31 00:32:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.ssl_ca 2024-10-31 00:32:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.set.source 2024-10-31 00:32:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.source 2024-10-31 00:32:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.set.cluster-name 2024-10-31 00:32:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.cluster-name 2024-10-31 00:32:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.set.auto-rejoin-tries 2024-10-31 00:32:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.auto-rejoin-tries 2024-10-31 00:32:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.set.expel-timeout 2024-10-31 00:32:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.expel-timeout 2024-10-31 00:32:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.set.innodb-buffer-pool-size 2024-10-31 00:32:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.set.innodb-change-buffering 2024-10-31 00:32:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.innodb-change-buffering 2024-10-31 00:32:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.set.innodb-io-capacity 2024-10-31 00:32:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.innodb-io-capacity 2024-10-31 00:32:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.set.innodb-file-per-table 2024-10-31 00:32:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.innodb-file-per-table 2024-10-31 00:32:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.set.tuning-level 2024-10-31 00:32:05 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.tuning-level 2024-10-31 00:32:05 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.set.table-open-cache 2024-10-31 00:32:05 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.table-open-cache 2024-10-31 00:32:05 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.set.max-connections 2024-10-31 00:32:05 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.enable-binlogs 2024-10-31 00:32:05 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.set.binlogs-path 2024-10-31 00:32:05 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.binlogs-path 2024-10-31 00:32:05 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.set.binlogs-max-size 2024-10-31 00:32:05 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.binlogs-max-size 2024-10-31 00:32:05 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.set.binlogs-expire-days 2024-10-31 00:32:05 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.binlogs-expire-days 2024-10-31 00:32:05 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.prefer-ipv6 2024-10-31 00:32:05 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.set.wait-timeout 2024-10-31 00:32:05 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.wait-timeout 2024-10-31 00:32:05 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.os-db-router-hostname 2024-10-31 00:32:05 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: Initializing Snap Layer 2024-10-31 00:32:05 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: coordinator.DelayedActionCoordinator Loading state 2024-10-31 00:32:05 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: Coordinator: Initializing coordinator layer 2024-10-31 00:32:05 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: Initializing Leadership Layer (is follower) 2024-10-31 00:32:06 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for mysql-innodb-cluster/2 : {47 {map[placement-mysql-router/0:{1}] map[] []}} 2024-10-31 00:32:06 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer> tracer: starting handler dispatch, 85 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-17-134-150 tracer: set flag leadership.set.cluster-instance-clustered-252-17-137-230 tracer: set flag leadership.set.cluster-instance-clustered-252-17-186-134 tracer: set flag leadership.set.cluster-instance-configured-252-17-134-150 tracer: set flag leadership.set.cluster-instance-configured-252-17-137-230 tracer: set flag leadership.set.cluster-instance-configured-252-17-186-134 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 00:32:06 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: hooks phase, 0 handlers queued 2024-10-31 00:32:06 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:32:06 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-10-31 00:32:06 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: Found peers: 252.17.134.150,252.17.186.134 2024-10-31 00:32:06 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: Expect 2 peers 2024-10-31 00:32:06 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: Reached quorum 2024-10-31 00:32:06 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:32:06 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-10-31 00:32:06 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-10-31 00:32:06 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-10-31 00:32:06 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router 2024-10-31 00:32:06 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:32:06 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: Running _assess_status() 2024-10-31 00:32:07 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-10-31 00:32:07 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-changed logger.go:60 active 2024-10-31 00:32:07 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: Opening db connection for root@localhost 2024-10-31 00:32:07 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: Checking cluster status. 2024-10-31 00:32:08 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: Opening db connection for root@None 2024-10-31 00:32:08 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: coordinator.DelayedActionCoordinator Publishing state 2024-10-31 00:32:09 INFO juju.worker.uniter.operation runhook.go:159 ran "db-router-relation-changed" hook (via explicit, bespoke hook script) 2024-10-31 00:32:09 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (37; unit: glance-mysql-router/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:32:09 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 00:32:09 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run relation-changed (37; unit: glance-mysql-router/0) hook) 2024-10-31 00:32:09 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 00:32:09 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 00:32:09 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-10-31 00:32:09 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-10-31 00:32:09 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 00:32:09 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 00:32:09 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 00:32:09 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 00:32:09 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-10-31 00:32:09 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-10-31 00:32:09 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (47; unit: placement-mysql-router/0) hook for mysql-innodb-cluster/2 2024-10-31 00:32:09 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run relation-changed (47; unit: placement-mysql-router/0) hook) 2024-10-31 00:32:09 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run relation-changed (47; unit: placement-mysql-router/0) hook) 2024-10-31 00:32:09 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (47; unit: placement-mysql-router/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:32:09 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (47; unit: placement-mysql-router/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:32:09 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running db-router-relation-changed hook for placement-mysql-router/0 2024-10-31 00:32:09 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 00:32:09 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: Reactive main running for hook db-router-relation-changed 2024-10-31 00:32:10 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:32:10 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.ssl_cert 2024-10-31 00:32:10 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.ssl_key 2024-10-31 00:32:10 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.ssl_ca 2024-10-31 00:32:10 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.set.source 2024-10-31 00:32:10 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.source 2024-10-31 00:32:10 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.set.cluster-name 2024-10-31 00:32:10 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.cluster-name 2024-10-31 00:32:10 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.set.auto-rejoin-tries 2024-10-31 00:32:10 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.auto-rejoin-tries 2024-10-31 00:32:10 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.set.expel-timeout 2024-10-31 00:32:10 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.expel-timeout 2024-10-31 00:32:10 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.set.innodb-buffer-pool-size 2024-10-31 00:32:10 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.set.innodb-change-buffering 2024-10-31 00:32:10 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.innodb-change-buffering 2024-10-31 00:32:10 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.set.innodb-io-capacity 2024-10-31 00:32:10 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.innodb-io-capacity 2024-10-31 00:32:10 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.set.innodb-file-per-table 2024-10-31 00:32:10 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.innodb-file-per-table 2024-10-31 00:32:10 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.set.tuning-level 2024-10-31 00:32:10 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.tuning-level 2024-10-31 00:32:10 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.set.table-open-cache 2024-10-31 00:32:11 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.table-open-cache 2024-10-31 00:32:11 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.set.max-connections 2024-10-31 00:32:11 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.enable-binlogs 2024-10-31 00:32:11 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.set.binlogs-path 2024-10-31 00:32:11 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.binlogs-path 2024-10-31 00:32:11 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.set.binlogs-max-size 2024-10-31 00:32:11 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.binlogs-max-size 2024-10-31 00:32:11 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.set.binlogs-expire-days 2024-10-31 00:32:11 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.binlogs-expire-days 2024-10-31 00:32:11 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.prefer-ipv6 2024-10-31 00:32:11 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.set.wait-timeout 2024-10-31 00:32:11 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.wait-timeout 2024-10-31 00:32:11 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.os-db-router-hostname 2024-10-31 00:32:11 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: Initializing Snap Layer 2024-10-31 00:32:11 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: coordinator.DelayedActionCoordinator Loading state 2024-10-31 00:32:11 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: Coordinator: Initializing coordinator layer 2024-10-31 00:32:11 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: Initializing Leadership Layer (is follower) 2024-10-31 00:32:11 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer> tracer: starting handler dispatch, 85 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-17-134-150 tracer: set flag leadership.set.cluster-instance-clustered-252-17-137-230 tracer: set flag leadership.set.cluster-instance-clustered-252-17-186-134 tracer: set flag leadership.set.cluster-instance-configured-252-17-134-150 tracer: set flag leadership.set.cluster-instance-configured-252-17-137-230 tracer: set flag leadership.set.cluster-instance-configured-252-17-186-134 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 00:32:11 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: hooks phase, 0 handlers queued 2024-10-31 00:32:11 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:32:11 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-10-31 00:32:11 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: Found peers: 252.17.134.150,252.17.186.134 2024-10-31 00:32:12 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: Expect 2 peers 2024-10-31 00:32:12 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: Reached quorum 2024-10-31 00:32:12 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:32:12 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-10-31 00:32:12 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-10-31 00:32:12 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-10-31 00:32:12 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router 2024-10-31 00:32:12 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:32:12 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: Running _assess_status() 2024-10-31 00:32:12 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-10-31 00:32:12 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-changed logger.go:60 active 2024-10-31 00:32:12 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: Opening db connection for root@localhost 2024-10-31 00:32:12 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: Checking cluster status. 2024-10-31 00:32:13 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: Opening db connection for root@None 2024-10-31 00:32:14 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: coordinator.DelayedActionCoordinator Publishing state 2024-10-31 00:32:14 INFO juju.worker.uniter.operation runhook.go:159 ran "db-router-relation-changed" hook (via explicit, bespoke hook script) 2024-10-31 00:32:14 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (47; unit: placement-mysql-router/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:32:14 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 00:32:14 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run relation-changed (47; unit: placement-mysql-router/0) hook) 2024-10-31 00:32:14 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 00:32:14 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 00:32:14 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-10-31 00:32:14 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-10-31 00:32:14 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-10-31 00:32:14 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-10-31 00:32:14 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 00:32:14 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 00:32:14 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 00:32:14 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 00:32:14 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 2024-10-31 00:32:14 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 00:32:14 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-10-31 00:32:14 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-10-31 00:32:14 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 00:32:14 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 00:32:14 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 00:32:14 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 00:32:14 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-10-31 00:32:14 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-10-31 00:32:37 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for mysql-innodb-cluster/2 : {47 {map[placement-mysql-router/0:{2}] map[] []}} 2024-10-31 00:32:37 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 00:32:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 00:32:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 00:32:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-10-31 00:32:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 00:32:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 00:32:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-10-31 00:32:37 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (47; unit: placement-mysql-router/0) hook for mysql-innodb-cluster/2 2024-10-31 00:32:37 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run relation-changed (47; unit: placement-mysql-router/0) hook) 2024-10-31 00:32:37 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run relation-changed (47; unit: placement-mysql-router/0) hook) 2024-10-31 00:32:37 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (47; unit: placement-mysql-router/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:32:37 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (47; unit: placement-mysql-router/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:32:37 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running db-router-relation-changed hook for placement-mysql-router/0 2024-10-31 00:32:37 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 00:32:38 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: Reactive main running for hook db-router-relation-changed 2024-10-31 00:32:38 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer> tracer: set flag endpoint.db-router.changed.novaapi_database tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:32:38 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag endpoint.db-router.changed.novaapi_hostname 2024-10-31 00:32:38 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag endpoint.db-router.changed.novaapi_username 2024-10-31 00:32:38 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag endpoint.db-router.changed.placement_database 2024-10-31 00:32:38 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag endpoint.db-router.changed.placement_hostname 2024-10-31 00:32:38 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag endpoint.db-router.changed.placement_username 2024-10-31 00:32:38 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.snapd_refresh 2024-10-31 00:32:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.ssl_cert 2024-10-31 00:32:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.ssl_key 2024-10-31 00:32:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.ssl_ca 2024-10-31 00:32:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.set.source 2024-10-31 00:32:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.source 2024-10-31 00:32:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.set.cluster-name 2024-10-31 00:32:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.cluster-name 2024-10-31 00:32:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.set.auto-rejoin-tries 2024-10-31 00:32:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.auto-rejoin-tries 2024-10-31 00:32:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.set.expel-timeout 2024-10-31 00:32:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.expel-timeout 2024-10-31 00:32:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.set.innodb-buffer-pool-size 2024-10-31 00:32:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.set.innodb-change-buffering 2024-10-31 00:32:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.innodb-change-buffering 2024-10-31 00:32:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.set.innodb-io-capacity 2024-10-31 00:32:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.innodb-io-capacity 2024-10-31 00:32:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.set.innodb-file-per-table 2024-10-31 00:32:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.innodb-file-per-table 2024-10-31 00:32:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.set.tuning-level 2024-10-31 00:32:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.tuning-level 2024-10-31 00:32:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.set.table-open-cache 2024-10-31 00:32:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.table-open-cache 2024-10-31 00:32:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.set.max-connections 2024-10-31 00:32:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.enable-binlogs 2024-10-31 00:32:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.set.binlogs-path 2024-10-31 00:32:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.binlogs-path 2024-10-31 00:32:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.set.binlogs-max-size 2024-10-31 00:32:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.binlogs-max-size 2024-10-31 00:32:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.set.binlogs-expire-days 2024-10-31 00:32:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.binlogs-expire-days 2024-10-31 00:32:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.prefer-ipv6 2024-10-31 00:32:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.set.wait-timeout 2024-10-31 00:32:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.wait-timeout 2024-10-31 00:32:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: set flag config.default.os-db-router-hostname 2024-10-31 00:32:40 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: Initializing Snap Layer 2024-10-31 00:32:40 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: coordinator.DelayedActionCoordinator Loading state 2024-10-31 00:32:40 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: Coordinator: Initializing coordinator layer 2024-10-31 00:32:40 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: Initializing Leadership Layer (is follower) 2024-10-31 00:32:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer> tracer: starting handler dispatch, 91 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-17-134-150 tracer: set flag leadership.set.cluster-instance-clustered-252-17-137-230 tracer: set flag leadership.set.cluster-instance-clustered-252-17-186-134 tracer: set flag leadership.set.cluster-instance-configured-252-17-134-150 tracer: set flag leadership.set.cluster-instance-configured-252-17-137-230 tracer: set flag leadership.set.cluster-instance-configured-252-17-186-134 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 00:32:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer: hooks phase, 0 handlers queued 2024-10-31 00:32:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:32:40 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-10-31 00:32:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: Found peers: 252.17.134.150,252.17.186.134 2024-10-31 00:32:41 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: Expect 2 peers 2024-10-31 00:32:41 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: Reached quorum 2024-10-31 00:32:41 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:32:41 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-10-31 00:32:41 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-10-31 00:32:41 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-10-31 00:32:41 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router 2024-10-31 00:32:41 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:32:41 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: Running _assess_status() 2024-10-31 00:32:41 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-10-31 00:32:42 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-changed logger.go:60 active 2024-10-31 00:32:42 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: Opening db connection for root@localhost 2024-10-31 00:32:42 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: Checking cluster status. 2024-10-31 00:32:43 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: Opening db connection for root@None 2024-10-31 00:32:43 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:47: coordinator.DelayedActionCoordinator Publishing state 2024-10-31 00:32:44 INFO juju.worker.uniter.operation runhook.go:159 ran "db-router-relation-changed" hook (via explicit, bespoke hook script) 2024-10-31 00:32:44 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (47; unit: placement-mysql-router/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:32:44 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 00:32:44 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run relation-changed (47; unit: placement-mysql-router/0) hook) 2024-10-31 00:32:44 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 00:32:44 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 00:32:44 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-10-31 00:32:44 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-10-31 00:32:44 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-10-31 00:32:44 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-10-31 00:32:44 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 00:32:44 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 00:32:44 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 00:32:44 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 00:32:44 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 2024-10-31 00:32:45 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for mysql-innodb-cluster/2: ok=true 2024-10-31 00:32:45 DEBUG juju.worker.uniter.operation executor.go:85 running operation run leader-settings-changed hook for mysql-innodb-cluster/2 2024-10-31 00:32:45 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run leader-settings-changed hook) 2024-10-31 00:32:45 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run leader-settings-changed hook) 2024-10-31 00:32:45 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run leader-settings-changed hook" for mysql-innodb-cluster/2 2024-10-31 00:32:45 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run leader-settings-changed hook" for mysql-innodb-cluster/2 2024-10-31 00:32:45 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running leader-settings-changed hook 2024-10-31 00:32:45 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for mysql-innodb-cluster/2: ok=true 2024-10-31 00:32:45 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 00:32:46 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Reactive main running for hook leader-settings-changed 2024-10-31 00:32:46 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Initializing Snap Layer 2024-10-31 00:32:46 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator.DelayedActionCoordinator Loading state 2024-10-31 00:32:46 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Coordinator: Initializing coordinator layer 2024-10-31 00:32:46 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Initializing Leadership Layer (is follower) 2024-10-31 00:32:46 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: set flag leadership.changed.mysql-nova.passwd tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:32:47 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag leadership.set.mysql-nova.passwd 2024-10-31 00:32:47 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag leadership.changed.mysql-placement.passwd 2024-10-31 00:32:47 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag leadership.set.mysql-placement.passwd 2024-10-31 00:32:47 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag leadership.changed 2024-10-31 00:32:47 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: starting handler dispatch, 61 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.connected tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.changed tracer: set flag leadership.changed.mysql-nova.passwd tracer: set flag leadership.changed.mysql-placement.passwd tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-17-134-150 tracer: set flag leadership.set.cluster-instance-clustered-252-17-137-230 tracer: set flag leadership.set.cluster-instance-clustered-252-17-186-134 tracer: set flag leadership.set.cluster-instance-configured-252-17-134-150 tracer: set flag leadership.set.cluster-instance-configured-252-17-137-230 tracer: set flag leadership.set.cluster-instance-configured-252-17-186-134 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 00:32:47 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-10-31 00:32:47 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:32:47 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-10-31 00:32:47 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Found peers: 252.17.134.150,252.17.186.134 2024-10-31 00:32:47 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Expect 2 peers 2024-10-31 00:32:47 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Reached quorum 2024-10-31 00:32:47 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:32:47 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-10-31 00:32:47 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-10-31 00:32:47 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-10-31 00:32:47 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router 2024-10-31 00:32:47 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:32:47 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Running _assess_status() 2024-10-31 00:32:48 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-10-31 00:32:48 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 active 2024-10-31 00:32:48 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Opening db connection for root@localhost 2024-10-31 00:32:48 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Checking cluster status. 2024-10-31 00:32:49 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Opening db connection for root@None 2024-10-31 00:32:49 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator.DelayedActionCoordinator Publishing state 2024-10-31 00:32:49 INFO juju.worker.uniter.operation runhook.go:159 ran "leader-settings-changed" hook (via explicit, bespoke hook script) 2024-10-31 00:32:49 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run leader-settings-changed hook" for mysql-innodb-cluster/2 2024-10-31 00:32:49 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 00:32:49 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run leader-settings-changed hook) 2024-10-31 00:32:49 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 00:32:49 DEBUG juju.worker.uniter.operation executor.go:85 running operation run leader-settings-changed hook for mysql-innodb-cluster/2 2024-10-31 00:32:49 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run leader-settings-changed hook) 2024-10-31 00:32:49 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run leader-settings-changed hook) 2024-10-31 00:32:49 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run leader-settings-changed hook" for mysql-innodb-cluster/2 2024-10-31 00:32:50 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run leader-settings-changed hook" for mysql-innodb-cluster/2 2024-10-31 00:32:50 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 00:32:50 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Reactive main running for hook leader-settings-changed 2024-10-31 00:32:51 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Initializing Snap Layer 2024-10-31 00:32:51 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator.DelayedActionCoordinator Loading state 2024-10-31 00:32:51 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Coordinator: Initializing coordinator layer 2024-10-31 00:32:51 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Initializing Leadership Layer (is follower) 2024-10-31 00:32:51 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: cleared flag leadership.changed.mysql-nova.passwd tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:32:51 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: cleared flag leadership.changed.mysql-placement.passwd 2024-10-31 00:32:51 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: cleared flag leadership.changed 2024-10-31 00:32:51 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: starting handler dispatch, 58 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.connected tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-17-134-150 tracer: set flag leadership.set.cluster-instance-clustered-252-17-137-230 tracer: set flag leadership.set.cluster-instance-clustered-252-17-186-134 tracer: set flag leadership.set.cluster-instance-configured-252-17-134-150 tracer: set flag leadership.set.cluster-instance-configured-252-17-137-230 tracer: set flag leadership.set.cluster-instance-configured-252-17-186-134 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 00:32:51 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-10-31 00:32:51 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:32:51 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-10-31 00:32:51 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Found peers: 252.17.134.150,252.17.186.134 2024-10-31 00:32:51 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Expect 2 peers 2024-10-31 00:32:51 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Reached quorum 2024-10-31 00:32:51 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:32:51 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-10-31 00:32:51 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-10-31 00:32:51 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-10-31 00:32:51 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router 2024-10-31 00:32:51 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:32:51 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Running _assess_status() 2024-10-31 00:32:52 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-10-31 00:32:52 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 active 2024-10-31 00:32:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Opening db connection for root@localhost 2024-10-31 00:32:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Checking cluster status. 2024-10-31 00:32:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Opening db connection for root@None 2024-10-31 00:32:52 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator.DelayedActionCoordinator Publishing state 2024-10-31 00:32:53 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for mysql-innodb-cluster/2 : {45 {map[heat-mysql-router/0:{0}] map[] []}} 2024-10-31 00:32:53 INFO juju.worker.uniter.operation runhook.go:159 ran "leader-settings-changed" hook (via explicit, bespoke hook script) 2024-10-31 00:32:53 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run leader-settings-changed hook" for mysql-innodb-cluster/2 2024-10-31 00:32:53 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 00:32:53 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run leader-settings-changed hook) 2024-10-31 00:32:53 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 00:32:53 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 00:32:53 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-joined (45; unit: heat-mysql-router/0) hook for mysql-innodb-cluster/2 2024-10-31 00:32:53 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run relation-joined (45; unit: heat-mysql-router/0) hook) 2024-10-31 00:32:53 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run relation-joined (45; unit: heat-mysql-router/0) hook) 2024-10-31 00:32:53 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-joined (45; unit: heat-mysql-router/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:32:53 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-joined (45; unit: heat-mysql-router/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:32:53 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running db-router-relation-joined hook for heat-mysql-router/0 2024-10-31 00:32:53 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 00:32:54 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: Reactive main running for hook db-router-relation-joined 2024-10-31 00:32:54 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:32:54 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.ssl_cert 2024-10-31 00:32:54 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.ssl_key 2024-10-31 00:32:54 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.ssl_ca 2024-10-31 00:32:54 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.set.source 2024-10-31 00:32:54 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.source 2024-10-31 00:32:54 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.set.cluster-name 2024-10-31 00:32:54 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.cluster-name 2024-10-31 00:32:54 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.set.auto-rejoin-tries 2024-10-31 00:32:54 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.auto-rejoin-tries 2024-10-31 00:32:54 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.set.expel-timeout 2024-10-31 00:32:54 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.expel-timeout 2024-10-31 00:32:55 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.set.innodb-buffer-pool-size 2024-10-31 00:32:55 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.set.innodb-change-buffering 2024-10-31 00:32:55 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.innodb-change-buffering 2024-10-31 00:32:55 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.set.innodb-io-capacity 2024-10-31 00:32:55 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.innodb-io-capacity 2024-10-31 00:32:55 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.set.innodb-file-per-table 2024-10-31 00:32:55 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.innodb-file-per-table 2024-10-31 00:32:55 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.set.tuning-level 2024-10-31 00:32:55 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.tuning-level 2024-10-31 00:32:55 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.set.table-open-cache 2024-10-31 00:32:55 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.table-open-cache 2024-10-31 00:32:55 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.set.max-connections 2024-10-31 00:32:55 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.enable-binlogs 2024-10-31 00:32:55 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.set.binlogs-path 2024-10-31 00:32:55 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.binlogs-path 2024-10-31 00:32:55 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.set.binlogs-max-size 2024-10-31 00:32:55 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.binlogs-max-size 2024-10-31 00:32:55 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.set.binlogs-expire-days 2024-10-31 00:32:55 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.binlogs-expire-days 2024-10-31 00:32:55 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.prefer-ipv6 2024-10-31 00:32:55 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.set.wait-timeout 2024-10-31 00:32:55 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.wait-timeout 2024-10-31 00:32:55 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.os-db-router-hostname 2024-10-31 00:32:55 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: Initializing Snap Layer 2024-10-31 00:32:55 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: coordinator.DelayedActionCoordinator Loading state 2024-10-31 00:32:55 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: Coordinator: Initializing coordinator layer 2024-10-31 00:32:55 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: Initializing Leadership Layer (is follower) 2024-10-31 00:32:55 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer> tracer: starting handler dispatch, 93 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-17-134-150 tracer: set flag leadership.set.cluster-instance-clustered-252-17-137-230 tracer: set flag leadership.set.cluster-instance-clustered-252-17-186-134 tracer: set flag leadership.set.cluster-instance-configured-252-17-134-150 tracer: set flag leadership.set.cluster-instance-configured-252-17-137-230 tracer: set flag leadership.set.cluster-instance-configured-252-17-186-134 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 00:32:55 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: hooks phase, 0 handlers queued 2024-10-31 00:32:55 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:32:55 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-10-31 00:32:55 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: Found peers: 252.17.134.150,252.17.186.134 2024-10-31 00:32:56 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: Expect 2 peers 2024-10-31 00:32:56 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: Reached quorum 2024-10-31 00:32:56 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:32:56 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-10-31 00:32:56 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-10-31 00:32:56 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-10-31 00:32:56 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router 2024-10-31 00:32:56 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:32:56 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: Running _assess_status() 2024-10-31 00:32:56 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-10-31 00:32:56 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-joined logger.go:60 active 2024-10-31 00:32:56 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: Opening db connection for root@localhost 2024-10-31 00:32:56 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: Checking cluster status. 2024-10-31 00:32:57 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for mysql-innodb-cluster/2 : {39 {map[nova-mysql-router/0:{0}] map[] []}} 2024-10-31 00:32:57 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: Opening db connection for root@None 2024-10-31 00:32:57 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: coordinator.DelayedActionCoordinator Publishing state 2024-10-31 00:32:58 INFO juju.worker.uniter.operation runhook.go:159 ran "db-router-relation-joined" hook (via explicit, bespoke hook script) 2024-10-31 00:32:58 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-joined (45; unit: heat-mysql-router/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:32:58 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 00:32:58 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run relation-joined (45; unit: heat-mysql-router/0) hook) 2024-10-31 00:32:58 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 00:32:58 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 00:32:58 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (45; unit: heat-mysql-router/0) hook for mysql-innodb-cluster/2 2024-10-31 00:32:58 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run relation-changed (45; unit: heat-mysql-router/0) hook) 2024-10-31 00:32:58 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run relation-changed (45; unit: heat-mysql-router/0) hook) 2024-10-31 00:32:58 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (45; unit: heat-mysql-router/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:32:58 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (45; unit: heat-mysql-router/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:32:58 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running db-router-relation-changed hook for heat-mysql-router/0 2024-10-31 00:32:58 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 00:32:59 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: Reactive main running for hook db-router-relation-changed 2024-10-31 00:32:59 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:32:59 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.ssl_cert 2024-10-31 00:32:59 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.ssl_key 2024-10-31 00:32:59 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.ssl_ca 2024-10-31 00:32:59 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.set.source 2024-10-31 00:32:59 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.source 2024-10-31 00:32:59 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.set.cluster-name 2024-10-31 00:33:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.cluster-name 2024-10-31 00:33:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.set.auto-rejoin-tries 2024-10-31 00:33:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.auto-rejoin-tries 2024-10-31 00:33:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.set.expel-timeout 2024-10-31 00:33:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.expel-timeout 2024-10-31 00:33:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.set.innodb-buffer-pool-size 2024-10-31 00:33:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.set.innodb-change-buffering 2024-10-31 00:33:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.innodb-change-buffering 2024-10-31 00:33:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.set.innodb-io-capacity 2024-10-31 00:33:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.innodb-io-capacity 2024-10-31 00:33:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.set.innodb-file-per-table 2024-10-31 00:33:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.innodb-file-per-table 2024-10-31 00:33:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.set.tuning-level 2024-10-31 00:33:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.tuning-level 2024-10-31 00:33:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.set.table-open-cache 2024-10-31 00:33:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.table-open-cache 2024-10-31 00:33:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.set.max-connections 2024-10-31 00:33:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.enable-binlogs 2024-10-31 00:33:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.set.binlogs-path 2024-10-31 00:33:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.binlogs-path 2024-10-31 00:33:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.set.binlogs-max-size 2024-10-31 00:33:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.binlogs-max-size 2024-10-31 00:33:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.set.binlogs-expire-days 2024-10-31 00:33:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.binlogs-expire-days 2024-10-31 00:33:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.prefer-ipv6 2024-10-31 00:33:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.set.wait-timeout 2024-10-31 00:33:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.wait-timeout 2024-10-31 00:33:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.os-db-router-hostname 2024-10-31 00:33:00 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: Initializing Snap Layer 2024-10-31 00:33:01 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: coordinator.DelayedActionCoordinator Loading state 2024-10-31 00:33:01 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: Coordinator: Initializing coordinator layer 2024-10-31 00:33:01 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: Initializing Leadership Layer (is follower) 2024-10-31 00:33:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer> tracer: starting handler dispatch, 93 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-17-134-150 tracer: set flag leadership.set.cluster-instance-clustered-252-17-137-230 tracer: set flag leadership.set.cluster-instance-clustered-252-17-186-134 tracer: set flag leadership.set.cluster-instance-configured-252-17-134-150 tracer: set flag leadership.set.cluster-instance-configured-252-17-137-230 tracer: set flag leadership.set.cluster-instance-configured-252-17-186-134 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 00:33:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: hooks phase, 0 handlers queued 2024-10-31 00:33:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:33:01 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-10-31 00:33:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: Found peers: 252.17.134.150,252.17.186.134 2024-10-31 00:33:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: Expect 2 peers 2024-10-31 00:33:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: Reached quorum 2024-10-31 00:33:01 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:33:01 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-10-31 00:33:01 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-10-31 00:33:01 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-10-31 00:33:01 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router 2024-10-31 00:33:01 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:33:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: Running _assess_status() 2024-10-31 00:33:02 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-10-31 00:33:02 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-changed logger.go:60 active 2024-10-31 00:33:02 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: Opening db connection for root@localhost 2024-10-31 00:33:02 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: Checking cluster status. 2024-10-31 00:33:03 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: Opening db connection for root@None 2024-10-31 00:33:03 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: coordinator.DelayedActionCoordinator Publishing state 2024-10-31 00:33:03 INFO juju.worker.uniter.operation runhook.go:159 ran "db-router-relation-changed" hook (via explicit, bespoke hook script) 2024-10-31 00:33:03 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (45; unit: heat-mysql-router/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:33:04 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 00:33:04 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run relation-changed (45; unit: heat-mysql-router/0) hook) 2024-10-31 00:33:04 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 00:33:04 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 00:33:04 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-10-31 00:33:04 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-10-31 00:33:04 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-joined (39; unit: nova-mysql-router/0) hook for mysql-innodb-cluster/2 2024-10-31 00:33:04 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run relation-joined (39; unit: nova-mysql-router/0) hook) 2024-10-31 00:33:04 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run relation-joined (39; unit: nova-mysql-router/0) hook) 2024-10-31 00:33:04 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-joined (39; unit: nova-mysql-router/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:33:04 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-joined (39; unit: nova-mysql-router/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:33:04 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running db-router-relation-joined hook for nova-mysql-router/0 2024-10-31 00:33:04 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 00:33:04 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: Reactive main running for hook db-router-relation-joined 2024-10-31 00:33:05 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:33:05 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.ssl_cert 2024-10-31 00:33:05 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.ssl_key 2024-10-31 00:33:05 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.ssl_ca 2024-10-31 00:33:05 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.set.source 2024-10-31 00:33:05 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.source 2024-10-31 00:33:05 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.set.cluster-name 2024-10-31 00:33:05 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.cluster-name 2024-10-31 00:33:05 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.set.auto-rejoin-tries 2024-10-31 00:33:05 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.auto-rejoin-tries 2024-10-31 00:33:05 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.set.expel-timeout 2024-10-31 00:33:05 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.expel-timeout 2024-10-31 00:33:05 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.set.innodb-buffer-pool-size 2024-10-31 00:33:05 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.set.innodb-change-buffering 2024-10-31 00:33:05 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.innodb-change-buffering 2024-10-31 00:33:05 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.set.innodb-io-capacity 2024-10-31 00:33:05 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.innodb-io-capacity 2024-10-31 00:33:05 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.set.innodb-file-per-table 2024-10-31 00:33:05 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.innodb-file-per-table 2024-10-31 00:33:06 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.set.tuning-level 2024-10-31 00:33:06 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.tuning-level 2024-10-31 00:33:06 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.set.table-open-cache 2024-10-31 00:33:06 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.table-open-cache 2024-10-31 00:33:06 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.set.max-connections 2024-10-31 00:33:06 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.enable-binlogs 2024-10-31 00:33:06 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.set.binlogs-path 2024-10-31 00:33:06 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.binlogs-path 2024-10-31 00:33:06 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.set.binlogs-max-size 2024-10-31 00:33:06 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.binlogs-max-size 2024-10-31 00:33:06 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.set.binlogs-expire-days 2024-10-31 00:33:06 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.binlogs-expire-days 2024-10-31 00:33:06 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.prefer-ipv6 2024-10-31 00:33:06 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.set.wait-timeout 2024-10-31 00:33:06 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.wait-timeout 2024-10-31 00:33:06 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.os-db-router-hostname 2024-10-31 00:33:06 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: Initializing Snap Layer 2024-10-31 00:33:06 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: coordinator.DelayedActionCoordinator Loading state 2024-10-31 00:33:06 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: Coordinator: Initializing coordinator layer 2024-10-31 00:33:06 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: Initializing Leadership Layer (is follower) 2024-10-31 00:33:06 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer> tracer: starting handler dispatch, 93 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-17-134-150 tracer: set flag leadership.set.cluster-instance-clustered-252-17-137-230 tracer: set flag leadership.set.cluster-instance-clustered-252-17-186-134 tracer: set flag leadership.set.cluster-instance-configured-252-17-134-150 tracer: set flag leadership.set.cluster-instance-configured-252-17-137-230 tracer: set flag leadership.set.cluster-instance-configured-252-17-186-134 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 00:33:06 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: hooks phase, 0 handlers queued 2024-10-31 00:33:06 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:33:07 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-10-31 00:33:07 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: Found peers: 252.17.134.150,252.17.186.134 2024-10-31 00:33:07 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: Expect 2 peers 2024-10-31 00:33:07 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: Reached quorum 2024-10-31 00:33:07 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:33:07 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-10-31 00:33:07 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-10-31 00:33:07 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-10-31 00:33:07 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router 2024-10-31 00:33:07 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:33:07 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: Running _assess_status() 2024-10-31 00:33:07 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-10-31 00:33:07 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-joined logger.go:60 active 2024-10-31 00:33:07 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: Opening db connection for root@localhost 2024-10-31 00:33:08 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: Checking cluster status. 2024-10-31 00:33:09 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: Opening db connection for root@None 2024-10-31 00:33:09 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: coordinator.DelayedActionCoordinator Publishing state 2024-10-31 00:33:09 INFO juju.worker.uniter.operation runhook.go:159 ran "db-router-relation-joined" hook (via explicit, bespoke hook script) 2024-10-31 00:33:09 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-joined (39; unit: nova-mysql-router/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:33:09 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 00:33:09 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run relation-joined (39; unit: nova-mysql-router/0) hook) 2024-10-31 00:33:09 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 00:33:09 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 00:33:09 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-10-31 00:33:09 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-10-31 00:33:09 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-10-31 00:33:09 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 00:33:09 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 00:33:09 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-10-31 00:33:09 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-10-31 00:33:09 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 00:33:09 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 00:33:09 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (39; unit: nova-mysql-router/0) hook for mysql-innodb-cluster/2 2024-10-31 00:33:09 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run relation-changed (39; unit: nova-mysql-router/0) hook) 2024-10-31 00:33:09 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run relation-changed (39; unit: nova-mysql-router/0) hook) 2024-10-31 00:33:09 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (39; unit: nova-mysql-router/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:33:09 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (39; unit: nova-mysql-router/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:33:09 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running db-router-relation-changed hook for nova-mysql-router/0 2024-10-31 00:33:09 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 00:33:10 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: Reactive main running for hook db-router-relation-changed 2024-10-31 00:33:11 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:33:11 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.ssl_cert 2024-10-31 00:33:11 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.ssl_key 2024-10-31 00:33:11 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.ssl_ca 2024-10-31 00:33:11 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.set.source 2024-10-31 00:33:11 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.source 2024-10-31 00:33:11 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.set.cluster-name 2024-10-31 00:33:11 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.cluster-name 2024-10-31 00:33:11 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.set.auto-rejoin-tries 2024-10-31 00:33:11 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.auto-rejoin-tries 2024-10-31 00:33:11 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.set.expel-timeout 2024-10-31 00:33:11 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.expel-timeout 2024-10-31 00:33:11 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.set.innodb-buffer-pool-size 2024-10-31 00:33:11 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.set.innodb-change-buffering 2024-10-31 00:33:11 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.innodb-change-buffering 2024-10-31 00:33:11 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.set.innodb-io-capacity 2024-10-31 00:33:11 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.innodb-io-capacity 2024-10-31 00:33:11 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.set.innodb-file-per-table 2024-10-31 00:33:11 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.innodb-file-per-table 2024-10-31 00:33:11 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.set.tuning-level 2024-10-31 00:33:11 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.tuning-level 2024-10-31 00:33:11 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.set.table-open-cache 2024-10-31 00:33:11 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.table-open-cache 2024-10-31 00:33:12 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.set.max-connections 2024-10-31 00:33:12 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.enable-binlogs 2024-10-31 00:33:12 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.set.binlogs-path 2024-10-31 00:33:12 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.binlogs-path 2024-10-31 00:33:12 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.set.binlogs-max-size 2024-10-31 00:33:12 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.binlogs-max-size 2024-10-31 00:33:12 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.set.binlogs-expire-days 2024-10-31 00:33:12 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.binlogs-expire-days 2024-10-31 00:33:12 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.prefer-ipv6 2024-10-31 00:33:12 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.set.wait-timeout 2024-10-31 00:33:12 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.wait-timeout 2024-10-31 00:33:12 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.os-db-router-hostname 2024-10-31 00:33:12 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: Initializing Snap Layer 2024-10-31 00:33:12 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: coordinator.DelayedActionCoordinator Loading state 2024-10-31 00:33:12 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: Coordinator: Initializing coordinator layer 2024-10-31 00:33:12 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: Initializing Leadership Layer (is follower) 2024-10-31 00:33:12 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer> tracer: starting handler dispatch, 93 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-17-134-150 tracer: set flag leadership.set.cluster-instance-clustered-252-17-137-230 tracer: set flag leadership.set.cluster-instance-clustered-252-17-186-134 tracer: set flag leadership.set.cluster-instance-configured-252-17-134-150 tracer: set flag leadership.set.cluster-instance-configured-252-17-137-230 tracer: set flag leadership.set.cluster-instance-configured-252-17-186-134 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 00:33:12 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: hooks phase, 0 handlers queued 2024-10-31 00:33:12 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:33:12 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-10-31 00:33:12 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: Found peers: 252.17.134.150,252.17.186.134 2024-10-31 00:33:13 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: Expect 2 peers 2024-10-31 00:33:13 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: Reached quorum 2024-10-31 00:33:13 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:33:13 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-10-31 00:33:13 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-10-31 00:33:13 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-10-31 00:33:13 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router 2024-10-31 00:33:13 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:33:13 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: Running _assess_status() 2024-10-31 00:33:13 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-10-31 00:33:13 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-changed logger.go:60 active 2024-10-31 00:33:13 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: Opening db connection for root@localhost 2024-10-31 00:33:13 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: Checking cluster status. 2024-10-31 00:33:14 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: Opening db connection for root@None 2024-10-31 00:33:15 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: coordinator.DelayedActionCoordinator Publishing state 2024-10-31 00:33:15 INFO juju.worker.uniter.operation runhook.go:159 ran "db-router-relation-changed" hook (via explicit, bespoke hook script) 2024-10-31 00:33:15 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (39; unit: nova-mysql-router/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:33:15 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 00:33:15 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run relation-changed (39; unit: nova-mysql-router/0) hook) 2024-10-31 00:33:15 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 00:33:15 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 00:33:15 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-10-31 00:33:15 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-10-31 00:33:15 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-10-31 00:33:15 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 00:33:15 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 00:33:15 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-10-31 00:33:15 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 00:33:15 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 00:33:15 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-10-31 00:33:15 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-10-31 00:33:15 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 2024-10-31 00:33:15 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 00:33:15 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-10-31 00:33:15 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-10-31 00:33:15 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-10-31 00:33:15 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 00:33:15 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 00:33:15 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 00:33:15 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 00:33:15 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-10-31 00:33:15 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-10-31 00:33:15 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-10-31 00:33:16 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for mysql-innodb-cluster/2 : {41 {map[neutron-mysql-router/0:{0}] map[] []}} 2024-10-31 00:33:16 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 00:33:16 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-10-31 00:33:16 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-10-31 00:33:16 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-10-31 00:33:16 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 00:33:16 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 00:33:16 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-joined (41; unit: neutron-mysql-router/0) hook for mysql-innodb-cluster/2 2024-10-31 00:33:16 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run relation-joined (41; unit: neutron-mysql-router/0) hook) 2024-10-31 00:33:16 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run relation-joined (41; unit: neutron-mysql-router/0) hook) 2024-10-31 00:33:16 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-joined (41; unit: neutron-mysql-router/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:33:16 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-joined (41; unit: neutron-mysql-router/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:33:16 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running db-router-relation-joined hook for neutron-mysql-router/0 2024-10-31 00:33:16 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 00:33:17 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: Reactive main running for hook db-router-relation-joined 2024-10-31 00:33:17 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:33:17 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.ssl_cert 2024-10-31 00:33:17 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.ssl_key 2024-10-31 00:33:17 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.ssl_ca 2024-10-31 00:33:17 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.set.source 2024-10-31 00:33:17 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.source 2024-10-31 00:33:17 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.set.cluster-name 2024-10-31 00:33:17 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.cluster-name 2024-10-31 00:33:17 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.set.auto-rejoin-tries 2024-10-31 00:33:17 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.auto-rejoin-tries 2024-10-31 00:33:17 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.set.expel-timeout 2024-10-31 00:33:17 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.expel-timeout 2024-10-31 00:33:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.set.innodb-buffer-pool-size 2024-10-31 00:33:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.set.innodb-change-buffering 2024-10-31 00:33:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.innodb-change-buffering 2024-10-31 00:33:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.set.innodb-io-capacity 2024-10-31 00:33:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.innodb-io-capacity 2024-10-31 00:33:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.set.innodb-file-per-table 2024-10-31 00:33:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.innodb-file-per-table 2024-10-31 00:33:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.set.tuning-level 2024-10-31 00:33:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.tuning-level 2024-10-31 00:33:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.set.table-open-cache 2024-10-31 00:33:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.table-open-cache 2024-10-31 00:33:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.set.max-connections 2024-10-31 00:33:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.enable-binlogs 2024-10-31 00:33:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.set.binlogs-path 2024-10-31 00:33:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.binlogs-path 2024-10-31 00:33:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.set.binlogs-max-size 2024-10-31 00:33:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.binlogs-max-size 2024-10-31 00:33:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.set.binlogs-expire-days 2024-10-31 00:33:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.binlogs-expire-days 2024-10-31 00:33:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.prefer-ipv6 2024-10-31 00:33:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.set.wait-timeout 2024-10-31 00:33:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.wait-timeout 2024-10-31 00:33:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.os-db-router-hostname 2024-10-31 00:33:18 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: Initializing Snap Layer 2024-10-31 00:33:19 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: coordinator.DelayedActionCoordinator Loading state 2024-10-31 00:33:19 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: Coordinator: Initializing coordinator layer 2024-10-31 00:33:19 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: Initializing Leadership Layer (is follower) 2024-10-31 00:33:19 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer> tracer: starting handler dispatch, 93 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-17-134-150 tracer: set flag leadership.set.cluster-instance-clustered-252-17-137-230 tracer: set flag leadership.set.cluster-instance-clustered-252-17-186-134 tracer: set flag leadership.set.cluster-instance-configured-252-17-134-150 tracer: set flag leadership.set.cluster-instance-configured-252-17-137-230 tracer: set flag leadership.set.cluster-instance-configured-252-17-186-134 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 00:33:19 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: hooks phase, 0 handlers queued 2024-10-31 00:33:19 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:33:19 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-10-31 00:33:19 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: Found peers: 252.17.134.150,252.17.186.134 2024-10-31 00:33:19 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: Expect 2 peers 2024-10-31 00:33:19 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: Reached quorum 2024-10-31 00:33:19 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:33:19 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-10-31 00:33:19 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-10-31 00:33:19 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-10-31 00:33:19 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router 2024-10-31 00:33:19 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:33:19 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: Running _assess_status() 2024-10-31 00:33:20 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-10-31 00:33:20 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-joined logger.go:60 active 2024-10-31 00:33:20 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: Opening db connection for root@localhost 2024-10-31 00:33:20 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: Checking cluster status. 2024-10-31 00:33:21 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: Opening db connection for root@None 2024-10-31 00:33:21 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: coordinator.DelayedActionCoordinator Publishing state 2024-10-31 00:33:22 INFO juju.worker.uniter.operation runhook.go:159 ran "db-router-relation-joined" hook (via explicit, bespoke hook script) 2024-10-31 00:33:22 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-joined (41; unit: neutron-mysql-router/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:33:22 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 00:33:22 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run relation-joined (41; unit: neutron-mysql-router/0) hook) 2024-10-31 00:33:22 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 00:33:22 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 00:33:22 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 00:33:22 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 00:33:22 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-10-31 00:33:22 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (41; unit: neutron-mysql-router/0) hook for mysql-innodb-cluster/2 2024-10-31 00:33:22 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run relation-changed (41; unit: neutron-mysql-router/0) hook) 2024-10-31 00:33:22 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run relation-changed (41; unit: neutron-mysql-router/0) hook) 2024-10-31 00:33:22 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (41; unit: neutron-mysql-router/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:33:22 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (41; unit: neutron-mysql-router/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:33:22 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running db-router-relation-changed hook for neutron-mysql-router/0 2024-10-31 00:33:22 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 00:33:22 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: Reactive main running for hook db-router-relation-changed 2024-10-31 00:33:23 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:33:23 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.ssl_cert 2024-10-31 00:33:23 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.ssl_key 2024-10-31 00:33:23 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.ssl_ca 2024-10-31 00:33:23 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.set.source 2024-10-31 00:33:23 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.source 2024-10-31 00:33:23 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.set.cluster-name 2024-10-31 00:33:23 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.cluster-name 2024-10-31 00:33:23 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.set.auto-rejoin-tries 2024-10-31 00:33:23 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.auto-rejoin-tries 2024-10-31 00:33:23 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.set.expel-timeout 2024-10-31 00:33:24 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.expel-timeout 2024-10-31 00:33:24 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.set.innodb-buffer-pool-size 2024-10-31 00:33:24 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.set.innodb-change-buffering 2024-10-31 00:33:24 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.innodb-change-buffering 2024-10-31 00:33:24 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.set.innodb-io-capacity 2024-10-31 00:33:24 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.innodb-io-capacity 2024-10-31 00:33:24 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.set.innodb-file-per-table 2024-10-31 00:33:24 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.innodb-file-per-table 2024-10-31 00:33:24 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.set.tuning-level 2024-10-31 00:33:24 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.tuning-level 2024-10-31 00:33:24 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.set.table-open-cache 2024-10-31 00:33:24 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.table-open-cache 2024-10-31 00:33:24 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.set.max-connections 2024-10-31 00:33:24 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.enable-binlogs 2024-10-31 00:33:24 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.set.binlogs-path 2024-10-31 00:33:24 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.binlogs-path 2024-10-31 00:33:24 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.set.binlogs-max-size 2024-10-31 00:33:24 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.binlogs-max-size 2024-10-31 00:33:24 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.set.binlogs-expire-days 2024-10-31 00:33:24 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.binlogs-expire-days 2024-10-31 00:33:24 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.prefer-ipv6 2024-10-31 00:33:24 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.set.wait-timeout 2024-10-31 00:33:24 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.wait-timeout 2024-10-31 00:33:24 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.os-db-router-hostname 2024-10-31 00:33:24 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: Initializing Snap Layer 2024-10-31 00:33:25 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: coordinator.DelayedActionCoordinator Loading state 2024-10-31 00:33:25 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: Coordinator: Initializing coordinator layer 2024-10-31 00:33:25 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: Initializing Leadership Layer (is follower) 2024-10-31 00:33:25 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer> tracer: starting handler dispatch, 93 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-17-134-150 tracer: set flag leadership.set.cluster-instance-clustered-252-17-137-230 tracer: set flag leadership.set.cluster-instance-clustered-252-17-186-134 tracer: set flag leadership.set.cluster-instance-configured-252-17-134-150 tracer: set flag leadership.set.cluster-instance-configured-252-17-137-230 tracer: set flag leadership.set.cluster-instance-configured-252-17-186-134 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 00:33:25 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: hooks phase, 0 handlers queued 2024-10-31 00:33:25 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:33:25 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-10-31 00:33:25 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: Found peers: 252.17.134.150,252.17.186.134 2024-10-31 00:33:25 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: Expect 2 peers 2024-10-31 00:33:25 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: Reached quorum 2024-10-31 00:33:25 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:33:25 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-10-31 00:33:25 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-10-31 00:33:25 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-10-31 00:33:25 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router 2024-10-31 00:33:25 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:33:25 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: Running _assess_status() 2024-10-31 00:33:25 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for mysql-innodb-cluster/2 : {37 {map[glance-mysql-router/0:{2}] map[] []}} 2024-10-31 00:33:26 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-10-31 00:33:26 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-changed logger.go:60 active 2024-10-31 00:33:26 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: Opening db connection for root@localhost 2024-10-31 00:33:26 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: Checking cluster status. 2024-10-31 00:33:27 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: Opening db connection for root@None 2024-10-31 00:33:27 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: coordinator.DelayedActionCoordinator Publishing state 2024-10-31 00:33:27 INFO juju.worker.uniter.operation runhook.go:159 ran "db-router-relation-changed" hook (via explicit, bespoke hook script) 2024-10-31 00:33:28 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (41; unit: neutron-mysql-router/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:33:28 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 00:33:28 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run relation-changed (41; unit: neutron-mysql-router/0) hook) 2024-10-31 00:33:28 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 00:33:28 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 00:33:28 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-10-31 00:33:28 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (37; unit: glance-mysql-router/0) hook for mysql-innodb-cluster/2 2024-10-31 00:33:28 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run relation-changed (37; unit: glance-mysql-router/0) hook) 2024-10-31 00:33:28 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run relation-changed (37; unit: glance-mysql-router/0) hook) 2024-10-31 00:33:28 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (37; unit: glance-mysql-router/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:33:28 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (37; unit: glance-mysql-router/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:33:28 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running db-router-relation-changed hook for glance-mysql-router/0 2024-10-31 00:33:28 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 00:33:29 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: Reactive main running for hook db-router-relation-changed 2024-10-31 00:33:29 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:33:29 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.ssl_cert 2024-10-31 00:33:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.ssl_key 2024-10-31 00:33:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.ssl_ca 2024-10-31 00:33:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.set.source 2024-10-31 00:33:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.source 2024-10-31 00:33:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.set.cluster-name 2024-10-31 00:33:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.cluster-name 2024-10-31 00:33:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.set.auto-rejoin-tries 2024-10-31 00:33:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.auto-rejoin-tries 2024-10-31 00:33:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.set.expel-timeout 2024-10-31 00:33:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.expel-timeout 2024-10-31 00:33:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.set.innodb-buffer-pool-size 2024-10-31 00:33:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.set.innodb-change-buffering 2024-10-31 00:33:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.innodb-change-buffering 2024-10-31 00:33:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.set.innodb-io-capacity 2024-10-31 00:33:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.innodb-io-capacity 2024-10-31 00:33:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.set.innodb-file-per-table 2024-10-31 00:33:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.innodb-file-per-table 2024-10-31 00:33:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.set.tuning-level 2024-10-31 00:33:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.tuning-level 2024-10-31 00:33:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.set.table-open-cache 2024-10-31 00:33:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.table-open-cache 2024-10-31 00:33:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.set.max-connections 2024-10-31 00:33:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.enable-binlogs 2024-10-31 00:33:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.set.binlogs-path 2024-10-31 00:33:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.binlogs-path 2024-10-31 00:33:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.set.binlogs-max-size 2024-10-31 00:33:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.binlogs-max-size 2024-10-31 00:33:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.set.binlogs-expire-days 2024-10-31 00:33:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.binlogs-expire-days 2024-10-31 00:33:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.prefer-ipv6 2024-10-31 00:33:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.set.wait-timeout 2024-10-31 00:33:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.wait-timeout 2024-10-31 00:33:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: set flag config.default.os-db-router-hostname 2024-10-31 00:33:31 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: Initializing Snap Layer 2024-10-31 00:33:31 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: coordinator.DelayedActionCoordinator Loading state 2024-10-31 00:33:31 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: Coordinator: Initializing coordinator layer 2024-10-31 00:33:31 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: Initializing Leadership Layer (is follower) 2024-10-31 00:33:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer> tracer: starting handler dispatch, 93 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-17-134-150 tracer: set flag leadership.set.cluster-instance-clustered-252-17-137-230 tracer: set flag leadership.set.cluster-instance-clustered-252-17-186-134 tracer: set flag leadership.set.cluster-instance-configured-252-17-134-150 tracer: set flag leadership.set.cluster-instance-configured-252-17-137-230 tracer: set flag leadership.set.cluster-instance-configured-252-17-186-134 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 00:33:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer: hooks phase, 0 handlers queued 2024-10-31 00:33:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:33:31 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-10-31 00:33:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: Found peers: 252.17.134.150,252.17.186.134 2024-10-31 00:33:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: Expect 2 peers 2024-10-31 00:33:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: Reached quorum 2024-10-31 00:33:31 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:33:31 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-10-31 00:33:31 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-10-31 00:33:31 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-10-31 00:33:31 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router 2024-10-31 00:33:31 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:33:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: Running _assess_status() 2024-10-31 00:33:32 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-10-31 00:33:32 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-changed logger.go:60 active 2024-10-31 00:33:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: Opening db connection for root@localhost 2024-10-31 00:33:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: Checking cluster status. 2024-10-31 00:33:33 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: Opening db connection for root@None 2024-10-31 00:33:33 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:37: coordinator.DelayedActionCoordinator Publishing state 2024-10-31 00:33:33 INFO juju.worker.uniter.operation runhook.go:159 ran "db-router-relation-changed" hook (via explicit, bespoke hook script) 2024-10-31 00:33:33 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (37; unit: glance-mysql-router/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:33:34 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 00:33:34 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run relation-changed (37; unit: glance-mysql-router/0) hook) 2024-10-31 00:33:34 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 00:33:34 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 00:33:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-10-31 00:33:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-10-31 00:33:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-10-31 00:33:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-10-31 00:33:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-10-31 00:33:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-10-31 00:33:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 00:33:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 00:33:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-10-31 00:33:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 00:33:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 00:33:34 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 2024-10-31 00:33:34 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 00:33:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-10-31 00:33:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-10-31 00:33:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-10-31 00:33:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 00:33:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 00:33:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-10-31 00:33:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-10-31 00:33:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-10-31 00:33:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-10-31 00:33:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 00:33:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 00:33:37 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for mysql-innodb-cluster/2: ok=true 2024-10-31 00:33:37 DEBUG juju.worker.uniter.operation executor.go:85 running operation run leader-settings-changed hook for mysql-innodb-cluster/2 2024-10-31 00:33:37 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run leader-settings-changed hook) 2024-10-31 00:33:37 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run leader-settings-changed hook) 2024-10-31 00:33:37 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run leader-settings-changed hook" for mysql-innodb-cluster/2 2024-10-31 00:33:37 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run leader-settings-changed hook" for mysql-innodb-cluster/2 2024-10-31 00:33:37 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running leader-settings-changed hook 2024-10-31 00:33:37 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 00:33:38 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Reactive main running for hook leader-settings-changed 2024-10-31 00:33:38 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Initializing Snap Layer 2024-10-31 00:33:38 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator.DelayedActionCoordinator Loading state 2024-10-31 00:33:38 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Coordinator: Initializing coordinator layer 2024-10-31 00:33:38 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Initializing Leadership Layer (is follower) 2024-10-31 00:33:38 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: set flag leadership.changed.mysql-glance.passwd tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:33:38 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag leadership.set.mysql-glance.passwd 2024-10-31 00:33:38 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag leadership.changed 2024-10-31 00:33:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: starting handler dispatch, 61 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.connected tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.changed tracer: set flag leadership.changed.mysql-glance.passwd tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-17-134-150 tracer: set flag leadership.set.cluster-instance-clustered-252-17-137-230 tracer: set flag leadership.set.cluster-instance-clustered-252-17-186-134 tracer: set flag leadership.set.cluster-instance-configured-252-17-134-150 tracer: set flag leadership.set.cluster-instance-configured-252-17-137-230 tracer: set flag leadership.set.cluster-instance-configured-252-17-186-134 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 00:33:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-10-31 00:33:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:33:39 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-10-31 00:33:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Found peers: 252.17.134.150,252.17.186.134 2024-10-31 00:33:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Expect 2 peers 2024-10-31 00:33:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Reached quorum 2024-10-31 00:33:39 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:33:39 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-10-31 00:33:39 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-10-31 00:33:39 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-10-31 00:33:39 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router 2024-10-31 00:33:39 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:33:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Running _assess_status() 2024-10-31 00:33:40 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-10-31 00:33:40 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 active 2024-10-31 00:33:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Opening db connection for root@localhost 2024-10-31 00:33:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Checking cluster status. 2024-10-31 00:33:41 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Opening db connection for root@None 2024-10-31 00:33:41 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator.DelayedActionCoordinator Publishing state 2024-10-31 00:33:41 INFO juju.worker.uniter.operation runhook.go:159 ran "leader-settings-changed" hook (via explicit, bespoke hook script) 2024-10-31 00:33:41 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run leader-settings-changed hook" for mysql-innodb-cluster/2 2024-10-31 00:33:41 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 00:33:41 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run leader-settings-changed hook) 2024-10-31 00:33:41 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 00:33:41 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 00:33:41 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-10-31 00:33:41 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-10-31 00:33:41 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-10-31 00:33:41 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-10-31 00:33:41 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-10-31 00:33:41 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-10-31 00:33:41 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 00:33:41 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 00:33:41 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-10-31 00:33:41 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 00:33:41 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 00:33:41 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 2024-10-31 00:34:20 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for mysql-innodb-cluster/2 : {45 {map[heat-mysql-router/0:{1}] map[] []}} 2024-10-31 00:34:20 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 00:34:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-10-31 00:34:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-10-31 00:34:20 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (45; unit: heat-mysql-router/0) hook for mysql-innodb-cluster/2 2024-10-31 00:34:20 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run relation-changed (45; unit: heat-mysql-router/0) hook) 2024-10-31 00:34:20 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run relation-changed (45; unit: heat-mysql-router/0) hook) 2024-10-31 00:34:20 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (45; unit: heat-mysql-router/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:34:20 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (45; unit: heat-mysql-router/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:34:20 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running db-router-relation-changed hook for heat-mysql-router/0 2024-10-31 00:34:20 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 00:34:20 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: Reactive main running for hook db-router-relation-changed 2024-10-31 00:34:21 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:34:21 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.ssl_cert 2024-10-31 00:34:21 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.ssl_key 2024-10-31 00:34:21 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.ssl_ca 2024-10-31 00:34:21 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.set.source 2024-10-31 00:34:21 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.source 2024-10-31 00:34:21 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.set.cluster-name 2024-10-31 00:34:21 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.cluster-name 2024-10-31 00:34:21 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.set.auto-rejoin-tries 2024-10-31 00:34:21 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.auto-rejoin-tries 2024-10-31 00:34:21 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.set.expel-timeout 2024-10-31 00:34:21 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.expel-timeout 2024-10-31 00:34:21 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.set.innodb-buffer-pool-size 2024-10-31 00:34:22 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.set.innodb-change-buffering 2024-10-31 00:34:22 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.innodb-change-buffering 2024-10-31 00:34:22 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.set.innodb-io-capacity 2024-10-31 00:34:22 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.innodb-io-capacity 2024-10-31 00:34:22 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.set.innodb-file-per-table 2024-10-31 00:34:22 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.innodb-file-per-table 2024-10-31 00:34:22 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.set.tuning-level 2024-10-31 00:34:22 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.tuning-level 2024-10-31 00:34:22 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.set.table-open-cache 2024-10-31 00:34:22 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.table-open-cache 2024-10-31 00:34:22 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.set.max-connections 2024-10-31 00:34:22 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.enable-binlogs 2024-10-31 00:34:22 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.set.binlogs-path 2024-10-31 00:34:22 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.binlogs-path 2024-10-31 00:34:22 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.set.binlogs-max-size 2024-10-31 00:34:22 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.binlogs-max-size 2024-10-31 00:34:22 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.set.binlogs-expire-days 2024-10-31 00:34:22 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.binlogs-expire-days 2024-10-31 00:34:22 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.prefer-ipv6 2024-10-31 00:34:22 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.set.wait-timeout 2024-10-31 00:34:22 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.wait-timeout 2024-10-31 00:34:22 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.os-db-router-hostname 2024-10-31 00:34:22 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: Initializing Snap Layer 2024-10-31 00:34:22 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: coordinator.DelayedActionCoordinator Loading state 2024-10-31 00:34:23 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: Coordinator: Initializing coordinator layer 2024-10-31 00:34:23 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: Initializing Leadership Layer (is follower) 2024-10-31 00:34:23 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: cleared flag leadership.changed.mysql-glance.passwd 2024-10-31 00:34:23 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: cleared flag leadership.changed 2024-10-31 00:34:23 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer> tracer: starting handler dispatch, 94 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-17-134-150 tracer: set flag leadership.set.cluster-instance-clustered-252-17-137-230 tracer: set flag leadership.set.cluster-instance-clustered-252-17-186-134 tracer: set flag leadership.set.cluster-instance-configured-252-17-134-150 tracer: set flag leadership.set.cluster-instance-configured-252-17-137-230 tracer: set flag leadership.set.cluster-instance-configured-252-17-186-134 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 00:34:23 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: hooks phase, 0 handlers queued 2024-10-31 00:34:23 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:34:23 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-10-31 00:34:23 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: Found peers: 252.17.134.150,252.17.186.134 2024-10-31 00:34:23 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: Expect 2 peers 2024-10-31 00:34:23 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: Reached quorum 2024-10-31 00:34:23 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:34:23 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-10-31 00:34:23 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-10-31 00:34:23 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-10-31 00:34:23 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router 2024-10-31 00:34:23 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:34:23 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: Running _assess_status() 2024-10-31 00:34:24 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-10-31 00:34:24 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-changed logger.go:60 active 2024-10-31 00:34:24 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: Opening db connection for root@localhost 2024-10-31 00:34:24 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: Checking cluster status. 2024-10-31 00:34:25 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: Opening db connection for root@None 2024-10-31 00:34:25 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: coordinator.DelayedActionCoordinator Publishing state 2024-10-31 00:34:25 INFO juju.worker.uniter.operation runhook.go:159 ran "db-router-relation-changed" hook (via explicit, bespoke hook script) 2024-10-31 00:34:25 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (45; unit: heat-mysql-router/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:34:26 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 00:34:26 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run relation-changed (45; unit: heat-mysql-router/0) hook) 2024-10-31 00:34:26 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 00:34:26 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 00:34:26 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-10-31 00:34:26 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 00:34:26 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 00:34:26 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-10-31 00:34:26 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-10-31 00:34:26 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-10-31 00:34:26 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 00:34:26 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 00:34:26 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-10-31 00:34:26 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-10-31 00:34:26 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-10-31 00:34:26 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 2024-10-31 00:34:51 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for mysql-innodb-cluster/2 : {45 {map[heat-mysql-router/0:{2}] map[] []}} 2024-10-31 00:34:51 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 00:34:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-10-31 00:34:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-10-31 00:34:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-10-31 00:34:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-10-31 00:34:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-10-31 00:34:51 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (45; unit: heat-mysql-router/0) hook for mysql-innodb-cluster/2 2024-10-31 00:34:51 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run relation-changed (45; unit: heat-mysql-router/0) hook) 2024-10-31 00:34:51 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run relation-changed (45; unit: heat-mysql-router/0) hook) 2024-10-31 00:34:51 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (45; unit: heat-mysql-router/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:34:51 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (45; unit: heat-mysql-router/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:34:51 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running db-router-relation-changed hook for heat-mysql-router/0 2024-10-31 00:34:51 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 00:34:51 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: Reactive main running for hook db-router-relation-changed 2024-10-31 00:34:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer> tracer: set flag endpoint.db-router.changed.heat_database tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:34:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag endpoint.db-router.changed.heat_hostname 2024-10-31 00:34:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag endpoint.db-router.changed.heat_username 2024-10-31 00:34:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.snapd_refresh 2024-10-31 00:34:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.ssl_cert 2024-10-31 00:34:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.ssl_key 2024-10-31 00:34:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.ssl_ca 2024-10-31 00:34:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.set.source 2024-10-31 00:34:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.source 2024-10-31 00:34:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.set.cluster-name 2024-10-31 00:34:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.cluster-name 2024-10-31 00:34:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.set.auto-rejoin-tries 2024-10-31 00:34:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.auto-rejoin-tries 2024-10-31 00:34:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.set.expel-timeout 2024-10-31 00:34:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.expel-timeout 2024-10-31 00:34:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.set.innodb-buffer-pool-size 2024-10-31 00:34:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.set.innodb-change-buffering 2024-10-31 00:34:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.innodb-change-buffering 2024-10-31 00:34:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.set.innodb-io-capacity 2024-10-31 00:34:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.innodb-io-capacity 2024-10-31 00:34:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.set.innodb-file-per-table 2024-10-31 00:34:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.innodb-file-per-table 2024-10-31 00:34:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.set.tuning-level 2024-10-31 00:34:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.tuning-level 2024-10-31 00:34:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.set.table-open-cache 2024-10-31 00:34:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.table-open-cache 2024-10-31 00:34:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.set.max-connections 2024-10-31 00:34:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.enable-binlogs 2024-10-31 00:34:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.set.binlogs-path 2024-10-31 00:34:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.binlogs-path 2024-10-31 00:34:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.set.binlogs-max-size 2024-10-31 00:34:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.binlogs-max-size 2024-10-31 00:34:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.set.binlogs-expire-days 2024-10-31 00:34:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.binlogs-expire-days 2024-10-31 00:34:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.prefer-ipv6 2024-10-31 00:34:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.set.wait-timeout 2024-10-31 00:34:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.wait-timeout 2024-10-31 00:34:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: set flag config.default.os-db-router-hostname 2024-10-31 00:34:53 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: Initializing Snap Layer 2024-10-31 00:34:53 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: coordinator.DelayedActionCoordinator Loading state 2024-10-31 00:34:53 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: Coordinator: Initializing coordinator layer 2024-10-31 00:34:53 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: Initializing Leadership Layer (is follower) 2024-10-31 00:34:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer> tracer: starting handler dispatch, 97 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-17-134-150 tracer: set flag leadership.set.cluster-instance-clustered-252-17-137-230 tracer: set flag leadership.set.cluster-instance-clustered-252-17-186-134 tracer: set flag leadership.set.cluster-instance-configured-252-17-134-150 tracer: set flag leadership.set.cluster-instance-configured-252-17-137-230 tracer: set flag leadership.set.cluster-instance-configured-252-17-186-134 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 00:34:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer: hooks phase, 0 handlers queued 2024-10-31 00:34:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:34:53 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-10-31 00:34:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: Found peers: 252.17.134.150,252.17.186.134 2024-10-31 00:34:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: Expect 2 peers 2024-10-31 00:34:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: Reached quorum 2024-10-31 00:34:54 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:34:54 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-10-31 00:34:54 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-10-31 00:34:54 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-10-31 00:34:54 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router 2024-10-31 00:34:54 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:34:54 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: Running _assess_status() 2024-10-31 00:34:54 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-10-31 00:34:54 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-changed logger.go:60 active 2024-10-31 00:34:54 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: Opening db connection for root@localhost 2024-10-31 00:34:54 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: Checking cluster status. 2024-10-31 00:34:55 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: Opening db connection for root@None 2024-10-31 00:34:55 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:45: coordinator.DelayedActionCoordinator Publishing state 2024-10-31 00:34:56 INFO juju.worker.uniter.operation runhook.go:159 ran "db-router-relation-changed" hook (via explicit, bespoke hook script) 2024-10-31 00:34:56 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (45; unit: heat-mysql-router/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:34:56 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 00:34:56 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run relation-changed (45; unit: heat-mysql-router/0) hook) 2024-10-31 00:34:56 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 00:34:56 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 00:34:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-10-31 00:34:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-10-31 00:34:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-10-31 00:34:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-10-31 00:34:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 00:34:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 00:34:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-10-31 00:34:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 00:34:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 00:34:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-10-31 00:34:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-10-31 00:34:56 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 2024-10-31 00:34:57 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for mysql-innodb-cluster/2: ok=true 2024-10-31 00:34:57 DEBUG juju.worker.uniter.operation executor.go:85 running operation run leader-settings-changed hook for mysql-innodb-cluster/2 2024-10-31 00:34:57 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run leader-settings-changed hook) 2024-10-31 00:34:57 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run leader-settings-changed hook) 2024-10-31 00:34:57 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run leader-settings-changed hook" for mysql-innodb-cluster/2 2024-10-31 00:34:57 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run leader-settings-changed hook" for mysql-innodb-cluster/2 2024-10-31 00:34:57 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running leader-settings-changed hook 2024-10-31 00:34:57 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 00:34:58 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Reactive main running for hook leader-settings-changed 2024-10-31 00:34:58 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Initializing Snap Layer 2024-10-31 00:34:58 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator.DelayedActionCoordinator Loading state 2024-10-31 00:34:58 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Coordinator: Initializing coordinator layer 2024-10-31 00:34:58 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Initializing Leadership Layer (is follower) 2024-10-31 00:34:58 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: set flag leadership.changed.mysql-heat.passwd tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:34:58 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag leadership.set.mysql-heat.passwd 2024-10-31 00:34:58 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag leadership.changed 2024-10-31 00:34:58 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: starting handler dispatch, 65 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.connected tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.changed tracer: set flag leadership.changed.mysql-heat.passwd tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-17-134-150 tracer: set flag leadership.set.cluster-instance-clustered-252-17-137-230 tracer: set flag leadership.set.cluster-instance-clustered-252-17-186-134 tracer: set flag leadership.set.cluster-instance-configured-252-17-134-150 tracer: set flag leadership.set.cluster-instance-configured-252-17-137-230 tracer: set flag leadership.set.cluster-instance-configured-252-17-186-134 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 00:34:58 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-10-31 00:34:58 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:34:58 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-10-31 00:34:58 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Found peers: 252.17.134.150,252.17.186.134 2024-10-31 00:34:58 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Expect 2 peers 2024-10-31 00:34:58 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Reached quorum 2024-10-31 00:34:58 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:34:59 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-10-31 00:34:59 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-10-31 00:34:59 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-10-31 00:34:59 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router 2024-10-31 00:34:59 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:34:59 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Running _assess_status() 2024-10-31 00:34:59 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-10-31 00:34:59 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 active 2024-10-31 00:34:59 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Opening db connection for root@localhost 2024-10-31 00:34:59 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Checking cluster status. 2024-10-31 00:35:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Opening db connection for root@None 2024-10-31 00:35:00 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator.DelayedActionCoordinator Publishing state 2024-10-31 00:35:01 INFO juju.worker.uniter.operation runhook.go:159 ran "leader-settings-changed" hook (via explicit, bespoke hook script) 2024-10-31 00:35:01 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run leader-settings-changed hook" for mysql-innodb-cluster/2 2024-10-31 00:35:01 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 00:35:01 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run leader-settings-changed hook) 2024-10-31 00:35:01 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 00:35:01 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 00:35:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-10-31 00:35:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-10-31 00:35:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-10-31 00:35:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-10-31 00:35:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-10-31 00:35:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 00:35:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 00:35:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-10-31 00:35:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-10-31 00:35:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 00:35:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 00:35:01 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 2024-10-31 00:35:32 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for mysql-innodb-cluster/2 : {41 {map[neutron-mysql-router/0:{1}] map[] []}} 2024-10-31 00:35:32 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 00:35:32 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-10-31 00:35:32 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 00:35:32 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 00:35:32 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-10-31 00:35:32 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 00:35:32 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 00:35:32 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-10-31 00:35:32 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-10-31 00:35:32 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-10-31 00:35:32 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-10-31 00:35:32 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (41; unit: neutron-mysql-router/0) hook for mysql-innodb-cluster/2 2024-10-31 00:35:32 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run relation-changed (41; unit: neutron-mysql-router/0) hook) 2024-10-31 00:35:32 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run relation-changed (41; unit: neutron-mysql-router/0) hook) 2024-10-31 00:35:32 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (41; unit: neutron-mysql-router/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:35:32 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (41; unit: neutron-mysql-router/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:35:32 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running db-router-relation-changed hook for neutron-mysql-router/0 2024-10-31 00:35:32 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 00:35:33 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: Reactive main running for hook db-router-relation-changed 2024-10-31 00:35:33 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:35:33 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.ssl_cert 2024-10-31 00:35:33 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.ssl_key 2024-10-31 00:35:33 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.ssl_ca 2024-10-31 00:35:33 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.set.source 2024-10-31 00:35:33 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.source 2024-10-31 00:35:33 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.set.cluster-name 2024-10-31 00:35:34 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.cluster-name 2024-10-31 00:35:34 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.set.auto-rejoin-tries 2024-10-31 00:35:34 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.auto-rejoin-tries 2024-10-31 00:35:34 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.set.expel-timeout 2024-10-31 00:35:34 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.expel-timeout 2024-10-31 00:35:34 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.set.innodb-buffer-pool-size 2024-10-31 00:35:34 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.set.innodb-change-buffering 2024-10-31 00:35:34 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.innodb-change-buffering 2024-10-31 00:35:34 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.set.innodb-io-capacity 2024-10-31 00:35:34 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.innodb-io-capacity 2024-10-31 00:35:34 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.set.innodb-file-per-table 2024-10-31 00:35:34 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.innodb-file-per-table 2024-10-31 00:35:34 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.set.tuning-level 2024-10-31 00:35:34 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.tuning-level 2024-10-31 00:35:34 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.set.table-open-cache 2024-10-31 00:35:34 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.table-open-cache 2024-10-31 00:35:34 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.set.max-connections 2024-10-31 00:35:34 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.enable-binlogs 2024-10-31 00:35:34 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.set.binlogs-path 2024-10-31 00:35:34 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.binlogs-path 2024-10-31 00:35:34 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.set.binlogs-max-size 2024-10-31 00:35:34 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.binlogs-max-size 2024-10-31 00:35:34 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.set.binlogs-expire-days 2024-10-31 00:35:34 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.binlogs-expire-days 2024-10-31 00:35:34 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.prefer-ipv6 2024-10-31 00:35:34 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.set.wait-timeout 2024-10-31 00:35:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.wait-timeout 2024-10-31 00:35:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.os-db-router-hostname 2024-10-31 00:35:35 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: Initializing Snap Layer 2024-10-31 00:35:35 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: coordinator.DelayedActionCoordinator Loading state 2024-10-31 00:35:35 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: Coordinator: Initializing coordinator layer 2024-10-31 00:35:35 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: Initializing Leadership Layer (is follower) 2024-10-31 00:35:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: cleared flag leadership.changed.mysql-heat.passwd 2024-10-31 00:35:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: cleared flag leadership.changed 2024-10-31 00:35:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer> tracer: starting handler dispatch, 98 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-17-134-150 tracer: set flag leadership.set.cluster-instance-clustered-252-17-137-230 tracer: set flag leadership.set.cluster-instance-clustered-252-17-186-134 tracer: set flag leadership.set.cluster-instance-configured-252-17-134-150 tracer: set flag leadership.set.cluster-instance-configured-252-17-137-230 tracer: set flag leadership.set.cluster-instance-configured-252-17-186-134 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 00:35:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: hooks phase, 0 handlers queued 2024-10-31 00:35:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:35:35 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-10-31 00:35:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: Found peers: 252.17.134.150,252.17.186.134 2024-10-31 00:35:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: Expect 2 peers 2024-10-31 00:35:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: Reached quorum 2024-10-31 00:35:35 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:35:35 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-10-31 00:35:35 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-10-31 00:35:35 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-10-31 00:35:35 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router 2024-10-31 00:35:35 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:35:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: Running _assess_status() 2024-10-31 00:35:36 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-10-31 00:35:36 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-changed logger.go:60 active 2024-10-31 00:35:36 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: Opening db connection for root@localhost 2024-10-31 00:35:36 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: Checking cluster status. 2024-10-31 00:35:36 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for mysql-innodb-cluster/2 : {39 {map[nova-mysql-router/0:{1}] map[] []}} 2024-10-31 00:35:37 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: Opening db connection for root@None 2024-10-31 00:35:37 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: coordinator.DelayedActionCoordinator Publishing state 2024-10-31 00:35:37 INFO juju.worker.uniter.operation runhook.go:159 ran "db-router-relation-changed" hook (via explicit, bespoke hook script) 2024-10-31 00:35:37 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (41; unit: neutron-mysql-router/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:35:37 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 00:35:37 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run relation-changed (41; unit: neutron-mysql-router/0) hook) 2024-10-31 00:35:37 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 00:35:37 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 00:35:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-10-31 00:35:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-10-31 00:35:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 00:35:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 00:35:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-10-31 00:35:37 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (39; unit: nova-mysql-router/0) hook for mysql-innodb-cluster/2 2024-10-31 00:35:37 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run relation-changed (39; unit: nova-mysql-router/0) hook) 2024-10-31 00:35:37 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run relation-changed (39; unit: nova-mysql-router/0) hook) 2024-10-31 00:35:37 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (39; unit: nova-mysql-router/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:35:38 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (39; unit: nova-mysql-router/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:35:38 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running db-router-relation-changed hook for nova-mysql-router/0 2024-10-31 00:35:38 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 00:35:38 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: Reactive main running for hook db-router-relation-changed 2024-10-31 00:35:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:35:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.ssl_cert 2024-10-31 00:35:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.ssl_key 2024-10-31 00:35:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.ssl_ca 2024-10-31 00:35:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.set.source 2024-10-31 00:35:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.source 2024-10-31 00:35:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.set.cluster-name 2024-10-31 00:35:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.cluster-name 2024-10-31 00:35:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.set.auto-rejoin-tries 2024-10-31 00:35:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.auto-rejoin-tries 2024-10-31 00:35:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.set.expel-timeout 2024-10-31 00:35:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.expel-timeout 2024-10-31 00:35:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.set.innodb-buffer-pool-size 2024-10-31 00:35:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.set.innodb-change-buffering 2024-10-31 00:35:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.innodb-change-buffering 2024-10-31 00:35:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.set.innodb-io-capacity 2024-10-31 00:35:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.innodb-io-capacity 2024-10-31 00:35:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.set.innodb-file-per-table 2024-10-31 00:35:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.innodb-file-per-table 2024-10-31 00:35:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.set.tuning-level 2024-10-31 00:35:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.tuning-level 2024-10-31 00:35:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.set.table-open-cache 2024-10-31 00:35:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.table-open-cache 2024-10-31 00:35:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.set.max-connections 2024-10-31 00:35:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.enable-binlogs 2024-10-31 00:35:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.set.binlogs-path 2024-10-31 00:35:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.binlogs-path 2024-10-31 00:35:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.set.binlogs-max-size 2024-10-31 00:35:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.binlogs-max-size 2024-10-31 00:35:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.set.binlogs-expire-days 2024-10-31 00:35:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.binlogs-expire-days 2024-10-31 00:35:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.prefer-ipv6 2024-10-31 00:35:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.set.wait-timeout 2024-10-31 00:35:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.wait-timeout 2024-10-31 00:35:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.os-db-router-hostname 2024-10-31 00:35:40 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: Initializing Snap Layer 2024-10-31 00:35:40 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: coordinator.DelayedActionCoordinator Loading state 2024-10-31 00:35:40 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: Coordinator: Initializing coordinator layer 2024-10-31 00:35:40 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: Initializing Leadership Layer (is follower) 2024-10-31 00:35:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer> tracer: starting handler dispatch, 98 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-17-134-150 tracer: set flag leadership.set.cluster-instance-clustered-252-17-137-230 tracer: set flag leadership.set.cluster-instance-clustered-252-17-186-134 tracer: set flag leadership.set.cluster-instance-configured-252-17-134-150 tracer: set flag leadership.set.cluster-instance-configured-252-17-137-230 tracer: set flag leadership.set.cluster-instance-configured-252-17-186-134 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 00:35:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: hooks phase, 0 handlers queued 2024-10-31 00:35:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:35:40 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-10-31 00:35:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: Found peers: 252.17.134.150,252.17.186.134 2024-10-31 00:35:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: Expect 2 peers 2024-10-31 00:35:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: Reached quorum 2024-10-31 00:35:40 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:35:40 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-10-31 00:35:40 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-10-31 00:35:40 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-10-31 00:35:40 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router 2024-10-31 00:35:40 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:35:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: Running _assess_status() 2024-10-31 00:35:41 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-10-31 00:35:41 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-changed logger.go:60 active 2024-10-31 00:35:41 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: Opening db connection for root@localhost 2024-10-31 00:35:41 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: Checking cluster status. 2024-10-31 00:35:42 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: Opening db connection for root@None 2024-10-31 00:35:42 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: coordinator.DelayedActionCoordinator Publishing state 2024-10-31 00:35:42 INFO juju.worker.uniter.operation runhook.go:159 ran "db-router-relation-changed" hook (via explicit, bespoke hook script) 2024-10-31 00:35:42 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (39; unit: nova-mysql-router/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:35:42 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 00:35:42 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run relation-changed (39; unit: nova-mysql-router/0) hook) 2024-10-31 00:35:42 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 00:35:42 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 00:35:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-10-31 00:35:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-10-31 00:35:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 00:35:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 00:35:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-10-31 00:35:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 00:35:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 00:35:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-10-31 00:35:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-10-31 00:35:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-10-31 00:35:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-10-31 00:35:42 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 2024-10-31 00:35:43 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 00:35:43 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 00:35:43 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 00:35:43 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-10-31 00:35:43 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 00:35:43 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 00:35:43 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-10-31 00:35:43 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-10-31 00:35:43 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-10-31 00:35:43 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-10-31 00:35:43 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-10-31 00:35:43 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-10-31 00:36:16 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for mysql-innodb-cluster/2 : {41 {map[neutron-mysql-router/0:{2}] map[] []}} 2024-10-31 00:36:16 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 00:36:16 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-10-31 00:36:16 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-10-31 00:36:16 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-10-31 00:36:16 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 00:36:16 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 00:36:16 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-10-31 00:36:16 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-10-31 00:36:16 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (41; unit: neutron-mysql-router/0) hook for mysql-innodb-cluster/2 2024-10-31 00:36:16 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run relation-changed (41; unit: neutron-mysql-router/0) hook) 2024-10-31 00:36:16 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run relation-changed (41; unit: neutron-mysql-router/0) hook) 2024-10-31 00:36:16 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (41; unit: neutron-mysql-router/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:36:16 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (41; unit: neutron-mysql-router/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:36:16 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running db-router-relation-changed hook for neutron-mysql-router/0 2024-10-31 00:36:16 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 00:36:17 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: Reactive main running for hook db-router-relation-changed 2024-10-31 00:36:17 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:36:17 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.ssl_cert 2024-10-31 00:36:17 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.ssl_key 2024-10-31 00:36:17 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.ssl_ca 2024-10-31 00:36:17 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.set.source 2024-10-31 00:36:17 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.source 2024-10-31 00:36:17 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.set.cluster-name 2024-10-31 00:36:17 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.cluster-name 2024-10-31 00:36:17 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.set.auto-rejoin-tries 2024-10-31 00:36:17 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.auto-rejoin-tries 2024-10-31 00:36:17 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.set.expel-timeout 2024-10-31 00:36:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.expel-timeout 2024-10-31 00:36:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.set.innodb-buffer-pool-size 2024-10-31 00:36:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.set.innodb-change-buffering 2024-10-31 00:36:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.innodb-change-buffering 2024-10-31 00:36:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.set.innodb-io-capacity 2024-10-31 00:36:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.innodb-io-capacity 2024-10-31 00:36:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.set.innodb-file-per-table 2024-10-31 00:36:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.innodb-file-per-table 2024-10-31 00:36:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.set.tuning-level 2024-10-31 00:36:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.tuning-level 2024-10-31 00:36:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.set.table-open-cache 2024-10-31 00:36:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.table-open-cache 2024-10-31 00:36:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.set.max-connections 2024-10-31 00:36:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.enable-binlogs 2024-10-31 00:36:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.set.binlogs-path 2024-10-31 00:36:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.binlogs-path 2024-10-31 00:36:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.set.binlogs-max-size 2024-10-31 00:36:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.binlogs-max-size 2024-10-31 00:36:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.set.binlogs-expire-days 2024-10-31 00:36:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.binlogs-expire-days 2024-10-31 00:36:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.prefer-ipv6 2024-10-31 00:36:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.set.wait-timeout 2024-10-31 00:36:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.wait-timeout 2024-10-31 00:36:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: set flag config.default.os-db-router-hostname 2024-10-31 00:36:18 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: Initializing Snap Layer 2024-10-31 00:36:18 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: coordinator.DelayedActionCoordinator Loading state 2024-10-31 00:36:18 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: Coordinator: Initializing coordinator layer 2024-10-31 00:36:18 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: Initializing Leadership Layer (is follower) 2024-10-31 00:36:19 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer> tracer: starting handler dispatch, 98 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-17-134-150 tracer: set flag leadership.set.cluster-instance-clustered-252-17-137-230 tracer: set flag leadership.set.cluster-instance-clustered-252-17-186-134 tracer: set flag leadership.set.cluster-instance-configured-252-17-134-150 tracer: set flag leadership.set.cluster-instance-configured-252-17-137-230 tracer: set flag leadership.set.cluster-instance-configured-252-17-186-134 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 00:36:19 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer: hooks phase, 0 handlers queued 2024-10-31 00:36:19 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:36:19 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-10-31 00:36:19 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: Found peers: 252.17.134.150,252.17.186.134 2024-10-31 00:36:19 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: Expect 2 peers 2024-10-31 00:36:19 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: Reached quorum 2024-10-31 00:36:19 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:36:19 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-10-31 00:36:19 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-10-31 00:36:19 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-10-31 00:36:19 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router 2024-10-31 00:36:19 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:36:19 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: Running _assess_status() 2024-10-31 00:36:19 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-10-31 00:36:19 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-changed logger.go:60 active 2024-10-31 00:36:19 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: Opening db connection for root@localhost 2024-10-31 00:36:19 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: Checking cluster status. 2024-10-31 00:36:20 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: Opening db connection for root@None 2024-10-31 00:36:20 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:41: coordinator.DelayedActionCoordinator Publishing state 2024-10-31 00:36:21 INFO juju.worker.uniter.operation runhook.go:159 ran "db-router-relation-changed" hook (via explicit, bespoke hook script) 2024-10-31 00:36:21 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (41; unit: neutron-mysql-router/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:36:21 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 00:36:21 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run relation-changed (41; unit: neutron-mysql-router/0) hook) 2024-10-31 00:36:21 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 00:36:21 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 00:36:21 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-10-31 00:36:21 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 00:36:21 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 00:36:21 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-10-31 00:36:21 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-10-31 00:36:21 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-10-31 00:36:21 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 00:36:21 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 00:36:21 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-10-31 00:36:21 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-10-31 00:36:21 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-10-31 00:36:21 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 2024-10-31 00:36:22 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for mysql-innodb-cluster/2: ok=true 2024-10-31 00:36:22 DEBUG juju.worker.uniter.operation executor.go:85 running operation run leader-settings-changed hook for mysql-innodb-cluster/2 2024-10-31 00:36:22 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run leader-settings-changed hook) 2024-10-31 00:36:22 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run leader-settings-changed hook) 2024-10-31 00:36:22 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run leader-settings-changed hook" for mysql-innodb-cluster/2 2024-10-31 00:36:22 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run leader-settings-changed hook" for mysql-innodb-cluster/2 2024-10-31 00:36:22 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running leader-settings-changed hook 2024-10-31 00:36:22 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 00:36:23 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Reactive main running for hook leader-settings-changed 2024-10-31 00:36:23 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Initializing Snap Layer 2024-10-31 00:36:23 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator.DelayedActionCoordinator Loading state 2024-10-31 00:36:23 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Coordinator: Initializing coordinator layer 2024-10-31 00:36:23 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Initializing Leadership Layer (is follower) 2024-10-31 00:36:23 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: set flag leadership.changed.mysql-neutron.passwd tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:36:23 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag leadership.set.mysql-neutron.passwd 2024-10-31 00:36:23 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag leadership.changed 2024-10-31 00:36:23 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: starting handler dispatch, 66 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.connected tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.changed tracer: set flag leadership.changed.mysql-neutron.passwd tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-17-134-150 tracer: set flag leadership.set.cluster-instance-clustered-252-17-137-230 tracer: set flag leadership.set.cluster-instance-clustered-252-17-186-134 tracer: set flag leadership.set.cluster-instance-configured-252-17-134-150 tracer: set flag leadership.set.cluster-instance-configured-252-17-137-230 tracer: set flag leadership.set.cluster-instance-configured-252-17-186-134 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 00:36:23 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-10-31 00:36:23 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:36:23 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-10-31 00:36:23 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Found peers: 252.17.134.150,252.17.186.134 2024-10-31 00:36:23 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Expect 2 peers 2024-10-31 00:36:23 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Reached quorum 2024-10-31 00:36:23 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:36:23 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-10-31 00:36:23 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-10-31 00:36:23 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-10-31 00:36:23 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router 2024-10-31 00:36:23 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:36:24 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Running _assess_status() 2024-10-31 00:36:24 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-10-31 00:36:24 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 active 2024-10-31 00:36:24 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Opening db connection for root@localhost 2024-10-31 00:36:24 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Checking cluster status. 2024-10-31 00:36:25 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Opening db connection for root@None 2024-10-31 00:36:25 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator.DelayedActionCoordinator Publishing state 2024-10-31 00:36:25 INFO juju.worker.uniter.operation runhook.go:159 ran "leader-settings-changed" hook (via explicit, bespoke hook script) 2024-10-31 00:36:25 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run leader-settings-changed hook" for mysql-innodb-cluster/2 2024-10-31 00:36:25 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 00:36:25 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run leader-settings-changed hook) 2024-10-31 00:36:25 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 00:36:25 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 00:36:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-10-31 00:36:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-10-31 00:36:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-10-31 00:36:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 00:36:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 00:36:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-10-31 00:36:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-10-31 00:36:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-10-31 00:36:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-10-31 00:36:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 00:36:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 00:36:25 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 2024-10-31 00:36:30 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for mysql-innodb-cluster/2 2024-10-31 00:36:30 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 00:36:30 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-10-31 00:36:30 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 00:36:30 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 00:36:30 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 00:36:30 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 00:36:30 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-10-31 00:36:30 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-10-31 00:36:30 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-10-31 00:36:30 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-10-31 00:36:30 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-10-31 00:36:30 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-10-31 00:36:30 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for mysql-innodb-cluster/2 2024-10-31 00:36:30 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run update-status hook) 2024-10-31 00:36:30 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run update-status hook) 2024-10-31 00:36:30 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for mysql-innodb-cluster/2 2024-10-31 00:36:30 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for mysql-innodb-cluster/2 2024-10-31 00:36:30 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 00:36:31 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Reactive main running for hook update-status 2024-10-31 00:36:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:36:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.ssl_cert 2024-10-31 00:36:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.ssl_key 2024-10-31 00:36:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.ssl_ca 2024-10-31 00:36:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.source 2024-10-31 00:36:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.source 2024-10-31 00:36:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.cluster-name 2024-10-31 00:36:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.cluster-name 2024-10-31 00:36:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.auto-rejoin-tries 2024-10-31 00:36:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.auto-rejoin-tries 2024-10-31 00:36:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.expel-timeout 2024-10-31 00:36:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.expel-timeout 2024-10-31 00:36:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-buffer-pool-size 2024-10-31 00:36:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-change-buffering 2024-10-31 00:36:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.innodb-change-buffering 2024-10-31 00:36:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-io-capacity 2024-10-31 00:36:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.innodb-io-capacity 2024-10-31 00:36:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-file-per-table 2024-10-31 00:36:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.innodb-file-per-table 2024-10-31 00:36:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.tuning-level 2024-10-31 00:36:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.tuning-level 2024-10-31 00:36:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.table-open-cache 2024-10-31 00:36:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.table-open-cache 2024-10-31 00:36:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.max-connections 2024-10-31 00:36:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.enable-binlogs 2024-10-31 00:36:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.binlogs-path 2024-10-31 00:36:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.binlogs-path 2024-10-31 00:36:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.binlogs-max-size 2024-10-31 00:36:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.binlogs-max-size 2024-10-31 00:36:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.binlogs-expire-days 2024-10-31 00:36:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.binlogs-expire-days 2024-10-31 00:36:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.prefer-ipv6 2024-10-31 00:36:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.wait-timeout 2024-10-31 00:36:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.wait-timeout 2024-10-31 00:36:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.os-db-router-hostname 2024-10-31 00:36:32 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Initializing Snap Layer 2024-10-31 00:36:32 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator.DelayedActionCoordinator Loading state 2024-10-31 00:36:32 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Coordinator: Initializing coordinator layer 2024-10-31 00:36:32 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Initializing Leadership Layer (is follower) 2024-10-31 00:36:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: cleared flag leadership.changed.mysql-neutron.passwd 2024-10-31 00:36:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: cleared flag leadership.changed 2024-10-31 00:36:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: starting handler dispatch, 99 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-17-134-150 tracer: set flag leadership.set.cluster-instance-clustered-252-17-137-230 tracer: set flag leadership.set.cluster-instance-clustered-252-17-186-134 tracer: set flag leadership.set.cluster-instance-configured-252-17-134-150 tracer: set flag leadership.set.cluster-instance-configured-252-17-137-230 tracer: set flag leadership.set.cluster-instance-configured-252-17-186-134 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 00:36:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:64:default_update_status 2024-10-31 00:36:32 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:64:default_update_status 2024-10-31 00:36:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag run-default-update-status 2024-10-31 00:36:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag is-update-status-hook 2024-10-31 00:36:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: main dispatch loop, 9 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:82:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:93:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:36:32 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:82:check_really_is_update_status 2024-10-31 00:36:32 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:93:run_default_update_status 2024-10-31 00:36:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:93:run_default_update_status 2024-10-31 00:36:32 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-10-31 00:36:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Found peers: 252.17.134.150,252.17.186.134 2024-10-31 00:36:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Expect 2 peers 2024-10-31 00:36:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Reached quorum 2024-10-31 00:36:32 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:36:32 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-10-31 00:36:32 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-10-31 00:36:32 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-10-31 00:36:32 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router 2024-10-31 00:36:33 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:36:33 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Running _assess_status() 2024-10-31 00:36:33 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-10-31 00:36:33 DEBUG unit.mysql-innodb-cluster/2.update-status logger.go:60 active 2024-10-31 00:36:33 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Opening db connection for root@localhost 2024-10-31 00:36:33 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Checking cluster status. 2024-10-31 00:36:34 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Opening db connection for root@None 2024-10-31 00:36:34 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:36:34 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator.DelayedActionCoordinator Publishing state 2024-10-31 00:36:34 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-10-31 00:36:34 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for mysql-innodb-cluster/2 2024-10-31 00:36:34 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 00:36:34 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run update-status hook) 2024-10-31 00:36:34 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 00:36:34 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 00:36:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-10-31 00:36:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-10-31 00:36:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-10-31 00:36:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-10-31 00:36:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 00:36:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 00:36:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-10-31 00:36:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-10-31 00:36:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-10-31 00:36:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 00:36:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 00:39:24 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for mysql-innodb-cluster/2 : {39 {map[nova-mysql-router/0:{2}] map[] []}} 2024-10-31 00:39:24 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 00:39:24 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-10-31 00:39:24 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-10-31 00:39:24 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-10-31 00:39:24 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-10-31 00:39:24 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (39; unit: nova-mysql-router/0) hook for mysql-innodb-cluster/2 2024-10-31 00:39:24 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run relation-changed (39; unit: nova-mysql-router/0) hook) 2024-10-31 00:39:24 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run relation-changed (39; unit: nova-mysql-router/0) hook) 2024-10-31 00:39:24 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (39; unit: nova-mysql-router/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:39:24 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (39; unit: nova-mysql-router/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:39:24 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running db-router-relation-changed hook for nova-mysql-router/0 2024-10-31 00:39:24 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 00:39:25 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: Reactive main running for hook db-router-relation-changed 2024-10-31 00:39:25 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer> tracer: set flag endpoint.db-router.changed.nova_database tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:39:25 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag endpoint.db-router.changed.nova_hostname 2024-10-31 00:39:25 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag endpoint.db-router.changed.nova_username 2024-10-31 00:39:25 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag endpoint.db-router.changed.novacell0_database 2024-10-31 00:39:25 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag endpoint.db-router.changed.novacell0_hostname 2024-10-31 00:39:25 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag endpoint.db-router.changed.novacell0_username 2024-10-31 00:39:25 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.snapd_refresh 2024-10-31 00:39:25 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.ssl_cert 2024-10-31 00:39:25 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.ssl_key 2024-10-31 00:39:25 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.ssl_ca 2024-10-31 00:39:26 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.set.source 2024-10-31 00:39:26 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.source 2024-10-31 00:39:26 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.set.cluster-name 2024-10-31 00:39:26 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.cluster-name 2024-10-31 00:39:26 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.set.auto-rejoin-tries 2024-10-31 00:39:26 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.auto-rejoin-tries 2024-10-31 00:39:26 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.set.expel-timeout 2024-10-31 00:39:26 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.expel-timeout 2024-10-31 00:39:26 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.set.innodb-buffer-pool-size 2024-10-31 00:39:26 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.set.innodb-change-buffering 2024-10-31 00:39:26 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.innodb-change-buffering 2024-10-31 00:39:26 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.set.innodb-io-capacity 2024-10-31 00:39:26 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.innodb-io-capacity 2024-10-31 00:39:26 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.set.innodb-file-per-table 2024-10-31 00:39:26 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.innodb-file-per-table 2024-10-31 00:39:26 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.set.tuning-level 2024-10-31 00:39:26 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.tuning-level 2024-10-31 00:39:26 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.set.table-open-cache 2024-10-31 00:39:26 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.table-open-cache 2024-10-31 00:39:26 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.set.max-connections 2024-10-31 00:39:26 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.enable-binlogs 2024-10-31 00:39:26 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.set.binlogs-path 2024-10-31 00:39:26 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.binlogs-path 2024-10-31 00:39:26 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.set.binlogs-max-size 2024-10-31 00:39:26 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.binlogs-max-size 2024-10-31 00:39:26 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.set.binlogs-expire-days 2024-10-31 00:39:26 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.binlogs-expire-days 2024-10-31 00:39:26 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.prefer-ipv6 2024-10-31 00:39:26 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.set.wait-timeout 2024-10-31 00:39:26 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.wait-timeout 2024-10-31 00:39:26 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: set flag config.default.os-db-router-hostname 2024-10-31 00:39:26 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: Initializing Snap Layer 2024-10-31 00:39:27 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: coordinator.DelayedActionCoordinator Loading state 2024-10-31 00:39:27 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: Coordinator: Initializing coordinator layer 2024-10-31 00:39:27 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: Initializing Leadership Layer (is follower) 2024-10-31 00:39:27 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer> tracer: starting handler dispatch, 105 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-17-134-150 tracer: set flag leadership.set.cluster-instance-clustered-252-17-137-230 tracer: set flag leadership.set.cluster-instance-clustered-252-17-186-134 tracer: set flag leadership.set.cluster-instance-configured-252-17-134-150 tracer: set flag leadership.set.cluster-instance-configured-252-17-137-230 tracer: set flag leadership.set.cluster-instance-configured-252-17-186-134 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 00:39:27 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer: hooks phase, 0 handlers queued 2024-10-31 00:39:27 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:39:27 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-10-31 00:39:27 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: Found peers: 252.17.134.150,252.17.186.134 2024-10-31 00:39:27 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: Expect 2 peers 2024-10-31 00:39:27 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: Reached quorum 2024-10-31 00:39:27 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:39:27 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-10-31 00:39:27 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-10-31 00:39:27 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-10-31 00:39:27 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router 2024-10-31 00:39:27 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:39:27 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: Running _assess_status() 2024-10-31 00:39:27 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-10-31 00:39:27 DEBUG unit.mysql-innodb-cluster/2.db-router-relation-changed logger.go:60 active 2024-10-31 00:39:27 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: Opening db connection for root@localhost 2024-10-31 00:39:27 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: Checking cluster status. 2024-10-31 00:39:28 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: Opening db connection for root@None 2024-10-31 00:39:28 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 db-router:39: coordinator.DelayedActionCoordinator Publishing state 2024-10-31 00:39:29 INFO juju.worker.uniter.operation runhook.go:159 ran "db-router-relation-changed" hook (via explicit, bespoke hook script) 2024-10-31 00:39:29 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (39; unit: nova-mysql-router/0) hook" for mysql-innodb-cluster/2 2024-10-31 00:39:29 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 00:39:29 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run relation-changed (39; unit: nova-mysql-router/0) hook) 2024-10-31 00:39:29 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 00:39:29 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 00:39:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-10-31 00:39:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-10-31 00:39:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-10-31 00:39:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-10-31 00:39:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-10-31 00:39:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 00:39:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 00:39:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-10-31 00:39:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-10-31 00:39:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 00:39:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 00:39:29 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 2024-10-31 00:42:30 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for mysql-innodb-cluster/2 2024-10-31 00:42:30 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 00:42:30 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-10-31 00:42:30 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-10-31 00:42:30 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-10-31 00:42:30 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 00:42:30 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 00:42:30 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-10-31 00:42:30 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 00:42:30 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 00:42:30 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-10-31 00:42:30 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-10-31 00:42:30 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-10-31 00:42:30 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for mysql-innodb-cluster/2 2024-10-31 00:42:30 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run update-status hook) 2024-10-31 00:42:30 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run update-status hook) 2024-10-31 00:42:30 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for mysql-innodb-cluster/2 2024-10-31 00:42:30 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for mysql-innodb-cluster/2 2024-10-31 00:42:30 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 00:42:30 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Reactive main running for hook update-status 2024-10-31 00:42:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:42:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.ssl_cert 2024-10-31 00:42:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.ssl_key 2024-10-31 00:42:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.ssl_ca 2024-10-31 00:42:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.source 2024-10-31 00:42:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.source 2024-10-31 00:42:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.cluster-name 2024-10-31 00:42:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.cluster-name 2024-10-31 00:42:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.auto-rejoin-tries 2024-10-31 00:42:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.auto-rejoin-tries 2024-10-31 00:42:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.expel-timeout 2024-10-31 00:42:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.expel-timeout 2024-10-31 00:42:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-buffer-pool-size 2024-10-31 00:42:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-change-buffering 2024-10-31 00:42:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.innodb-change-buffering 2024-10-31 00:42:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-io-capacity 2024-10-31 00:42:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.innodb-io-capacity 2024-10-31 00:42:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-file-per-table 2024-10-31 00:42:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.innodb-file-per-table 2024-10-31 00:42:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.tuning-level 2024-10-31 00:42:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.tuning-level 2024-10-31 00:42:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.table-open-cache 2024-10-31 00:42:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.table-open-cache 2024-10-31 00:42:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.max-connections 2024-10-31 00:42:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.enable-binlogs 2024-10-31 00:42:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.binlogs-path 2024-10-31 00:42:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.binlogs-path 2024-10-31 00:42:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.binlogs-max-size 2024-10-31 00:42:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.binlogs-max-size 2024-10-31 00:42:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.binlogs-expire-days 2024-10-31 00:42:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.binlogs-expire-days 2024-10-31 00:42:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.prefer-ipv6 2024-10-31 00:42:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.wait-timeout 2024-10-31 00:42:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.wait-timeout 2024-10-31 00:42:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.os-db-router-hostname 2024-10-31 00:42:32 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Initializing Snap Layer 2024-10-31 00:42:32 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator.DelayedActionCoordinator Loading state 2024-10-31 00:42:32 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Coordinator: Initializing coordinator layer 2024-10-31 00:42:32 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Initializing Leadership Layer (is follower) 2024-10-31 00:42:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: starting handler dispatch, 105 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-17-134-150 tracer: set flag leadership.set.cluster-instance-clustered-252-17-137-230 tracer: set flag leadership.set.cluster-instance-clustered-252-17-186-134 tracer: set flag leadership.set.cluster-instance-configured-252-17-134-150 tracer: set flag leadership.set.cluster-instance-configured-252-17-137-230 tracer: set flag leadership.set.cluster-instance-configured-252-17-186-134 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 00:42:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:64:default_update_status 2024-10-31 00:42:32 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:64:default_update_status 2024-10-31 00:42:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag run-default-update-status 2024-10-31 00:42:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag is-update-status-hook 2024-10-31 00:42:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: main dispatch loop, 9 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:82:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:93:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:42:32 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:82:check_really_is_update_status 2024-10-31 00:42:32 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:93:run_default_update_status 2024-10-31 00:42:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:93:run_default_update_status 2024-10-31 00:42:32 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-10-31 00:42:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Found peers: 252.17.134.150,252.17.186.134 2024-10-31 00:42:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Expect 2 peers 2024-10-31 00:42:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Reached quorum 2024-10-31 00:42:32 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:42:32 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-10-31 00:42:32 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-10-31 00:42:32 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-10-31 00:42:32 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router 2024-10-31 00:42:32 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:42:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Running _assess_status() 2024-10-31 00:42:33 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-10-31 00:42:33 DEBUG unit.mysql-innodb-cluster/2.update-status logger.go:60 active 2024-10-31 00:42:33 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Opening db connection for root@localhost 2024-10-31 00:42:33 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Checking cluster status. 2024-10-31 00:42:34 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Opening db connection for root@None 2024-10-31 00:42:34 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:42:34 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator.DelayedActionCoordinator Publishing state 2024-10-31 00:42:35 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-10-31 00:42:35 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for mysql-innodb-cluster/2 2024-10-31 00:42:35 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 00:42:35 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run update-status hook) 2024-10-31 00:42:35 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 00:42:35 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 00:42:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-10-31 00:42:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 00:42:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 00:42:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-10-31 00:42:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-10-31 00:42:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-10-31 00:42:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 00:42:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 00:42:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-10-31 00:42:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-10-31 00:42:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-10-31 00:47:03 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for mysql-innodb-cluster/2 2024-10-31 00:47:03 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 00:47:03 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-10-31 00:47:03 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-10-31 00:47:03 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-10-31 00:47:03 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-10-31 00:47:03 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-10-31 00:47:03 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-10-31 00:47:03 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 00:47:03 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 00:47:03 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 00:47:03 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 00:47:03 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-10-31 00:47:03 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for mysql-innodb-cluster/2 2024-10-31 00:47:03 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run update-status hook) 2024-10-31 00:47:03 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run update-status hook) 2024-10-31 00:47:03 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for mysql-innodb-cluster/2 2024-10-31 00:47:03 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for mysql-innodb-cluster/2 2024-10-31 00:47:03 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 00:47:03 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Reactive main running for hook update-status 2024-10-31 00:47:03 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:47:03 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.ssl_cert 2024-10-31 00:47:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.ssl_key 2024-10-31 00:47:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.ssl_ca 2024-10-31 00:47:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.source 2024-10-31 00:47:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.source 2024-10-31 00:47:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.cluster-name 2024-10-31 00:47:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.cluster-name 2024-10-31 00:47:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.auto-rejoin-tries 2024-10-31 00:47:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.auto-rejoin-tries 2024-10-31 00:47:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.expel-timeout 2024-10-31 00:47:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.expel-timeout 2024-10-31 00:47:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-buffer-pool-size 2024-10-31 00:47:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-change-buffering 2024-10-31 00:47:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.innodb-change-buffering 2024-10-31 00:47:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-io-capacity 2024-10-31 00:47:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.innodb-io-capacity 2024-10-31 00:47:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-file-per-table 2024-10-31 00:47:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.innodb-file-per-table 2024-10-31 00:47:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.tuning-level 2024-10-31 00:47:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.tuning-level 2024-10-31 00:47:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.table-open-cache 2024-10-31 00:47:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.table-open-cache 2024-10-31 00:47:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.max-connections 2024-10-31 00:47:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.enable-binlogs 2024-10-31 00:47:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.binlogs-path 2024-10-31 00:47:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.binlogs-path 2024-10-31 00:47:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.binlogs-max-size 2024-10-31 00:47:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.binlogs-max-size 2024-10-31 00:47:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.binlogs-expire-days 2024-10-31 00:47:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.binlogs-expire-days 2024-10-31 00:47:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.prefer-ipv6 2024-10-31 00:47:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.wait-timeout 2024-10-31 00:47:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.wait-timeout 2024-10-31 00:47:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.os-db-router-hostname 2024-10-31 00:47:04 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Initializing Snap Layer 2024-10-31 00:47:05 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator.DelayedActionCoordinator Loading state 2024-10-31 00:47:05 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Coordinator: Initializing coordinator layer 2024-10-31 00:47:05 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Initializing Leadership Layer (is follower) 2024-10-31 00:47:05 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: starting handler dispatch, 105 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-17-134-150 tracer: set flag leadership.set.cluster-instance-clustered-252-17-137-230 tracer: set flag leadership.set.cluster-instance-clustered-252-17-186-134 tracer: set flag leadership.set.cluster-instance-configured-252-17-134-150 tracer: set flag leadership.set.cluster-instance-configured-252-17-137-230 tracer: set flag leadership.set.cluster-instance-configured-252-17-186-134 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 00:47:05 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:64:default_update_status 2024-10-31 00:47:05 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:64:default_update_status 2024-10-31 00:47:05 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag run-default-update-status 2024-10-31 00:47:05 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag is-update-status-hook 2024-10-31 00:47:05 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: main dispatch loop, 9 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:82:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:93:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:47:05 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:82:check_really_is_update_status 2024-10-31 00:47:05 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:93:run_default_update_status 2024-10-31 00:47:05 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:93:run_default_update_status 2024-10-31 00:47:05 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-10-31 00:47:05 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Found peers: 252.17.134.150,252.17.186.134 2024-10-31 00:47:05 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Expect 2 peers 2024-10-31 00:47:05 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Reached quorum 2024-10-31 00:47:05 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:47:05 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-10-31 00:47:05 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-10-31 00:47:05 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-10-31 00:47:05 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router 2024-10-31 00:47:05 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:47:05 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Running _assess_status() 2024-10-31 00:47:05 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-10-31 00:47:05 DEBUG unit.mysql-innodb-cluster/2.update-status logger.go:60 active 2024-10-31 00:47:05 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Opening db connection for root@localhost 2024-10-31 00:47:05 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Checking cluster status. 2024-10-31 00:47:07 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Opening db connection for root@None 2024-10-31 00:47:07 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:47:07 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator.DelayedActionCoordinator Publishing state 2024-10-31 00:47:07 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-10-31 00:47:07 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for mysql-innodb-cluster/2 2024-10-31 00:47:07 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 00:47:07 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run update-status hook) 2024-10-31 00:47:07 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 00:47:07 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 00:47:07 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-10-31 00:47:07 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-10-31 00:47:07 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-10-31 00:47:07 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 00:47:07 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 00:47:07 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-10-31 00:47:07 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 00:47:07 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 00:47:07 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-10-31 00:47:07 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-10-31 00:47:07 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-10-31 00:51:16 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for mysql-innodb-cluster/2 2024-10-31 00:51:16 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 00:51:16 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-10-31 00:51:16 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-10-31 00:51:16 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 00:51:16 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 00:51:16 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-10-31 00:51:16 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 00:51:16 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 00:51:16 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-10-31 00:51:16 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-10-31 00:51:16 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-10-31 00:51:16 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-10-31 00:51:16 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for mysql-innodb-cluster/2 2024-10-31 00:51:16 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run update-status hook) 2024-10-31 00:51:16 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run update-status hook) 2024-10-31 00:51:16 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for mysql-innodb-cluster/2 2024-10-31 00:51:16 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for mysql-innodb-cluster/2 2024-10-31 00:51:16 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 00:51:17 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Reactive main running for hook update-status 2024-10-31 00:51:17 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:51:17 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.ssl_cert 2024-10-31 00:51:17 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.ssl_key 2024-10-31 00:51:17 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.ssl_ca 2024-10-31 00:51:17 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.source 2024-10-31 00:51:17 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.source 2024-10-31 00:51:17 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.cluster-name 2024-10-31 00:51:17 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.cluster-name 2024-10-31 00:51:17 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.auto-rejoin-tries 2024-10-31 00:51:17 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.auto-rejoin-tries 2024-10-31 00:51:17 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.expel-timeout 2024-10-31 00:51:17 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.expel-timeout 2024-10-31 00:51:17 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-buffer-pool-size 2024-10-31 00:51:17 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-change-buffering 2024-10-31 00:51:17 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.innodb-change-buffering 2024-10-31 00:51:17 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-io-capacity 2024-10-31 00:51:17 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.innodb-io-capacity 2024-10-31 00:51:17 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-file-per-table 2024-10-31 00:51:17 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.innodb-file-per-table 2024-10-31 00:51:17 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.tuning-level 2024-10-31 00:51:17 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.tuning-level 2024-10-31 00:51:17 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.table-open-cache 2024-10-31 00:51:17 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.table-open-cache 2024-10-31 00:51:17 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.max-connections 2024-10-31 00:51:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.enable-binlogs 2024-10-31 00:51:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.binlogs-path 2024-10-31 00:51:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.binlogs-path 2024-10-31 00:51:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.binlogs-max-size 2024-10-31 00:51:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.binlogs-max-size 2024-10-31 00:51:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.binlogs-expire-days 2024-10-31 00:51:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.binlogs-expire-days 2024-10-31 00:51:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.prefer-ipv6 2024-10-31 00:51:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.wait-timeout 2024-10-31 00:51:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.wait-timeout 2024-10-31 00:51:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.os-db-router-hostname 2024-10-31 00:51:18 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Initializing Snap Layer 2024-10-31 00:51:18 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator.DelayedActionCoordinator Loading state 2024-10-31 00:51:18 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Coordinator: Initializing coordinator layer 2024-10-31 00:51:18 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Initializing Leadership Layer (is follower) 2024-10-31 00:51:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: starting handler dispatch, 105 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-17-134-150 tracer: set flag leadership.set.cluster-instance-clustered-252-17-137-230 tracer: set flag leadership.set.cluster-instance-clustered-252-17-186-134 tracer: set flag leadership.set.cluster-instance-configured-252-17-134-150 tracer: set flag leadership.set.cluster-instance-configured-252-17-137-230 tracer: set flag leadership.set.cluster-instance-configured-252-17-186-134 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 00:51:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:64:default_update_status 2024-10-31 00:51:18 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:64:default_update_status 2024-10-31 00:51:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag run-default-update-status 2024-10-31 00:51:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag is-update-status-hook 2024-10-31 00:51:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: main dispatch loop, 9 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:82:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:93:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:51:18 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:82:check_really_is_update_status 2024-10-31 00:51:18 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:93:run_default_update_status 2024-10-31 00:51:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:93:run_default_update_status 2024-10-31 00:51:18 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-10-31 00:51:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Found peers: 252.17.134.150,252.17.186.134 2024-10-31 00:51:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Expect 2 peers 2024-10-31 00:51:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Reached quorum 2024-10-31 00:51:18 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:51:18 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-10-31 00:51:18 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-10-31 00:51:18 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-10-31 00:51:18 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router 2024-10-31 00:51:18 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:51:18 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Running _assess_status() 2024-10-31 00:51:19 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-10-31 00:51:19 DEBUG unit.mysql-innodb-cluster/2.update-status logger.go:60 active 2024-10-31 00:51:19 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Opening db connection for root@localhost 2024-10-31 00:51:19 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Checking cluster status. 2024-10-31 00:51:20 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Opening db connection for root@None 2024-10-31 00:51:20 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:51:20 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator.DelayedActionCoordinator Publishing state 2024-10-31 00:51:20 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-10-31 00:51:20 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for mysql-innodb-cluster/2 2024-10-31 00:51:20 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 00:51:20 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run update-status hook) 2024-10-31 00:51:20 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 00:51:20 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 00:51:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-10-31 00:51:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-10-31 00:51:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 00:51:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 00:51:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-10-31 00:51:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-10-31 00:51:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-10-31 00:51:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 00:51:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 00:51:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-10-31 00:51:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-10-31 00:57:02 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for mysql-innodb-cluster/2 2024-10-31 00:57:02 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 00:57:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-10-31 00:57:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-10-31 00:57:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-10-31 00:57:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-10-31 00:57:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 00:57:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 00:57:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 00:57:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 00:57:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-10-31 00:57:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-10-31 00:57:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-10-31 00:57:02 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for mysql-innodb-cluster/2 2024-10-31 00:57:02 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run update-status hook) 2024-10-31 00:57:02 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run update-status hook) 2024-10-31 00:57:02 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for mysql-innodb-cluster/2 2024-10-31 00:57:02 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for mysql-innodb-cluster/2 2024-10-31 00:57:02 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 00:57:03 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Reactive main running for hook update-status 2024-10-31 00:57:03 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:57:03 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.ssl_cert 2024-10-31 00:57:03 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.ssl_key 2024-10-31 00:57:03 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.ssl_ca 2024-10-31 00:57:03 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.source 2024-10-31 00:57:03 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.source 2024-10-31 00:57:03 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.cluster-name 2024-10-31 00:57:03 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.cluster-name 2024-10-31 00:57:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.auto-rejoin-tries 2024-10-31 00:57:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.auto-rejoin-tries 2024-10-31 00:57:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.expel-timeout 2024-10-31 00:57:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.expel-timeout 2024-10-31 00:57:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-buffer-pool-size 2024-10-31 00:57:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-change-buffering 2024-10-31 00:57:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.innodb-change-buffering 2024-10-31 00:57:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-io-capacity 2024-10-31 00:57:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.innodb-io-capacity 2024-10-31 00:57:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-file-per-table 2024-10-31 00:57:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.innodb-file-per-table 2024-10-31 00:57:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.tuning-level 2024-10-31 00:57:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.tuning-level 2024-10-31 00:57:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.table-open-cache 2024-10-31 00:57:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.table-open-cache 2024-10-31 00:57:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.max-connections 2024-10-31 00:57:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.enable-binlogs 2024-10-31 00:57:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.binlogs-path 2024-10-31 00:57:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.binlogs-path 2024-10-31 00:57:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.binlogs-max-size 2024-10-31 00:57:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.binlogs-max-size 2024-10-31 00:57:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.binlogs-expire-days 2024-10-31 00:57:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.binlogs-expire-days 2024-10-31 00:57:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.prefer-ipv6 2024-10-31 00:57:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.wait-timeout 2024-10-31 00:57:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.wait-timeout 2024-10-31 00:57:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.os-db-router-hostname 2024-10-31 00:57:04 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Initializing Snap Layer 2024-10-31 00:57:04 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator.DelayedActionCoordinator Loading state 2024-10-31 00:57:04 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Coordinator: Initializing coordinator layer 2024-10-31 00:57:04 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Initializing Leadership Layer (is follower) 2024-10-31 00:57:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: starting handler dispatch, 105 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-17-134-150 tracer: set flag leadership.set.cluster-instance-clustered-252-17-137-230 tracer: set flag leadership.set.cluster-instance-clustered-252-17-186-134 tracer: set flag leadership.set.cluster-instance-configured-252-17-134-150 tracer: set flag leadership.set.cluster-instance-configured-252-17-137-230 tracer: set flag leadership.set.cluster-instance-configured-252-17-186-134 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 00:57:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:64:default_update_status 2024-10-31 00:57:04 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:64:default_update_status 2024-10-31 00:57:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag run-default-update-status 2024-10-31 00:57:05 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag is-update-status-hook 2024-10-31 00:57:05 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: main dispatch loop, 9 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:82:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:93:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:57:05 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:82:check_really_is_update_status 2024-10-31 00:57:05 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:93:run_default_update_status 2024-10-31 00:57:05 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:93:run_default_update_status 2024-10-31 00:57:05 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-10-31 00:57:05 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Found peers: 252.17.134.150,252.17.186.134 2024-10-31 00:57:05 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Expect 2 peers 2024-10-31 00:57:05 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Reached quorum 2024-10-31 00:57:05 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:57:05 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-10-31 00:57:05 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-10-31 00:57:05 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-10-31 00:57:05 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router 2024-10-31 00:57:05 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 00:57:05 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Running _assess_status() 2024-10-31 00:57:05 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-10-31 00:57:05 DEBUG unit.mysql-innodb-cluster/2.update-status logger.go:60 active 2024-10-31 00:57:05 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Opening db connection for root@localhost 2024-10-31 00:57:05 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Checking cluster status. 2024-10-31 00:57:06 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Opening db connection for root@None 2024-10-31 00:57:06 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 00:57:06 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator.DelayedActionCoordinator Publishing state 2024-10-31 00:57:07 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-10-31 00:57:07 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for mysql-innodb-cluster/2 2024-10-31 00:57:07 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 00:57:07 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run update-status hook) 2024-10-31 00:57:07 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 00:57:07 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 00:57:07 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-10-31 00:57:07 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 00:57:07 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 00:57:07 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-10-31 00:57:07 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-10-31 00:57:07 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 00:57:07 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 00:57:07 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-10-31 00:57:07 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-10-31 00:57:07 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-10-31 00:57:07 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-10-31 01:03:01 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for mysql-innodb-cluster/2 2024-10-31 01:03:01 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 01:03:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-10-31 01:03:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-10-31 01:03:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-10-31 01:03:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-10-31 01:03:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-10-31 01:03:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 01:03:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 01:03:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-10-31 01:03:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 01:03:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 01:03:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-10-31 01:03:01 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for mysql-innodb-cluster/2 2024-10-31 01:03:01 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run update-status hook) 2024-10-31 01:03:01 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run update-status hook) 2024-10-31 01:03:01 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for mysql-innodb-cluster/2 2024-10-31 01:03:01 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for mysql-innodb-cluster/2 2024-10-31 01:03:01 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 01:03:01 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Reactive main running for hook update-status 2024-10-31 01:03:02 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 01:03:02 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.ssl_cert 2024-10-31 01:03:02 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.ssl_key 2024-10-31 01:03:02 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.ssl_ca 2024-10-31 01:03:02 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.source 2024-10-31 01:03:02 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.source 2024-10-31 01:03:02 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.cluster-name 2024-10-31 01:03:02 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.cluster-name 2024-10-31 01:03:02 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.auto-rejoin-tries 2024-10-31 01:03:02 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.auto-rejoin-tries 2024-10-31 01:03:02 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.expel-timeout 2024-10-31 01:03:02 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.expel-timeout 2024-10-31 01:03:02 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-buffer-pool-size 2024-10-31 01:03:02 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-change-buffering 2024-10-31 01:03:02 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.innodb-change-buffering 2024-10-31 01:03:02 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-io-capacity 2024-10-31 01:03:02 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.innodb-io-capacity 2024-10-31 01:03:02 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-file-per-table 2024-10-31 01:03:02 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.innodb-file-per-table 2024-10-31 01:03:02 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.tuning-level 2024-10-31 01:03:02 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.tuning-level 2024-10-31 01:03:02 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.table-open-cache 2024-10-31 01:03:02 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.table-open-cache 2024-10-31 01:03:02 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.max-connections 2024-10-31 01:03:02 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.enable-binlogs 2024-10-31 01:03:03 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.binlogs-path 2024-10-31 01:03:03 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.binlogs-path 2024-10-31 01:03:03 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.binlogs-max-size 2024-10-31 01:03:03 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.binlogs-max-size 2024-10-31 01:03:03 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.binlogs-expire-days 2024-10-31 01:03:03 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.binlogs-expire-days 2024-10-31 01:03:03 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.prefer-ipv6 2024-10-31 01:03:03 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.wait-timeout 2024-10-31 01:03:03 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.wait-timeout 2024-10-31 01:03:03 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.os-db-router-hostname 2024-10-31 01:03:03 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Initializing Snap Layer 2024-10-31 01:03:03 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator.DelayedActionCoordinator Loading state 2024-10-31 01:03:03 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Coordinator: Initializing coordinator layer 2024-10-31 01:03:03 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Initializing Leadership Layer (is follower) 2024-10-31 01:03:03 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: starting handler dispatch, 105 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-17-134-150 tracer: set flag leadership.set.cluster-instance-clustered-252-17-137-230 tracer: set flag leadership.set.cluster-instance-clustered-252-17-186-134 tracer: set flag leadership.set.cluster-instance-configured-252-17-134-150 tracer: set flag leadership.set.cluster-instance-configured-252-17-137-230 tracer: set flag leadership.set.cluster-instance-configured-252-17-186-134 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 01:03:03 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:64:default_update_status 2024-10-31 01:03:03 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:64:default_update_status 2024-10-31 01:03:03 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag run-default-update-status 2024-10-31 01:03:03 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag is-update-status-hook 2024-10-31 01:03:03 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: main dispatch loop, 9 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:82:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:93:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 01:03:03 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:82:check_really_is_update_status 2024-10-31 01:03:03 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:93:run_default_update_status 2024-10-31 01:03:03 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:93:run_default_update_status 2024-10-31 01:03:03 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-10-31 01:03:03 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Found peers: 252.17.134.150,252.17.186.134 2024-10-31 01:03:03 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Expect 2 peers 2024-10-31 01:03:03 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Reached quorum 2024-10-31 01:03:03 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 01:03:03 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-10-31 01:03:03 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-10-31 01:03:03 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-10-31 01:03:03 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router 2024-10-31 01:03:03 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 01:03:03 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Running _assess_status() 2024-10-31 01:03:04 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-10-31 01:03:04 DEBUG unit.mysql-innodb-cluster/2.update-status logger.go:60 active 2024-10-31 01:03:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Opening db connection for root@localhost 2024-10-31 01:03:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Checking cluster status. 2024-10-31 01:03:05 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Opening db connection for root@None 2024-10-31 01:03:05 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 01:03:05 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator.DelayedActionCoordinator Publishing state 2024-10-31 01:03:06 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-10-31 01:03:06 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for mysql-innodb-cluster/2 2024-10-31 01:03:06 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 01:03:06 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run update-status hook) 2024-10-31 01:03:06 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 01:03:06 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 01:03:06 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-10-31 01:03:06 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-10-31 01:03:06 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 01:03:06 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 01:03:06 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-10-31 01:03:06 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-10-31 01:03:06 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 01:03:06 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 01:03:06 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-10-31 01:03:06 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-10-31 01:03:06 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-10-31 01:08:11 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for mysql-innodb-cluster/2 2024-10-31 01:08:11 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 01:08:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-10-31 01:08:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-10-31 01:08:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-10-31 01:08:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-10-31 01:08:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 01:08:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 01:08:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 01:08:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 01:08:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-10-31 01:08:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-10-31 01:08:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-10-31 01:08:11 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for mysql-innodb-cluster/2 2024-10-31 01:08:11 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run update-status hook) 2024-10-31 01:08:11 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run update-status hook) 2024-10-31 01:08:11 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for mysql-innodb-cluster/2 2024-10-31 01:08:11 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for mysql-innodb-cluster/2 2024-10-31 01:08:11 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 01:08:12 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Reactive main running for hook update-status 2024-10-31 01:08:12 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 01:08:12 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.ssl_cert 2024-10-31 01:08:12 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.ssl_key 2024-10-31 01:08:12 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.ssl_ca 2024-10-31 01:08:12 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.source 2024-10-31 01:08:12 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.source 2024-10-31 01:08:12 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.cluster-name 2024-10-31 01:08:12 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.cluster-name 2024-10-31 01:08:12 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.auto-rejoin-tries 2024-10-31 01:08:12 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.auto-rejoin-tries 2024-10-31 01:08:13 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.expel-timeout 2024-10-31 01:08:13 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.expel-timeout 2024-10-31 01:08:13 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-buffer-pool-size 2024-10-31 01:08:13 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-change-buffering 2024-10-31 01:08:13 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.innodb-change-buffering 2024-10-31 01:08:13 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-io-capacity 2024-10-31 01:08:13 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.innodb-io-capacity 2024-10-31 01:08:13 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-file-per-table 2024-10-31 01:08:13 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.innodb-file-per-table 2024-10-31 01:08:13 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.tuning-level 2024-10-31 01:08:13 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.tuning-level 2024-10-31 01:08:13 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.table-open-cache 2024-10-31 01:08:13 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.table-open-cache 2024-10-31 01:08:13 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.max-connections 2024-10-31 01:08:13 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.enable-binlogs 2024-10-31 01:08:13 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.binlogs-path 2024-10-31 01:08:13 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.binlogs-path 2024-10-31 01:08:13 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.binlogs-max-size 2024-10-31 01:08:13 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.binlogs-max-size 2024-10-31 01:08:13 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.binlogs-expire-days 2024-10-31 01:08:13 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.binlogs-expire-days 2024-10-31 01:08:13 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.prefer-ipv6 2024-10-31 01:08:13 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.wait-timeout 2024-10-31 01:08:13 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.wait-timeout 2024-10-31 01:08:13 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.os-db-router-hostname 2024-10-31 01:08:13 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Initializing Snap Layer 2024-10-31 01:08:13 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator.DelayedActionCoordinator Loading state 2024-10-31 01:08:13 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Coordinator: Initializing coordinator layer 2024-10-31 01:08:13 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Initializing Leadership Layer (is follower) 2024-10-31 01:08:13 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: starting handler dispatch, 105 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-17-134-150 tracer: set flag leadership.set.cluster-instance-clustered-252-17-137-230 tracer: set flag leadership.set.cluster-instance-clustered-252-17-186-134 tracer: set flag leadership.set.cluster-instance-configured-252-17-134-150 tracer: set flag leadership.set.cluster-instance-configured-252-17-137-230 tracer: set flag leadership.set.cluster-instance-configured-252-17-186-134 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 01:08:13 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:64:default_update_status 2024-10-31 01:08:13 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:64:default_update_status 2024-10-31 01:08:13 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag run-default-update-status 2024-10-31 01:08:13 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag is-update-status-hook 2024-10-31 01:08:13 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: main dispatch loop, 9 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:82:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:93:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 01:08:13 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:82:check_really_is_update_status 2024-10-31 01:08:13 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:93:run_default_update_status 2024-10-31 01:08:13 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:93:run_default_update_status 2024-10-31 01:08:13 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-10-31 01:08:14 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Found peers: 252.17.134.150,252.17.186.134 2024-10-31 01:08:14 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Expect 2 peers 2024-10-31 01:08:14 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Reached quorum 2024-10-31 01:08:14 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 01:08:14 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-10-31 01:08:14 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-10-31 01:08:14 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-10-31 01:08:14 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router 2024-10-31 01:08:14 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 01:08:14 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Running _assess_status() 2024-10-31 01:08:14 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-10-31 01:08:14 DEBUG unit.mysql-innodb-cluster/2.update-status logger.go:60 active 2024-10-31 01:08:14 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Opening db connection for root@localhost 2024-10-31 01:08:14 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Checking cluster status. 2024-10-31 01:08:15 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Opening db connection for root@None 2024-10-31 01:08:15 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 01:08:15 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator.DelayedActionCoordinator Publishing state 2024-10-31 01:08:15 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-10-31 01:08:15 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for mysql-innodb-cluster/2 2024-10-31 01:08:15 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 01:08:15 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run update-status hook) 2024-10-31 01:08:15 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 01:08:15 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 01:08:15 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-10-31 01:08:15 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 01:08:15 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 01:08:15 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-10-31 01:08:15 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-10-31 01:08:15 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-10-31 01:08:15 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-10-31 01:08:15 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-10-31 01:08:15 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 01:08:15 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 01:08:15 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-10-31 01:12:34 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for mysql-innodb-cluster/2 2024-10-31 01:12:34 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 01:12:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-10-31 01:12:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-10-31 01:12:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-10-31 01:12:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 01:12:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 01:12:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-10-31 01:12:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 01:12:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 01:12:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-10-31 01:12:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-10-31 01:12:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-10-31 01:12:34 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for mysql-innodb-cluster/2 2024-10-31 01:12:34 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run update-status hook) 2024-10-31 01:12:34 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run update-status hook) 2024-10-31 01:12:34 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for mysql-innodb-cluster/2 2024-10-31 01:12:34 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for mysql-innodb-cluster/2 2024-10-31 01:12:34 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 01:12:35 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Reactive main running for hook update-status 2024-10-31 01:12:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 01:12:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.ssl_cert 2024-10-31 01:12:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.ssl_key 2024-10-31 01:12:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.ssl_ca 2024-10-31 01:12:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.source 2024-10-31 01:12:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.source 2024-10-31 01:12:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.cluster-name 2024-10-31 01:12:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.cluster-name 2024-10-31 01:12:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.auto-rejoin-tries 2024-10-31 01:12:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.auto-rejoin-tries 2024-10-31 01:12:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.expel-timeout 2024-10-31 01:12:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.expel-timeout 2024-10-31 01:12:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-buffer-pool-size 2024-10-31 01:12:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-change-buffering 2024-10-31 01:12:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.innodb-change-buffering 2024-10-31 01:12:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-io-capacity 2024-10-31 01:12:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.innodb-io-capacity 2024-10-31 01:12:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-file-per-table 2024-10-31 01:12:36 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.innodb-file-per-table 2024-10-31 01:12:36 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.tuning-level 2024-10-31 01:12:36 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.tuning-level 2024-10-31 01:12:36 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.table-open-cache 2024-10-31 01:12:36 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.table-open-cache 2024-10-31 01:12:36 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.max-connections 2024-10-31 01:12:36 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.enable-binlogs 2024-10-31 01:12:36 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.binlogs-path 2024-10-31 01:12:36 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.binlogs-path 2024-10-31 01:12:36 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.binlogs-max-size 2024-10-31 01:12:36 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.binlogs-max-size 2024-10-31 01:12:36 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.binlogs-expire-days 2024-10-31 01:12:36 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.binlogs-expire-days 2024-10-31 01:12:36 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.prefer-ipv6 2024-10-31 01:12:36 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.wait-timeout 2024-10-31 01:12:36 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.wait-timeout 2024-10-31 01:12:36 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.os-db-router-hostname 2024-10-31 01:12:36 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Initializing Snap Layer 2024-10-31 01:12:36 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator.DelayedActionCoordinator Loading state 2024-10-31 01:12:36 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Coordinator: Initializing coordinator layer 2024-10-31 01:12:36 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Initializing Leadership Layer (is follower) 2024-10-31 01:12:36 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: starting handler dispatch, 105 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-17-134-150 tracer: set flag leadership.set.cluster-instance-clustered-252-17-137-230 tracer: set flag leadership.set.cluster-instance-clustered-252-17-186-134 tracer: set flag leadership.set.cluster-instance-configured-252-17-134-150 tracer: set flag leadership.set.cluster-instance-configured-252-17-137-230 tracer: set flag leadership.set.cluster-instance-configured-252-17-186-134 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 01:12:36 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:64:default_update_status 2024-10-31 01:12:36 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:64:default_update_status 2024-10-31 01:12:36 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag run-default-update-status 2024-10-31 01:12:36 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag is-update-status-hook 2024-10-31 01:12:36 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: main dispatch loop, 9 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:82:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:93:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 01:12:36 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:82:check_really_is_update_status 2024-10-31 01:12:36 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:93:run_default_update_status 2024-10-31 01:12:36 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:93:run_default_update_status 2024-10-31 01:12:36 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-10-31 01:12:36 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Found peers: 252.17.134.150,252.17.186.134 2024-10-31 01:12:36 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Expect 2 peers 2024-10-31 01:12:36 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Reached quorum 2024-10-31 01:12:36 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 01:12:36 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-10-31 01:12:36 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-10-31 01:12:36 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-10-31 01:12:36 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router 2024-10-31 01:12:36 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 01:12:36 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Running _assess_status() 2024-10-31 01:12:37 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-10-31 01:12:37 DEBUG unit.mysql-innodb-cluster/2.update-status logger.go:60 active 2024-10-31 01:12:37 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Opening db connection for root@localhost 2024-10-31 01:12:37 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Checking cluster status. 2024-10-31 01:12:38 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Opening db connection for root@None 2024-10-31 01:12:38 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 01:12:38 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator.DelayedActionCoordinator Publishing state 2024-10-31 01:12:38 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-10-31 01:12:38 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for mysql-innodb-cluster/2 2024-10-31 01:12:38 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 01:12:38 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run update-status hook) 2024-10-31 01:12:38 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 01:12:38 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 01:12:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-10-31 01:12:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 01:12:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 01:12:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 01:12:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 01:12:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-10-31 01:12:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-10-31 01:12:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-10-31 01:12:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-10-31 01:12:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-10-31 01:12:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-10-31 01:17:38 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for mysql-innodb-cluster/2 2024-10-31 01:17:38 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 01:17:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-10-31 01:17:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 01:17:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 01:17:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-10-31 01:17:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 01:17:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 01:17:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-10-31 01:17:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-10-31 01:17:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-10-31 01:17:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-10-31 01:17:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-10-31 01:17:38 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for mysql-innodb-cluster/2 2024-10-31 01:17:38 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run update-status hook) 2024-10-31 01:17:38 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run update-status hook) 2024-10-31 01:17:38 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for mysql-innodb-cluster/2 2024-10-31 01:17:38 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for mysql-innodb-cluster/2 2024-10-31 01:17:38 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 01:17:38 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Reactive main running for hook update-status 2024-10-31 01:17:38 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 01:17:38 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.ssl_cert 2024-10-31 01:17:38 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.ssl_key 2024-10-31 01:17:38 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.ssl_ca 2024-10-31 01:17:38 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.source 2024-10-31 01:17:38 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.source 2024-10-31 01:17:38 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.cluster-name 2024-10-31 01:17:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.cluster-name 2024-10-31 01:17:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.auto-rejoin-tries 2024-10-31 01:17:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.auto-rejoin-tries 2024-10-31 01:17:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.expel-timeout 2024-10-31 01:17:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.expel-timeout 2024-10-31 01:17:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-buffer-pool-size 2024-10-31 01:17:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-change-buffering 2024-10-31 01:17:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.innodb-change-buffering 2024-10-31 01:17:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-io-capacity 2024-10-31 01:17:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.innodb-io-capacity 2024-10-31 01:17:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-file-per-table 2024-10-31 01:17:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.innodb-file-per-table 2024-10-31 01:17:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.tuning-level 2024-10-31 01:17:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.tuning-level 2024-10-31 01:17:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.table-open-cache 2024-10-31 01:17:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.table-open-cache 2024-10-31 01:17:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.max-connections 2024-10-31 01:17:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.enable-binlogs 2024-10-31 01:17:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.binlogs-path 2024-10-31 01:17:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.binlogs-path 2024-10-31 01:17:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.binlogs-max-size 2024-10-31 01:17:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.binlogs-max-size 2024-10-31 01:17:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.binlogs-expire-days 2024-10-31 01:17:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.binlogs-expire-days 2024-10-31 01:17:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.prefer-ipv6 2024-10-31 01:17:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.wait-timeout 2024-10-31 01:17:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.wait-timeout 2024-10-31 01:17:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.os-db-router-hostname 2024-10-31 01:17:39 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Initializing Snap Layer 2024-10-31 01:17:39 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator.DelayedActionCoordinator Loading state 2024-10-31 01:17:39 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Coordinator: Initializing coordinator layer 2024-10-31 01:17:39 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Initializing Leadership Layer (is follower) 2024-10-31 01:17:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: starting handler dispatch, 105 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-17-134-150 tracer: set flag leadership.set.cluster-instance-clustered-252-17-137-230 tracer: set flag leadership.set.cluster-instance-clustered-252-17-186-134 tracer: set flag leadership.set.cluster-instance-configured-252-17-134-150 tracer: set flag leadership.set.cluster-instance-configured-252-17-137-230 tracer: set flag leadership.set.cluster-instance-configured-252-17-186-134 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 01:17:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:64:default_update_status 2024-10-31 01:17:39 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:64:default_update_status 2024-10-31 01:17:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag run-default-update-status 2024-10-31 01:17:39 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag is-update-status-hook 2024-10-31 01:17:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: main dispatch loop, 9 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:82:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:93:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 01:17:40 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:82:check_really_is_update_status 2024-10-31 01:17:40 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:93:run_default_update_status 2024-10-31 01:17:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:93:run_default_update_status 2024-10-31 01:17:40 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-10-31 01:17:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Found peers: 252.17.134.150,252.17.186.134 2024-10-31 01:17:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Expect 2 peers 2024-10-31 01:17:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Reached quorum 2024-10-31 01:17:40 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 01:17:40 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-10-31 01:17:40 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-10-31 01:17:40 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-10-31 01:17:40 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router 2024-10-31 01:17:40 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 01:17:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Running _assess_status() 2024-10-31 01:17:40 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-10-31 01:17:40 DEBUG unit.mysql-innodb-cluster/2.update-status logger.go:60 active 2024-10-31 01:17:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Opening db connection for root@localhost 2024-10-31 01:17:40 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Checking cluster status. 2024-10-31 01:17:41 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Opening db connection for root@None 2024-10-31 01:17:41 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 01:17:41 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator.DelayedActionCoordinator Publishing state 2024-10-31 01:17:41 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-10-31 01:17:41 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for mysql-innodb-cluster/2 2024-10-31 01:17:41 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 01:17:41 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run update-status hook) 2024-10-31 01:17:41 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 01:17:41 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 01:17:41 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-10-31 01:17:41 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-10-31 01:17:41 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-10-31 01:17:41 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-10-31 01:17:41 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-10-31 01:17:41 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-10-31 01:17:41 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-10-31 01:17:41 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 01:17:41 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 01:17:41 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 01:17:41 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 01:22:29 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for mysql-innodb-cluster/2 2024-10-31 01:22:29 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 01:22:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-10-31 01:22:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 01:22:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 01:22:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-10-31 01:22:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-10-31 01:22:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-10-31 01:22:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-10-31 01:22:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-10-31 01:22:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 01:22:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 01:22:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-10-31 01:22:29 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for mysql-innodb-cluster/2 2024-10-31 01:22:29 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run update-status hook) 2024-10-31 01:22:29 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run update-status hook) 2024-10-31 01:22:29 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for mysql-innodb-cluster/2 2024-10-31 01:22:29 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for mysql-innodb-cluster/2 2024-10-31 01:22:29 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 01:22:30 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Reactive main running for hook update-status 2024-10-31 01:22:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 01:22:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.ssl_cert 2024-10-31 01:22:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.ssl_key 2024-10-31 01:22:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.ssl_ca 2024-10-31 01:22:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.source 2024-10-31 01:22:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.source 2024-10-31 01:22:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.cluster-name 2024-10-31 01:22:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.cluster-name 2024-10-31 01:22:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.auto-rejoin-tries 2024-10-31 01:22:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.auto-rejoin-tries 2024-10-31 01:22:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.expel-timeout 2024-10-31 01:22:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.expel-timeout 2024-10-31 01:22:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-buffer-pool-size 2024-10-31 01:22:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-change-buffering 2024-10-31 01:22:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.innodb-change-buffering 2024-10-31 01:22:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-io-capacity 2024-10-31 01:22:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.innodb-io-capacity 2024-10-31 01:22:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-file-per-table 2024-10-31 01:22:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.innodb-file-per-table 2024-10-31 01:22:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.tuning-level 2024-10-31 01:22:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.tuning-level 2024-10-31 01:22:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.table-open-cache 2024-10-31 01:22:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.table-open-cache 2024-10-31 01:22:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.max-connections 2024-10-31 01:22:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.enable-binlogs 2024-10-31 01:22:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.binlogs-path 2024-10-31 01:22:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.binlogs-path 2024-10-31 01:22:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.binlogs-max-size 2024-10-31 01:22:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.binlogs-max-size 2024-10-31 01:22:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.binlogs-expire-days 2024-10-31 01:22:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.binlogs-expire-days 2024-10-31 01:22:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.prefer-ipv6 2024-10-31 01:22:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.wait-timeout 2024-10-31 01:22:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.wait-timeout 2024-10-31 01:22:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.os-db-router-hostname 2024-10-31 01:22:31 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Initializing Snap Layer 2024-10-31 01:22:31 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator.DelayedActionCoordinator Loading state 2024-10-31 01:22:31 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Coordinator: Initializing coordinator layer 2024-10-31 01:22:31 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Initializing Leadership Layer (is follower) 2024-10-31 01:22:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: starting handler dispatch, 105 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-17-134-150 tracer: set flag leadership.set.cluster-instance-clustered-252-17-137-230 tracer: set flag leadership.set.cluster-instance-clustered-252-17-186-134 tracer: set flag leadership.set.cluster-instance-configured-252-17-134-150 tracer: set flag leadership.set.cluster-instance-configured-252-17-137-230 tracer: set flag leadership.set.cluster-instance-configured-252-17-186-134 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 01:22:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:64:default_update_status 2024-10-31 01:22:31 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:64:default_update_status 2024-10-31 01:22:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag run-default-update-status 2024-10-31 01:22:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag is-update-status-hook 2024-10-31 01:22:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: main dispatch loop, 9 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:82:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:93:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 01:22:31 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:82:check_really_is_update_status 2024-10-31 01:22:31 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:93:run_default_update_status 2024-10-31 01:22:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:93:run_default_update_status 2024-10-31 01:22:31 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-10-31 01:22:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Found peers: 252.17.134.150,252.17.186.134 2024-10-31 01:22:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Expect 2 peers 2024-10-31 01:22:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Reached quorum 2024-10-31 01:22:31 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 01:22:31 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-10-31 01:22:31 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-10-31 01:22:31 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-10-31 01:22:32 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router 2024-10-31 01:22:32 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 01:22:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Running _assess_status() 2024-10-31 01:22:32 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-10-31 01:22:32 DEBUG unit.mysql-innodb-cluster/2.update-status logger.go:60 active 2024-10-31 01:22:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Opening db connection for root@localhost 2024-10-31 01:22:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Checking cluster status. 2024-10-31 01:22:33 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Opening db connection for root@None 2024-10-31 01:22:33 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 01:22:33 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator.DelayedActionCoordinator Publishing state 2024-10-31 01:22:33 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-10-31 01:22:33 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for mysql-innodb-cluster/2 2024-10-31 01:22:33 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 01:22:33 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run update-status hook) 2024-10-31 01:22:33 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 01:22:33 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 01:22:33 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-10-31 01:22:33 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 01:22:33 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 01:22:33 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-10-31 01:22:33 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-10-31 01:22:33 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-10-31 01:22:33 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-10-31 01:22:33 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-10-31 01:22:33 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 01:22:33 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 01:22:33 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-10-31 01:27:51 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for mysql-innodb-cluster/2 2024-10-31 01:27:51 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 01:27:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-10-31 01:27:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 01:27:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 01:27:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 01:27:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 01:27:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-10-31 01:27:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-10-31 01:27:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-10-31 01:27:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-10-31 01:27:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-10-31 01:27:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-10-31 01:27:51 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for mysql-innodb-cluster/2 2024-10-31 01:27:51 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run update-status hook) 2024-10-31 01:27:51 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run update-status hook) 2024-10-31 01:27:51 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for mysql-innodb-cluster/2 2024-10-31 01:27:51 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for mysql-innodb-cluster/2 2024-10-31 01:27:51 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 01:27:51 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Reactive main running for hook update-status 2024-10-31 01:27:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 01:27:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.ssl_cert 2024-10-31 01:27:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.ssl_key 2024-10-31 01:27:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.ssl_ca 2024-10-31 01:27:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.source 2024-10-31 01:27:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.source 2024-10-31 01:27:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.cluster-name 2024-10-31 01:27:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.cluster-name 2024-10-31 01:27:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.auto-rejoin-tries 2024-10-31 01:27:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.auto-rejoin-tries 2024-10-31 01:27:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.expel-timeout 2024-10-31 01:27:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.expel-timeout 2024-10-31 01:27:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-buffer-pool-size 2024-10-31 01:27:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-change-buffering 2024-10-31 01:27:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.innodb-change-buffering 2024-10-31 01:27:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-io-capacity 2024-10-31 01:27:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.innodb-io-capacity 2024-10-31 01:27:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-file-per-table 2024-10-31 01:27:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.innodb-file-per-table 2024-10-31 01:27:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.tuning-level 2024-10-31 01:27:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.tuning-level 2024-10-31 01:27:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.table-open-cache 2024-10-31 01:27:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.table-open-cache 2024-10-31 01:27:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.max-connections 2024-10-31 01:27:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.enable-binlogs 2024-10-31 01:27:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.binlogs-path 2024-10-31 01:27:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.binlogs-path 2024-10-31 01:27:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.binlogs-max-size 2024-10-31 01:27:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.binlogs-max-size 2024-10-31 01:27:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.binlogs-expire-days 2024-10-31 01:27:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.binlogs-expire-days 2024-10-31 01:27:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.prefer-ipv6 2024-10-31 01:27:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.wait-timeout 2024-10-31 01:27:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.wait-timeout 2024-10-31 01:27:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.os-db-router-hostname 2024-10-31 01:27:53 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Initializing Snap Layer 2024-10-31 01:27:53 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator.DelayedActionCoordinator Loading state 2024-10-31 01:27:53 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Coordinator: Initializing coordinator layer 2024-10-31 01:27:53 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Initializing Leadership Layer (is follower) 2024-10-31 01:27:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: starting handler dispatch, 105 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-17-134-150 tracer: set flag leadership.set.cluster-instance-clustered-252-17-137-230 tracer: set flag leadership.set.cluster-instance-clustered-252-17-186-134 tracer: set flag leadership.set.cluster-instance-configured-252-17-134-150 tracer: set flag leadership.set.cluster-instance-configured-252-17-137-230 tracer: set flag leadership.set.cluster-instance-configured-252-17-186-134 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 01:27:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:64:default_update_status 2024-10-31 01:27:53 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:64:default_update_status 2024-10-31 01:27:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag run-default-update-status 2024-10-31 01:27:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag is-update-status-hook 2024-10-31 01:27:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: main dispatch loop, 9 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:82:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:93:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 01:27:53 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:82:check_really_is_update_status 2024-10-31 01:27:53 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:93:run_default_update_status 2024-10-31 01:27:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:93:run_default_update_status 2024-10-31 01:27:53 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-10-31 01:27:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Found peers: 252.17.134.150,252.17.186.134 2024-10-31 01:27:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Expect 2 peers 2024-10-31 01:27:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Reached quorum 2024-10-31 01:27:53 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 01:27:53 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-10-31 01:27:53 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-10-31 01:27:53 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-10-31 01:27:53 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router 2024-10-31 01:27:53 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 01:27:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Running _assess_status() 2024-10-31 01:27:54 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-10-31 01:27:54 DEBUG unit.mysql-innodb-cluster/2.update-status logger.go:60 active 2024-10-31 01:27:54 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Opening db connection for root@localhost 2024-10-31 01:27:54 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Checking cluster status. 2024-10-31 01:27:55 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Opening db connection for root@None 2024-10-31 01:27:55 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 01:27:55 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator.DelayedActionCoordinator Publishing state 2024-10-31 01:27:55 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-10-31 01:27:55 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for mysql-innodb-cluster/2 2024-10-31 01:27:55 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 01:27:55 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run update-status hook) 2024-10-31 01:27:55 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 01:27:55 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 01:27:55 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-10-31 01:27:55 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-10-31 01:27:55 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-10-31 01:27:55 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 01:27:55 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 01:27:55 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-10-31 01:27:55 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 01:27:55 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 01:27:55 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-10-31 01:27:55 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-10-31 01:27:55 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-10-31 01:32:52 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for mysql-innodb-cluster/2 2024-10-31 01:32:52 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 01:32:52 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-10-31 01:32:52 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-10-31 01:32:52 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-10-31 01:32:52 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-10-31 01:32:52 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 01:32:52 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 01:32:52 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-10-31 01:32:52 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-10-31 01:32:52 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 01:32:52 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 01:32:52 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-10-31 01:32:52 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for mysql-innodb-cluster/2 2024-10-31 01:32:52 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run update-status hook) 2024-10-31 01:32:52 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run update-status hook) 2024-10-31 01:32:52 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for mysql-innodb-cluster/2 2024-10-31 01:32:52 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for mysql-innodb-cluster/2 2024-10-31 01:32:52 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 01:32:53 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Reactive main running for hook update-status 2024-10-31 01:32:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 01:32:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.ssl_cert 2024-10-31 01:32:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.ssl_key 2024-10-31 01:32:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.ssl_ca 2024-10-31 01:32:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.source 2024-10-31 01:32:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.source 2024-10-31 01:32:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.cluster-name 2024-10-31 01:32:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.cluster-name 2024-10-31 01:32:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.auto-rejoin-tries 2024-10-31 01:32:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.auto-rejoin-tries 2024-10-31 01:32:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.expel-timeout 2024-10-31 01:32:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.expel-timeout 2024-10-31 01:32:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-buffer-pool-size 2024-10-31 01:32:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-change-buffering 2024-10-31 01:32:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.innodb-change-buffering 2024-10-31 01:32:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-io-capacity 2024-10-31 01:32:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.innodb-io-capacity 2024-10-31 01:32:54 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-file-per-table 2024-10-31 01:32:54 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.innodb-file-per-table 2024-10-31 01:32:54 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.tuning-level 2024-10-31 01:32:54 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.tuning-level 2024-10-31 01:32:54 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.table-open-cache 2024-10-31 01:32:54 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.table-open-cache 2024-10-31 01:32:54 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.max-connections 2024-10-31 01:32:54 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.enable-binlogs 2024-10-31 01:32:54 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.binlogs-path 2024-10-31 01:32:54 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.binlogs-path 2024-10-31 01:32:54 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.binlogs-max-size 2024-10-31 01:32:54 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.binlogs-max-size 2024-10-31 01:32:54 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.binlogs-expire-days 2024-10-31 01:32:54 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.binlogs-expire-days 2024-10-31 01:32:54 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.prefer-ipv6 2024-10-31 01:32:54 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.wait-timeout 2024-10-31 01:32:54 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.wait-timeout 2024-10-31 01:32:54 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.os-db-router-hostname 2024-10-31 01:32:54 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Initializing Snap Layer 2024-10-31 01:32:54 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator.DelayedActionCoordinator Loading state 2024-10-31 01:32:54 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Coordinator: Initializing coordinator layer 2024-10-31 01:32:54 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Initializing Leadership Layer (is follower) 2024-10-31 01:32:54 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: starting handler dispatch, 105 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-17-134-150 tracer: set flag leadership.set.cluster-instance-clustered-252-17-137-230 tracer: set flag leadership.set.cluster-instance-clustered-252-17-186-134 tracer: set flag leadership.set.cluster-instance-configured-252-17-134-150 tracer: set flag leadership.set.cluster-instance-configured-252-17-137-230 tracer: set flag leadership.set.cluster-instance-configured-252-17-186-134 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 01:32:54 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:64:default_update_status 2024-10-31 01:32:54 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:64:default_update_status 2024-10-31 01:32:54 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag run-default-update-status 2024-10-31 01:32:54 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag is-update-status-hook 2024-10-31 01:32:54 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: main dispatch loop, 9 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:82:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:93:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 01:32:54 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:82:check_really_is_update_status 2024-10-31 01:32:54 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:93:run_default_update_status 2024-10-31 01:32:54 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:93:run_default_update_status 2024-10-31 01:32:54 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-10-31 01:32:54 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Found peers: 252.17.134.150,252.17.186.134 2024-10-31 01:32:54 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Expect 2 peers 2024-10-31 01:32:54 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Reached quorum 2024-10-31 01:32:54 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 01:32:54 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-10-31 01:32:54 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-10-31 01:32:54 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-10-31 01:32:54 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router 2024-10-31 01:32:54 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 01:32:54 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Running _assess_status() 2024-10-31 01:32:55 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-10-31 01:32:55 DEBUG unit.mysql-innodb-cluster/2.update-status logger.go:60 active 2024-10-31 01:32:55 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Opening db connection for root@localhost 2024-10-31 01:32:55 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Checking cluster status. 2024-10-31 01:32:56 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Opening db connection for root@None 2024-10-31 01:32:56 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 01:32:56 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator.DelayedActionCoordinator Publishing state 2024-10-31 01:32:56 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-10-31 01:32:56 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for mysql-innodb-cluster/2 2024-10-31 01:32:56 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 01:32:56 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run update-status hook) 2024-10-31 01:32:56 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 01:32:56 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 01:32:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-10-31 01:32:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-10-31 01:32:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-10-31 01:32:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-10-31 01:32:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-10-31 01:32:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-10-31 01:32:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 01:32:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 01:32:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-10-31 01:32:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 01:32:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 01:37:51 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for mysql-innodb-cluster/2 2024-10-31 01:37:51 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 01:37:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-10-31 01:37:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-10-31 01:37:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-10-31 01:37:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-10-31 01:37:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-10-31 01:37:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 01:37:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 01:37:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-10-31 01:37:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-10-31 01:37:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 01:37:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 01:37:51 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for mysql-innodb-cluster/2 2024-10-31 01:37:51 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run update-status hook) 2024-10-31 01:37:51 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run update-status hook) 2024-10-31 01:37:51 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for mysql-innodb-cluster/2 2024-10-31 01:37:51 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for mysql-innodb-cluster/2 2024-10-31 01:37:51 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 01:37:51 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Reactive main running for hook update-status 2024-10-31 01:37:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 01:37:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.ssl_cert 2024-10-31 01:37:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.ssl_key 2024-10-31 01:37:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.ssl_ca 2024-10-31 01:37:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.source 2024-10-31 01:37:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.source 2024-10-31 01:37:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.cluster-name 2024-10-31 01:37:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.cluster-name 2024-10-31 01:37:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.auto-rejoin-tries 2024-10-31 01:37:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.auto-rejoin-tries 2024-10-31 01:37:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.expel-timeout 2024-10-31 01:37:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.expel-timeout 2024-10-31 01:37:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-buffer-pool-size 2024-10-31 01:37:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-change-buffering 2024-10-31 01:37:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.innodb-change-buffering 2024-10-31 01:37:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-io-capacity 2024-10-31 01:37:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.innodb-io-capacity 2024-10-31 01:37:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-file-per-table 2024-10-31 01:37:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.innodb-file-per-table 2024-10-31 01:37:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.tuning-level 2024-10-31 01:37:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.tuning-level 2024-10-31 01:37:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.table-open-cache 2024-10-31 01:37:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.table-open-cache 2024-10-31 01:37:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.max-connections 2024-10-31 01:37:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.enable-binlogs 2024-10-31 01:37:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.binlogs-path 2024-10-31 01:37:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.binlogs-path 2024-10-31 01:37:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.binlogs-max-size 2024-10-31 01:37:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.binlogs-max-size 2024-10-31 01:37:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.binlogs-expire-days 2024-10-31 01:37:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.binlogs-expire-days 2024-10-31 01:37:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.prefer-ipv6 2024-10-31 01:37:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.wait-timeout 2024-10-31 01:37:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.wait-timeout 2024-10-31 01:37:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.os-db-router-hostname 2024-10-31 01:37:53 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Initializing Snap Layer 2024-10-31 01:37:53 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator.DelayedActionCoordinator Loading state 2024-10-31 01:37:53 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Coordinator: Initializing coordinator layer 2024-10-31 01:37:53 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Initializing Leadership Layer (is follower) 2024-10-31 01:37:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: starting handler dispatch, 105 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-17-134-150 tracer: set flag leadership.set.cluster-instance-clustered-252-17-137-230 tracer: set flag leadership.set.cluster-instance-clustered-252-17-186-134 tracer: set flag leadership.set.cluster-instance-configured-252-17-134-150 tracer: set flag leadership.set.cluster-instance-configured-252-17-137-230 tracer: set flag leadership.set.cluster-instance-configured-252-17-186-134 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 01:37:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:64:default_update_status 2024-10-31 01:37:53 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:64:default_update_status 2024-10-31 01:37:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag run-default-update-status 2024-10-31 01:37:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag is-update-status-hook 2024-10-31 01:37:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: main dispatch loop, 9 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:82:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:93:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 01:37:53 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:82:check_really_is_update_status 2024-10-31 01:37:53 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:93:run_default_update_status 2024-10-31 01:37:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:93:run_default_update_status 2024-10-31 01:37:53 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-10-31 01:37:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Found peers: 252.17.134.150,252.17.186.134 2024-10-31 01:37:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Expect 2 peers 2024-10-31 01:37:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Reached quorum 2024-10-31 01:37:53 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 01:37:53 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-10-31 01:37:53 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-10-31 01:37:53 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-10-31 01:37:53 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router 2024-10-31 01:37:53 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 01:37:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Running _assess_status() 2024-10-31 01:37:53 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-10-31 01:37:53 DEBUG unit.mysql-innodb-cluster/2.update-status logger.go:60 active 2024-10-31 01:37:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Opening db connection for root@localhost 2024-10-31 01:37:53 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Checking cluster status. 2024-10-31 01:37:54 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Opening db connection for root@None 2024-10-31 01:37:54 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 01:37:54 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator.DelayedActionCoordinator Publishing state 2024-10-31 01:37:55 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-10-31 01:37:55 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for mysql-innodb-cluster/2 2024-10-31 01:37:55 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 01:37:55 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run update-status hook) 2024-10-31 01:37:55 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 01:37:55 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 01:37:55 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-10-31 01:37:55 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-10-31 01:37:55 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 01:37:55 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 01:37:55 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-10-31 01:37:55 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-10-31 01:37:55 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-10-31 01:37:55 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-10-31 01:37:55 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 01:37:55 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 01:37:55 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-10-31 01:42:59 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for mysql-innodb-cluster/2 2024-10-31 01:42:59 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 01:42:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-10-31 01:42:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 01:42:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 01:42:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 01:42:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 01:42:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-10-31 01:42:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-10-31 01:42:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-10-31 01:42:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-10-31 01:42:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-10-31 01:42:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-10-31 01:42:59 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for mysql-innodb-cluster/2 2024-10-31 01:42:59 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run update-status hook) 2024-10-31 01:42:59 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run update-status hook) 2024-10-31 01:42:59 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for mysql-innodb-cluster/2 2024-10-31 01:42:59 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for mysql-innodb-cluster/2 2024-10-31 01:42:59 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 01:43:00 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Reactive main running for hook update-status 2024-10-31 01:43:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 01:43:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.ssl_cert 2024-10-31 01:43:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.ssl_key 2024-10-31 01:43:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.ssl_ca 2024-10-31 01:43:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.source 2024-10-31 01:43:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.source 2024-10-31 01:43:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.cluster-name 2024-10-31 01:43:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.cluster-name 2024-10-31 01:43:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.auto-rejoin-tries 2024-10-31 01:43:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.auto-rejoin-tries 2024-10-31 01:43:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.expel-timeout 2024-10-31 01:43:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.expel-timeout 2024-10-31 01:43:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-buffer-pool-size 2024-10-31 01:43:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-change-buffering 2024-10-31 01:43:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.innodb-change-buffering 2024-10-31 01:43:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-io-capacity 2024-10-31 01:43:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.innodb-io-capacity 2024-10-31 01:43:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-file-per-table 2024-10-31 01:43:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.innodb-file-per-table 2024-10-31 01:43:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.tuning-level 2024-10-31 01:43:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.tuning-level 2024-10-31 01:43:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.table-open-cache 2024-10-31 01:43:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.table-open-cache 2024-10-31 01:43:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.max-connections 2024-10-31 01:43:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.enable-binlogs 2024-10-31 01:43:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.binlogs-path 2024-10-31 01:43:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.binlogs-path 2024-10-31 01:43:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.binlogs-max-size 2024-10-31 01:43:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.binlogs-max-size 2024-10-31 01:43:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.binlogs-expire-days 2024-10-31 01:43:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.binlogs-expire-days 2024-10-31 01:43:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.prefer-ipv6 2024-10-31 01:43:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.wait-timeout 2024-10-31 01:43:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.wait-timeout 2024-10-31 01:43:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.os-db-router-hostname 2024-10-31 01:43:01 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Initializing Snap Layer 2024-10-31 01:43:01 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator.DelayedActionCoordinator Loading state 2024-10-31 01:43:01 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Coordinator: Initializing coordinator layer 2024-10-31 01:43:01 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Initializing Leadership Layer (is follower) 2024-10-31 01:43:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: starting handler dispatch, 105 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-17-134-150 tracer: set flag leadership.set.cluster-instance-clustered-252-17-137-230 tracer: set flag leadership.set.cluster-instance-clustered-252-17-186-134 tracer: set flag leadership.set.cluster-instance-configured-252-17-134-150 tracer: set flag leadership.set.cluster-instance-configured-252-17-137-230 tracer: set flag leadership.set.cluster-instance-configured-252-17-186-134 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 01:43:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:64:default_update_status 2024-10-31 01:43:01 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:64:default_update_status 2024-10-31 01:43:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag run-default-update-status 2024-10-31 01:43:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag is-update-status-hook 2024-10-31 01:43:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: main dispatch loop, 9 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:82:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:93:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 01:43:01 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:82:check_really_is_update_status 2024-10-31 01:43:01 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:93:run_default_update_status 2024-10-31 01:43:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:93:run_default_update_status 2024-10-31 01:43:01 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-10-31 01:43:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Found peers: 252.17.134.150,252.17.186.134 2024-10-31 01:43:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Expect 2 peers 2024-10-31 01:43:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Reached quorum 2024-10-31 01:43:01 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 01:43:01 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-10-31 01:43:01 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-10-31 01:43:01 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-10-31 01:43:01 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router 2024-10-31 01:43:01 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 01:43:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Running _assess_status() 2024-10-31 01:43:02 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-10-31 01:43:02 DEBUG unit.mysql-innodb-cluster/2.update-status logger.go:60 active 2024-10-31 01:43:02 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Opening db connection for root@localhost 2024-10-31 01:43:02 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Checking cluster status. 2024-10-31 01:43:03 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Opening db connection for root@None 2024-10-31 01:43:03 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 01:43:03 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator.DelayedActionCoordinator Publishing state 2024-10-31 01:43:03 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-10-31 01:43:03 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for mysql-innodb-cluster/2 2024-10-31 01:43:03 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 01:43:03 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run update-status hook) 2024-10-31 01:43:03 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 01:43:03 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 01:43:03 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-10-31 01:43:03 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-10-31 01:43:03 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 01:43:03 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 01:43:03 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-10-31 01:43:03 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-10-31 01:43:03 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-10-31 01:43:03 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 01:43:03 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 01:43:03 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-10-31 01:43:03 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-10-31 01:48:46 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for mysql-innodb-cluster/2 2024-10-31 01:48:46 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 01:48:46 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 01:48:46 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 01:48:46 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-10-31 01:48:46 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-10-31 01:48:46 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-10-31 01:48:46 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-10-31 01:48:46 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-10-31 01:48:46 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 01:48:46 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 01:48:46 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-10-31 01:48:46 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-10-31 01:48:46 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for mysql-innodb-cluster/2 2024-10-31 01:48:46 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run update-status hook) 2024-10-31 01:48:46 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run update-status hook) 2024-10-31 01:48:46 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for mysql-innodb-cluster/2 2024-10-31 01:48:46 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for mysql-innodb-cluster/2 2024-10-31 01:48:46 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 01:48:46 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Reactive main running for hook update-status 2024-10-31 01:48:47 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 01:48:47 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.ssl_cert 2024-10-31 01:48:47 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.ssl_key 2024-10-31 01:48:47 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.ssl_ca 2024-10-31 01:48:47 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.source 2024-10-31 01:48:47 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.source 2024-10-31 01:48:47 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.cluster-name 2024-10-31 01:48:47 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.cluster-name 2024-10-31 01:48:47 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.auto-rejoin-tries 2024-10-31 01:48:47 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.auto-rejoin-tries 2024-10-31 01:48:47 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.expel-timeout 2024-10-31 01:48:47 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.expel-timeout 2024-10-31 01:48:47 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-buffer-pool-size 2024-10-31 01:48:47 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-change-buffering 2024-10-31 01:48:47 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.innodb-change-buffering 2024-10-31 01:48:47 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-io-capacity 2024-10-31 01:48:47 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.innodb-io-capacity 2024-10-31 01:48:47 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-file-per-table 2024-10-31 01:48:47 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.innodb-file-per-table 2024-10-31 01:48:47 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.tuning-level 2024-10-31 01:48:47 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.tuning-level 2024-10-31 01:48:47 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.table-open-cache 2024-10-31 01:48:47 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.table-open-cache 2024-10-31 01:48:47 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.max-connections 2024-10-31 01:48:47 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.enable-binlogs 2024-10-31 01:48:47 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.binlogs-path 2024-10-31 01:48:47 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.binlogs-path 2024-10-31 01:48:47 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.binlogs-max-size 2024-10-31 01:48:47 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.binlogs-max-size 2024-10-31 01:48:47 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.binlogs-expire-days 2024-10-31 01:48:47 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.binlogs-expire-days 2024-10-31 01:48:48 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.prefer-ipv6 2024-10-31 01:48:48 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.wait-timeout 2024-10-31 01:48:48 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.wait-timeout 2024-10-31 01:48:48 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.os-db-router-hostname 2024-10-31 01:48:48 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Initializing Snap Layer 2024-10-31 01:48:48 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator.DelayedActionCoordinator Loading state 2024-10-31 01:48:48 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Coordinator: Initializing coordinator layer 2024-10-31 01:48:48 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Initializing Leadership Layer (is follower) 2024-10-31 01:48:48 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: starting handler dispatch, 105 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-17-134-150 tracer: set flag leadership.set.cluster-instance-clustered-252-17-137-230 tracer: set flag leadership.set.cluster-instance-clustered-252-17-186-134 tracer: set flag leadership.set.cluster-instance-configured-252-17-134-150 tracer: set flag leadership.set.cluster-instance-configured-252-17-137-230 tracer: set flag leadership.set.cluster-instance-configured-252-17-186-134 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 01:48:48 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:64:default_update_status 2024-10-31 01:48:48 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:64:default_update_status 2024-10-31 01:48:48 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag run-default-update-status 2024-10-31 01:48:48 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag is-update-status-hook 2024-10-31 01:48:48 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: main dispatch loop, 9 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:82:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:93:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 01:48:48 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:82:check_really_is_update_status 2024-10-31 01:48:48 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:93:run_default_update_status 2024-10-31 01:48:48 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:93:run_default_update_status 2024-10-31 01:48:48 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-10-31 01:48:48 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Found peers: 252.17.134.150,252.17.186.134 2024-10-31 01:48:48 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Expect 2 peers 2024-10-31 01:48:48 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Reached quorum 2024-10-31 01:48:48 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 01:48:48 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-10-31 01:48:48 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-10-31 01:48:48 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-10-31 01:48:48 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router 2024-10-31 01:48:48 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 01:48:48 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Running _assess_status() 2024-10-31 01:48:48 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-10-31 01:48:48 DEBUG unit.mysql-innodb-cluster/2.update-status logger.go:60 active 2024-10-31 01:48:48 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Opening db connection for root@localhost 2024-10-31 01:48:48 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Checking cluster status. 2024-10-31 01:48:49 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Opening db connection for root@None 2024-10-31 01:48:49 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 01:48:49 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator.DelayedActionCoordinator Publishing state 2024-10-31 01:48:50 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-10-31 01:48:50 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for mysql-innodb-cluster/2 2024-10-31 01:48:50 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 01:48:50 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run update-status hook) 2024-10-31 01:48:50 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 01:48:50 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 01:48:50 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-10-31 01:48:50 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-10-31 01:48:50 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 01:48:50 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 01:48:50 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-10-31 01:48:50 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-10-31 01:48:50 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-10-31 01:48:50 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-10-31 01:48:50 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-10-31 01:48:50 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 01:48:50 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 01:52:59 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for mysql-innodb-cluster/2 2024-10-31 01:52:59 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 01:52:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 01:52:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 01:52:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-10-31 01:52:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-10-31 01:52:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 01:52:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 01:52:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-10-31 01:52:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-10-31 01:52:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-10-31 01:52:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-10-31 01:52:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-10-31 01:52:59 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for mysql-innodb-cluster/2 2024-10-31 01:52:59 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run update-status hook) 2024-10-31 01:52:59 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run update-status hook) 2024-10-31 01:52:59 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for mysql-innodb-cluster/2 2024-10-31 01:52:59 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for mysql-innodb-cluster/2 2024-10-31 01:52:59 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 01:53:00 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Reactive main running for hook update-status 2024-10-31 01:53:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 01:53:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.ssl_cert 2024-10-31 01:53:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.ssl_key 2024-10-31 01:53:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.ssl_ca 2024-10-31 01:53:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.source 2024-10-31 01:53:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.source 2024-10-31 01:53:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.cluster-name 2024-10-31 01:53:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.cluster-name 2024-10-31 01:53:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.auto-rejoin-tries 2024-10-31 01:53:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.auto-rejoin-tries 2024-10-31 01:53:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.expel-timeout 2024-10-31 01:53:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.expel-timeout 2024-10-31 01:53:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-buffer-pool-size 2024-10-31 01:53:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-change-buffering 2024-10-31 01:53:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.innodb-change-buffering 2024-10-31 01:53:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-io-capacity 2024-10-31 01:53:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.innodb-io-capacity 2024-10-31 01:53:00 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-file-per-table 2024-10-31 01:53:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.innodb-file-per-table 2024-10-31 01:53:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.tuning-level 2024-10-31 01:53:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.tuning-level 2024-10-31 01:53:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.table-open-cache 2024-10-31 01:53:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.table-open-cache 2024-10-31 01:53:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.max-connections 2024-10-31 01:53:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.enable-binlogs 2024-10-31 01:53:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.binlogs-path 2024-10-31 01:53:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.binlogs-path 2024-10-31 01:53:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.binlogs-max-size 2024-10-31 01:53:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.binlogs-max-size 2024-10-31 01:53:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.binlogs-expire-days 2024-10-31 01:53:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.binlogs-expire-days 2024-10-31 01:53:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.prefer-ipv6 2024-10-31 01:53:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.wait-timeout 2024-10-31 01:53:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.wait-timeout 2024-10-31 01:53:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.os-db-router-hostname 2024-10-31 01:53:01 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Initializing Snap Layer 2024-10-31 01:53:01 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator.DelayedActionCoordinator Loading state 2024-10-31 01:53:01 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Coordinator: Initializing coordinator layer 2024-10-31 01:53:01 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Initializing Leadership Layer (is follower) 2024-10-31 01:53:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: starting handler dispatch, 105 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-17-134-150 tracer: set flag leadership.set.cluster-instance-clustered-252-17-137-230 tracer: set flag leadership.set.cluster-instance-clustered-252-17-186-134 tracer: set flag leadership.set.cluster-instance-configured-252-17-134-150 tracer: set flag leadership.set.cluster-instance-configured-252-17-137-230 tracer: set flag leadership.set.cluster-instance-configured-252-17-186-134 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 01:53:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:64:default_update_status 2024-10-31 01:53:01 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:64:default_update_status 2024-10-31 01:53:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag run-default-update-status 2024-10-31 01:53:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag is-update-status-hook 2024-10-31 01:53:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: main dispatch loop, 9 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:82:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:93:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 01:53:01 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:82:check_really_is_update_status 2024-10-31 01:53:01 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:93:run_default_update_status 2024-10-31 01:53:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:93:run_default_update_status 2024-10-31 01:53:01 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-10-31 01:53:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Found peers: 252.17.134.150,252.17.186.134 2024-10-31 01:53:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Expect 2 peers 2024-10-31 01:53:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Reached quorum 2024-10-31 01:53:01 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 01:53:01 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-10-31 01:53:01 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-10-31 01:53:01 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-10-31 01:53:01 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router 2024-10-31 01:53:01 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 01:53:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Running _assess_status() 2024-10-31 01:53:02 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-10-31 01:53:02 DEBUG unit.mysql-innodb-cluster/2.update-status logger.go:60 active 2024-10-31 01:53:02 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Opening db connection for root@localhost 2024-10-31 01:53:02 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Checking cluster status. 2024-10-31 01:53:03 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Opening db connection for root@None 2024-10-31 01:53:03 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 01:53:03 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator.DelayedActionCoordinator Publishing state 2024-10-31 01:53:03 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-10-31 01:53:03 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for mysql-innodb-cluster/2 2024-10-31 01:53:03 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 01:53:03 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run update-status hook) 2024-10-31 01:53:03 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 01:53:03 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 01:53:03 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-10-31 01:53:03 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-10-31 01:53:03 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-10-31 01:53:03 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-10-31 01:53:03 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-10-31 01:53:03 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-10-31 01:53:03 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 01:53:03 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 01:53:03 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-10-31 01:53:03 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 01:53:03 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 01:54:19 DEBUG juju.worker.uniter.remotestate watcher.go:623 got update status interval change for mysql-innodb-cluster/2: ok=true 2024-10-31 01:54:19 DEBUG juju.worker.retrystrategy worker.go:92 bouncing retrystrategy worker to get new values 2024-10-31 01:54:19 DEBUG juju.worker.dependency engine.go:621 "hook-retry-strategy" manifold worker stopped: restart immediately 2024-10-31 01:54:19 DEBUG juju.worker.uniter runlistener.go:130 juju-run listener stopping 2024-10-31 01:54:19 DEBUG juju.worker.uniter runlistener.go:149 juju-run listener stopped 2024-10-31 01:54:19 INFO juju.worker.uniter uniter.go:319 unit "mysql-innodb-cluster/2" shutting down: catacomb 0xc000795200 is dying 2024-10-31 01:54:20 DEBUG juju.worker.dependency engine.go:603 "uniter" manifold worker completed successfully 2024-10-31 01:54:20 DEBUG juju.worker.dependency engine.go:580 "hook-retry-strategy" manifold worker started at 2024-10-31 01:54:20.244883945 +0000 UTC 2024-10-31 01:54:20 DEBUG juju.worker.dependency engine.go:580 "uniter" manifold worker started at 2024-10-31 01:54:20.255161026 +0000 UTC 2024-10-31 01:54:21 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "mysql-innodb-cluster/2" (leader=false) entered scope for relation "keystone-mysql-router:db-router mysql-innodb-cluster:db-router" 2024-10-31 01:54:22 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "mysql-innodb-cluster/2" (leader=false) entered scope for relation "dashboard-mysql-router:db-router mysql-innodb-cluster:db-router" 2024-10-31 01:54:22 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "mysql-innodb-cluster/2" (leader=false) entered scope for relation "placement-mysql-router:db-router mysql-innodb-cluster:db-router" 2024-10-31 01:54:22 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "mysql-innodb-cluster/2" (leader=false) entered scope for relation "neutron-mysql-router:db-router mysql-innodb-cluster:db-router" 2024-10-31 01:54:22 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "mysql-innodb-cluster/2" (leader=false) entered scope for relation "mysql-innodb-cluster:cluster" 2024-10-31 01:54:22 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "mysql-innodb-cluster/2" (leader=false) entered scope for relation "glance-mysql-router:db-router mysql-innodb-cluster:db-router" 2024-10-31 01:54:22 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "mysql-innodb-cluster/2" (leader=false) entered scope for relation "nova-mysql-router:db-router mysql-innodb-cluster:db-router" 2024-10-31 01:54:22 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "mysql-innodb-cluster/2" (leader=false) entered scope for relation "mysql-innodb-cluster:coordinator" 2024-10-31 01:54:22 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "mysql-innodb-cluster/2" (leader=false) entered scope for relation "heat-mysql-router:db-router mysql-innodb-cluster:db-router" 2024-10-31 01:54:22 DEBUG juju.worker.uniter uniter.go:883 starting local juju-run listener on {unix /var/lib/juju/agents/unit-mysql-innodb-cluster-2/run.socket } 2024-10-31 01:54:22 INFO juju.worker.uniter uniter.go:335 unit "mysql-innodb-cluster/2" started 2024-10-31 01:54:22 DEBUG juju.worker.uniter runlistener.go:117 juju-run listener running 2024-10-31 01:54:22 INFO juju.worker.uniter uniter.go:361 hooks are retried false 2024-10-31 01:54:22 DEBUG juju.worker.uniter.remotestate watcher.go:595 got action change for mysql-innodb-cluster/2: [] ok=true 2024-10-31 01:54:22 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for mysql-innodb-cluster/2: ok=true 2024-10-31 01:54:22 DEBUG juju.worker.uniter.remotestate watcher.go:509 got instance data change for mysql-innodb-cluster/2 2024-10-31 01:54:22 DEBUG juju.worker.uniter.remotestate watcher.go:843 LXDProfileName changed to "" 2024-10-31 01:54:22 DEBUG juju.worker.uniter.remotestate watcher.go:623 got update status interval change for mysql-innodb-cluster/2: ok=true 2024-10-31 01:54:22 DEBUG juju.worker.uniter.remotestate watcher.go:613 got storage change for mysql-innodb-cluster/2: [] ok=true 2024-10-31 01:54:22 DEBUG juju.worker.uniter.remotestate watcher.go:553 got trust config change for mysql-innodb-cluster/2: ok=true, hashes=[aeddf8dcd2b7e0ac0c37321c9d8645dff25799f0d355a7d57fccc94a3c9956b2] 2024-10-31 01:54:22 DEBUG juju.worker.uniter.remotestate watcher.go:564 got upgrade series change 2024-10-31 01:54:22 DEBUG juju.worker.uniter.remotestate watcher.go:714 no upgrade series in progress, reinitializing local upgrade series state 2024-10-31 01:54:22 DEBUG juju.worker.uniter.remotestate watcher.go:489 got unit change for mysql-innodb-cluster/2 2024-10-31 01:54:22 DEBUG juju.worker.uniter.remotestate watcher.go:542 got config change for mysql-innodb-cluster/2: ok=true, hashes=[16220c72d89b4caf072292fc8a79692b89ee0cd3ccb03f9ea52e6ca7cca5ed2b] 2024-10-31 01:54:22 DEBUG juju.worker.uniter.remotestate watcher.go:574 got address change for mysql-innodb-cluster/2: ok=true, hashes=[7c90ade5ec79ca599927e3ec605ba210cc05047d01c94c2dced434e266005fbf] 2024-10-31 01:54:22 DEBUG juju.worker.uniter.remotestate watcher.go:499 got application change for mysql-innodb-cluster/2 2024-10-31 01:54:22 DEBUG juju.worker.uniter.remotestate watcher.go:603 got relations change for mysql-innodb-cluster/2: ok=true 2024-10-31 01:54:22 DEBUG juju.worker.uniter.operation executor.go:85 running operation run leader-settings-changed hook for mysql-innodb-cluster/2 2024-10-31 01:54:22 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run leader-settings-changed hook) 2024-10-31 01:54:22 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run leader-settings-changed hook) 2024-10-31 01:54:22 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run leader-settings-changed hook" for mysql-innodb-cluster/2 2024-10-31 01:54:22 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run leader-settings-changed hook" for mysql-innodb-cluster/2 2024-10-31 01:54:22 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running leader-settings-changed hook 2024-10-31 01:54:22 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 01:54:23 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Reactive main running for hook leader-settings-changed 2024-10-31 01:54:23 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Initializing Snap Layer 2024-10-31 01:54:23 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator.DelayedActionCoordinator Loading state 2024-10-31 01:54:23 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Coordinator: Initializing coordinator layer 2024-10-31 01:54:23 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Initializing Leadership Layer (is follower) 2024-10-31 01:54:23 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: starting handler dispatch, 70 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.connected tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-17-134-150 tracer: set flag leadership.set.cluster-instance-clustered-252-17-137-230 tracer: set flag leadership.set.cluster-instance-clustered-252-17-186-134 tracer: set flag leadership.set.cluster-instance-configured-252-17-134-150 tracer: set flag leadership.set.cluster-instance-configured-252-17-137-230 tracer: set flag leadership.set.cluster-instance-configured-252-17-186-134 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 01:54:23 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-10-31 01:54:23 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 01:54:23 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-10-31 01:54:23 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Found peers: 252.17.134.150,252.17.186.134 2024-10-31 01:54:23 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Expect 2 peers 2024-10-31 01:54:23 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Reached quorum 2024-10-31 01:54:23 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 01:54:23 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-10-31 01:54:23 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-10-31 01:54:23 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-10-31 01:54:23 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router 2024-10-31 01:54:23 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 01:54:23 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Running _assess_status() 2024-10-31 01:54:24 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-10-31 01:54:24 DEBUG unit.mysql-innodb-cluster/2.leader-settings-changed logger.go:60 active 2024-10-31 01:54:24 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Opening db connection for root@localhost 2024-10-31 01:54:24 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Checking cluster status. 2024-10-31 01:54:25 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Opening db connection for root@None 2024-10-31 01:54:25 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator.DelayedActionCoordinator Publishing state 2024-10-31 01:54:25 INFO juju.worker.uniter.operation runhook.go:159 ran "leader-settings-changed" hook (via explicit, bespoke hook script) 2024-10-31 01:54:25 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run leader-settings-changed hook" for mysql-innodb-cluster/2 2024-10-31 01:54:25 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 01:54:25 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run leader-settings-changed hook) 2024-10-31 01:54:25 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 01:54:25 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 01:54:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-10-31 01:54:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 01:54:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 01:54:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-10-31 01:54:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-10-31 01:54:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-10-31 01:54:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-10-31 01:54:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-10-31 01:54:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 01:54:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 01:54:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-10-31 01:54:25 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 2024-10-31 02:00:00 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for mysql-innodb-cluster/2 2024-10-31 02:00:00 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 02:00:00 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-10-31 02:00:00 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-10-31 02:00:00 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-10-31 02:00:00 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-10-31 02:00:00 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 02:00:00 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 02:00:00 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 02:00:00 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 02:00:00 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-10-31 02:00:00 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-10-31 02:00:00 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-10-31 02:00:00 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for mysql-innodb-cluster/2 2024-10-31 02:00:00 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run update-status hook) 2024-10-31 02:00:00 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run update-status hook) 2024-10-31 02:00:00 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for mysql-innodb-cluster/2 2024-10-31 02:00:00 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for mysql-innodb-cluster/2 2024-10-31 02:00:00 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 02:00:00 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Reactive main running for hook update-status 2024-10-31 02:00:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 02:00:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.ssl_cert 2024-10-31 02:00:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.ssl_key 2024-10-31 02:00:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.ssl_ca 2024-10-31 02:00:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.source 2024-10-31 02:00:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.source 2024-10-31 02:00:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.cluster-name 2024-10-31 02:00:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.cluster-name 2024-10-31 02:00:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.auto-rejoin-tries 2024-10-31 02:00:02 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.auto-rejoin-tries 2024-10-31 02:00:02 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.expel-timeout 2024-10-31 02:00:02 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.expel-timeout 2024-10-31 02:00:02 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-buffer-pool-size 2024-10-31 02:00:02 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-change-buffering 2024-10-31 02:00:02 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.innodb-change-buffering 2024-10-31 02:00:02 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-io-capacity 2024-10-31 02:00:02 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.innodb-io-capacity 2024-10-31 02:00:02 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-file-per-table 2024-10-31 02:00:02 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.innodb-file-per-table 2024-10-31 02:00:02 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.tuning-level 2024-10-31 02:00:02 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.tuning-level 2024-10-31 02:00:02 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.table-open-cache 2024-10-31 02:00:02 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.table-open-cache 2024-10-31 02:00:02 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.max-connections 2024-10-31 02:00:02 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.enable-binlogs 2024-10-31 02:00:02 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.binlogs-path 2024-10-31 02:00:02 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.binlogs-path 2024-10-31 02:00:02 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.binlogs-max-size 2024-10-31 02:00:02 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.binlogs-max-size 2024-10-31 02:00:02 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.binlogs-expire-days 2024-10-31 02:00:03 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.binlogs-expire-days 2024-10-31 02:00:03 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.prefer-ipv6 2024-10-31 02:00:03 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.wait-timeout 2024-10-31 02:00:03 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.wait-timeout 2024-10-31 02:00:03 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.os-db-router-hostname 2024-10-31 02:00:03 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Initializing Snap Layer 2024-10-31 02:00:03 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator.DelayedActionCoordinator Loading state 2024-10-31 02:00:03 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Coordinator: Initializing coordinator layer 2024-10-31 02:00:03 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Initializing Leadership Layer (is follower) 2024-10-31 02:00:03 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: starting handler dispatch, 105 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-17-134-150 tracer: set flag leadership.set.cluster-instance-clustered-252-17-137-230 tracer: set flag leadership.set.cluster-instance-clustered-252-17-186-134 tracer: set flag leadership.set.cluster-instance-configured-252-17-134-150 tracer: set flag leadership.set.cluster-instance-configured-252-17-137-230 tracer: set flag leadership.set.cluster-instance-configured-252-17-186-134 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 02:00:03 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:64:default_update_status 2024-10-31 02:00:03 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:64:default_update_status 2024-10-31 02:00:03 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag run-default-update-status 2024-10-31 02:00:03 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag is-update-status-hook 2024-10-31 02:00:03 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: main dispatch loop, 9 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:82:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:93:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 02:00:03 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:82:check_really_is_update_status 2024-10-31 02:00:03 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:93:run_default_update_status 2024-10-31 02:00:03 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:93:run_default_update_status 2024-10-31 02:00:03 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-10-31 02:00:03 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Found peers: 252.17.134.150,252.17.186.134 2024-10-31 02:00:03 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Expect 2 peers 2024-10-31 02:00:03 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Reached quorum 2024-10-31 02:00:04 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 02:00:04 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-10-31 02:00:04 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-10-31 02:00:04 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-10-31 02:00:04 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router 2024-10-31 02:00:04 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 02:00:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Running _assess_status() 2024-10-31 02:00:05 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-10-31 02:00:05 DEBUG unit.mysql-innodb-cluster/2.update-status logger.go:60 active 2024-10-31 02:00:05 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Opening db connection for root@localhost 2024-10-31 02:00:05 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Checking cluster status. 2024-10-31 02:00:08 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Opening db connection for root@None 2024-10-31 02:00:08 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 02:00:08 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator.DelayedActionCoordinator Publishing state 2024-10-31 02:00:09 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-10-31 02:00:09 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for mysql-innodb-cluster/2 2024-10-31 02:00:09 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 02:00:09 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run update-status hook) 2024-10-31 02:00:09 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 02:00:09 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 02:00:09 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-10-31 02:00:09 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-10-31 02:00:09 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-10-31 02:00:09 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 02:00:09 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 02:00:09 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-10-31 02:00:09 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 02:00:09 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 02:00:09 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-10-31 02:00:09 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-10-31 02:00:09 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-10-31 02:04:56 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for mysql-innodb-cluster/2 2024-10-31 02:04:56 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 02:04:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 02:04:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 02:04:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-10-31 02:04:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-10-31 02:04:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-10-31 02:04:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-10-31 02:04:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-10-31 02:04:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-10-31 02:04:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-10-31 02:04:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 02:04:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 02:04:56 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for mysql-innodb-cluster/2 2024-10-31 02:04:56 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run update-status hook) 2024-10-31 02:04:56 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run update-status hook) 2024-10-31 02:04:56 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for mysql-innodb-cluster/2 2024-10-31 02:04:56 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for mysql-innodb-cluster/2 2024-10-31 02:04:56 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 02:04:59 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Reactive main running for hook update-status 2024-10-31 02:05:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 02:05:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.ssl_cert 2024-10-31 02:05:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.ssl_key 2024-10-31 02:05:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.ssl_ca 2024-10-31 02:05:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.source 2024-10-31 02:05:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.source 2024-10-31 02:05:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.cluster-name 2024-10-31 02:05:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.cluster-name 2024-10-31 02:05:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.auto-rejoin-tries 2024-10-31 02:05:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.auto-rejoin-tries 2024-10-31 02:05:01 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.expel-timeout 2024-10-31 02:05:02 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.expel-timeout 2024-10-31 02:05:02 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-buffer-pool-size 2024-10-31 02:05:02 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-change-buffering 2024-10-31 02:05:02 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.innodb-change-buffering 2024-10-31 02:05:02 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-io-capacity 2024-10-31 02:05:02 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.innodb-io-capacity 2024-10-31 02:05:02 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-file-per-table 2024-10-31 02:05:02 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.innodb-file-per-table 2024-10-31 02:05:02 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.tuning-level 2024-10-31 02:05:02 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.tuning-level 2024-10-31 02:05:02 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.table-open-cache 2024-10-31 02:05:02 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.table-open-cache 2024-10-31 02:05:02 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.max-connections 2024-10-31 02:05:02 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.enable-binlogs 2024-10-31 02:05:02 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.binlogs-path 2024-10-31 02:05:03 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.binlogs-path 2024-10-31 02:05:03 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.binlogs-max-size 2024-10-31 02:05:03 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.binlogs-max-size 2024-10-31 02:05:03 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.binlogs-expire-days 2024-10-31 02:05:03 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.binlogs-expire-days 2024-10-31 02:05:03 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.prefer-ipv6 2024-10-31 02:05:03 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.wait-timeout 2024-10-31 02:05:03 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.wait-timeout 2024-10-31 02:05:03 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.os-db-router-hostname 2024-10-31 02:05:03 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Initializing Snap Layer 2024-10-31 02:05:03 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator.DelayedActionCoordinator Loading state 2024-10-31 02:05:03 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Coordinator: Initializing coordinator layer 2024-10-31 02:05:03 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Initializing Leadership Layer (is follower) 2024-10-31 02:05:03 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: starting handler dispatch, 105 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-17-134-150 tracer: set flag leadership.set.cluster-instance-clustered-252-17-137-230 tracer: set flag leadership.set.cluster-instance-clustered-252-17-186-134 tracer: set flag leadership.set.cluster-instance-configured-252-17-134-150 tracer: set flag leadership.set.cluster-instance-configured-252-17-137-230 tracer: set flag leadership.set.cluster-instance-configured-252-17-186-134 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 02:05:03 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:64:default_update_status 2024-10-31 02:05:03 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:64:default_update_status 2024-10-31 02:05:03 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag run-default-update-status 2024-10-31 02:05:03 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag is-update-status-hook 2024-10-31 02:05:03 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: main dispatch loop, 9 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:82:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:93:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 02:05:03 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:82:check_really_is_update_status 2024-10-31 02:05:03 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:93:run_default_update_status 2024-10-31 02:05:03 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:93:run_default_update_status 2024-10-31 02:05:03 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-10-31 02:05:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Found peers: 252.17.134.150,252.17.186.134 2024-10-31 02:05:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Expect 2 peers 2024-10-31 02:05:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Reached quorum 2024-10-31 02:05:04 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 02:05:04 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-10-31 02:05:04 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-10-31 02:05:04 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-10-31 02:05:04 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router 2024-10-31 02:05:04 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 02:05:04 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Running _assess_status() 2024-10-31 02:05:06 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-10-31 02:05:06 DEBUG unit.mysql-innodb-cluster/2.update-status logger.go:60 active 2024-10-31 02:05:06 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Opening db connection for root@localhost 2024-10-31 02:05:07 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Checking cluster status. 2024-10-31 02:05:13 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Opening db connection for root@None 2024-10-31 02:05:13 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 02:05:13 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator.DelayedActionCoordinator Publishing state 2024-10-31 02:05:14 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-10-31 02:05:15 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for mysql-innodb-cluster/2 2024-10-31 02:05:15 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 02:05:15 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run update-status hook) 2024-10-31 02:05:15 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 02:05:15 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 02:05:15 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 02:05:15 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 02:05:15 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-10-31 02:05:15 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-10-31 02:05:15 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-10-31 02:05:15 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-10-31 02:05:15 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-10-31 02:05:15 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 02:05:15 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 02:05:15 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-10-31 02:05:15 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-10-31 02:10:20 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for mysql-innodb-cluster/2 2024-10-31 02:10:20 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 02:10:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-10-31 02:10:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-10-31 02:10:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-10-31 02:10:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 02:10:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 02:10:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-10-31 02:10:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-10-31 02:10:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-10-31 02:10:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 02:10:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 02:10:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-10-31 02:10:20 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for mysql-innodb-cluster/2 2024-10-31 02:10:20 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run update-status hook) 2024-10-31 02:10:20 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run update-status hook) 2024-10-31 02:10:20 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for mysql-innodb-cluster/2 2024-10-31 02:10:20 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for mysql-innodb-cluster/2 2024-10-31 02:10:20 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 02:10:23 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Reactive main running for hook update-status 2024-10-31 02:10:24 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 02:10:24 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.ssl_cert 2024-10-31 02:10:24 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.ssl_key 2024-10-31 02:10:24 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.ssl_ca 2024-10-31 02:10:24 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.source 2024-10-31 02:10:24 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.source 2024-10-31 02:10:24 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.cluster-name 2024-10-31 02:10:24 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.cluster-name 2024-10-31 02:10:24 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.auto-rejoin-tries 2024-10-31 02:10:24 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.auto-rejoin-tries 2024-10-31 02:10:24 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.expel-timeout 2024-10-31 02:10:24 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.expel-timeout 2024-10-31 02:10:24 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-buffer-pool-size 2024-10-31 02:10:24 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-change-buffering 2024-10-31 02:10:25 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.innodb-change-buffering 2024-10-31 02:10:25 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-io-capacity 2024-10-31 02:10:25 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.innodb-io-capacity 2024-10-31 02:10:25 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-file-per-table 2024-10-31 02:10:25 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.innodb-file-per-table 2024-10-31 02:10:25 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.tuning-level 2024-10-31 02:10:25 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.tuning-level 2024-10-31 02:10:25 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.table-open-cache 2024-10-31 02:10:25 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.table-open-cache 2024-10-31 02:10:25 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.max-connections 2024-10-31 02:10:25 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.enable-binlogs 2024-10-31 02:10:25 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.binlogs-path 2024-10-31 02:10:25 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.binlogs-path 2024-10-31 02:10:25 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.binlogs-max-size 2024-10-31 02:10:25 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.binlogs-max-size 2024-10-31 02:10:25 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.binlogs-expire-days 2024-10-31 02:10:25 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.binlogs-expire-days 2024-10-31 02:10:25 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.prefer-ipv6 2024-10-31 02:10:25 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.wait-timeout 2024-10-31 02:10:25 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.wait-timeout 2024-10-31 02:10:25 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.os-db-router-hostname 2024-10-31 02:10:25 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Initializing Snap Layer 2024-10-31 02:10:26 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator.DelayedActionCoordinator Loading state 2024-10-31 02:10:26 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Coordinator: Initializing coordinator layer 2024-10-31 02:10:26 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Initializing Leadership Layer (is follower) 2024-10-31 02:10:26 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: starting handler dispatch, 105 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-17-134-150 tracer: set flag leadership.set.cluster-instance-clustered-252-17-137-230 tracer: set flag leadership.set.cluster-instance-clustered-252-17-186-134 tracer: set flag leadership.set.cluster-instance-configured-252-17-134-150 tracer: set flag leadership.set.cluster-instance-configured-252-17-137-230 tracer: set flag leadership.set.cluster-instance-configured-252-17-186-134 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 02:10:26 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:64:default_update_status 2024-10-31 02:10:26 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:64:default_update_status 2024-10-31 02:10:26 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag run-default-update-status 2024-10-31 02:10:26 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag is-update-status-hook 2024-10-31 02:10:26 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: main dispatch loop, 9 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:82:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:93:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 02:10:26 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:82:check_really_is_update_status 2024-10-31 02:10:26 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:93:run_default_update_status 2024-10-31 02:10:26 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:93:run_default_update_status 2024-10-31 02:10:26 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-10-31 02:10:26 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Found peers: 252.17.134.150,252.17.186.134 2024-10-31 02:10:26 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Expect 2 peers 2024-10-31 02:10:26 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Reached quorum 2024-10-31 02:10:26 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 02:10:26 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-10-31 02:10:26 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-10-31 02:10:26 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-10-31 02:10:27 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router 2024-10-31 02:10:27 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 02:10:27 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Running _assess_status() 2024-10-31 02:10:28 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-10-31 02:10:28 DEBUG unit.mysql-innodb-cluster/2.update-status logger.go:60 active 2024-10-31 02:10:28 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Opening db connection for root@localhost 2024-10-31 02:10:28 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Checking cluster status. 2024-10-31 02:10:34 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Opening db connection for root@None 2024-10-31 02:10:35 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 02:10:35 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator.DelayedActionCoordinator Publishing state 2024-10-31 02:10:35 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-10-31 02:10:35 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for mysql-innodb-cluster/2 2024-10-31 02:10:35 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 02:10:35 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run update-status hook) 2024-10-31 02:10:35 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 02:10:35 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 02:10:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-10-31 02:10:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-10-31 02:10:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-10-31 02:10:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 02:10:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 02:10:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-10-31 02:10:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-10-31 02:10:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 02:10:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 02:10:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-10-31 02:10:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-10-31 02:14:44 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for mysql-innodb-cluster/2 2024-10-31 02:14:44 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 02:14:44 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-10-31 02:14:44 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 02:14:44 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 02:14:44 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 02:14:44 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 02:14:44 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-10-31 02:14:44 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-10-31 02:14:44 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-10-31 02:14:44 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-10-31 02:14:44 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-10-31 02:14:44 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-10-31 02:14:44 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for mysql-innodb-cluster/2 2024-10-31 02:14:44 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run update-status hook) 2024-10-31 02:14:44 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run update-status hook) 2024-10-31 02:14:44 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for mysql-innodb-cluster/2 2024-10-31 02:14:44 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for mysql-innodb-cluster/2 2024-10-31 02:14:44 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 02:14:45 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Reactive main running for hook update-status 2024-10-31 02:14:46 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 02:14:46 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.ssl_cert 2024-10-31 02:14:46 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.ssl_key 2024-10-31 02:14:46 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.ssl_ca 2024-10-31 02:14:46 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.source 2024-10-31 02:14:46 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.source 2024-10-31 02:14:46 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.cluster-name 2024-10-31 02:14:46 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.cluster-name 2024-10-31 02:14:46 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.auto-rejoin-tries 2024-10-31 02:14:46 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.auto-rejoin-tries 2024-10-31 02:14:46 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.expel-timeout 2024-10-31 02:14:46 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.expel-timeout 2024-10-31 02:14:47 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-buffer-pool-size 2024-10-31 02:14:47 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-change-buffering 2024-10-31 02:14:47 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.innodb-change-buffering 2024-10-31 02:14:47 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-io-capacity 2024-10-31 02:14:47 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.innodb-io-capacity 2024-10-31 02:14:47 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-file-per-table 2024-10-31 02:14:47 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.innodb-file-per-table 2024-10-31 02:14:47 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.tuning-level 2024-10-31 02:14:47 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.tuning-level 2024-10-31 02:14:47 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.table-open-cache 2024-10-31 02:14:47 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.table-open-cache 2024-10-31 02:14:47 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.max-connections 2024-10-31 02:14:47 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.enable-binlogs 2024-10-31 02:14:47 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.binlogs-path 2024-10-31 02:14:47 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.binlogs-path 2024-10-31 02:14:47 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.binlogs-max-size 2024-10-31 02:14:47 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.binlogs-max-size 2024-10-31 02:14:47 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.binlogs-expire-days 2024-10-31 02:14:48 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.binlogs-expire-days 2024-10-31 02:14:48 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.prefer-ipv6 2024-10-31 02:14:48 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.wait-timeout 2024-10-31 02:14:48 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.wait-timeout 2024-10-31 02:14:48 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.os-db-router-hostname 2024-10-31 02:14:48 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Initializing Snap Layer 2024-10-31 02:14:48 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator.DelayedActionCoordinator Loading state 2024-10-31 02:14:48 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Coordinator: Initializing coordinator layer 2024-10-31 02:14:48 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Initializing Leadership Layer (is follower) 2024-10-31 02:14:48 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: starting handler dispatch, 105 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-17-134-150 tracer: set flag leadership.set.cluster-instance-clustered-252-17-137-230 tracer: set flag leadership.set.cluster-instance-clustered-252-17-186-134 tracer: set flag leadership.set.cluster-instance-configured-252-17-134-150 tracer: set flag leadership.set.cluster-instance-configured-252-17-137-230 tracer: set flag leadership.set.cluster-instance-configured-252-17-186-134 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 02:14:48 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:64:default_update_status 2024-10-31 02:14:48 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:64:default_update_status 2024-10-31 02:14:48 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag run-default-update-status 2024-10-31 02:14:48 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag is-update-status-hook 2024-10-31 02:14:48 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: main dispatch loop, 9 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:82:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:93:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 02:14:48 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:82:check_really_is_update_status 2024-10-31 02:14:48 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:93:run_default_update_status 2024-10-31 02:14:48 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:93:run_default_update_status 2024-10-31 02:14:48 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-10-31 02:14:48 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Found peers: 252.17.134.150,252.17.186.134 2024-10-31 02:14:49 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Expect 2 peers 2024-10-31 02:14:49 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Reached quorum 2024-10-31 02:14:49 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 02:14:49 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-10-31 02:14:49 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-10-31 02:14:49 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-10-31 02:14:49 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router 2024-10-31 02:14:49 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 02:14:49 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Running _assess_status() 2024-10-31 02:14:50 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-10-31 02:14:50 DEBUG unit.mysql-innodb-cluster/2.update-status logger.go:60 active 2024-10-31 02:14:50 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Opening db connection for root@localhost 2024-10-31 02:14:50 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Checking cluster status. 2024-10-31 02:14:51 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Opening db connection for root@None 2024-10-31 02:14:52 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 02:14:52 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator.DelayedActionCoordinator Publishing state 2024-10-31 02:14:52 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-10-31 02:14:52 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for mysql-innodb-cluster/2 2024-10-31 02:14:52 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 02:14:52 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run update-status hook) 2024-10-31 02:14:52 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 02:14:52 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 02:14:52 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 02:14:52 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 02:14:52 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-10-31 02:14:52 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-10-31 02:14:52 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-10-31 02:14:52 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-10-31 02:14:52 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-10-31 02:14:52 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 02:14:52 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 02:14:52 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-10-31 02:14:52 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-10-31 02:19:27 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for mysql-innodb-cluster/2 2024-10-31 02:19:27 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 02:19:27 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-10-31 02:19:27 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 02:19:27 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 02:19:27 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-10-31 02:19:27 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-10-31 02:19:27 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 02:19:27 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 02:19:27 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-10-31 02:19:27 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-10-31 02:19:27 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-10-31 02:19:27 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-10-31 02:19:27 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for mysql-innodb-cluster/2 2024-10-31 02:19:27 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/2 uniter (run update-status hook) 2024-10-31 02:19:27 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/2 uniter (run update-status hook) 2024-10-31 02:19:27 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for mysql-innodb-cluster/2 2024-10-31 02:19:27 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for mysql-innodb-cluster/2 2024-10-31 02:19:27 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-2/agent.socket } 2024-10-31 02:19:28 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Reactive main running for hook update-status 2024-10-31 02:19:28 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 02:19:29 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.ssl_cert 2024-10-31 02:19:29 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.ssl_key 2024-10-31 02:19:29 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.ssl_ca 2024-10-31 02:19:29 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.source 2024-10-31 02:19:29 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.source 2024-10-31 02:19:29 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.cluster-name 2024-10-31 02:19:29 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.cluster-name 2024-10-31 02:19:29 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.auto-rejoin-tries 2024-10-31 02:19:29 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.auto-rejoin-tries 2024-10-31 02:19:29 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.expel-timeout 2024-10-31 02:19:29 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.expel-timeout 2024-10-31 02:19:29 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-buffer-pool-size 2024-10-31 02:19:29 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-change-buffering 2024-10-31 02:19:29 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.innodb-change-buffering 2024-10-31 02:19:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-io-capacity 2024-10-31 02:19:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.innodb-io-capacity 2024-10-31 02:19:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.innodb-file-per-table 2024-10-31 02:19:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.innodb-file-per-table 2024-10-31 02:19:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.tuning-level 2024-10-31 02:19:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.tuning-level 2024-10-31 02:19:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.table-open-cache 2024-10-31 02:19:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.table-open-cache 2024-10-31 02:19:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.max-connections 2024-10-31 02:19:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.enable-binlogs 2024-10-31 02:19:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.binlogs-path 2024-10-31 02:19:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.binlogs-path 2024-10-31 02:19:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.binlogs-max-size 2024-10-31 02:19:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.binlogs-max-size 2024-10-31 02:19:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.binlogs-expire-days 2024-10-31 02:19:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.binlogs-expire-days 2024-10-31 02:19:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.prefer-ipv6 2024-10-31 02:19:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.set.wait-timeout 2024-10-31 02:19:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.wait-timeout 2024-10-31 02:19:30 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag config.default.os-db-router-hostname 2024-10-31 02:19:30 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Initializing Snap Layer 2024-10-31 02:19:31 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator.DelayedActionCoordinator Loading state 2024-10-31 02:19:31 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Coordinator: Initializing coordinator layer 2024-10-31 02:19:31 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Initializing Leadership Layer (is follower) 2024-10-31 02:19:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: starting handler dispatch, 105 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-17-134-150 tracer: set flag leadership.set.cluster-instance-clustered-252-17-137-230 tracer: set flag leadership.set.cluster-instance-clustered-252-17-186-134 tracer: set flag leadership.set.cluster-instance-configured-252-17-134-150 tracer: set flag leadership.set.cluster-instance-configured-252-17-137-230 tracer: set flag leadership.set.cluster-instance-configured-252-17-186-134 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-10-31 02:19:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:64:default_update_status 2024-10-31 02:19:31 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:64:default_update_status 2024-10-31 02:19:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag run-default-update-status 2024-10-31 02:19:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer: set flag is-update-status-hook 2024-10-31 02:19:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: main dispatch loop, 9 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:82:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:93:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 02:19:31 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:82:check_really_is_update_status 2024-10-31 02:19:31 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:93:run_default_update_status 2024-10-31 02:19:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:93:run_default_update_status 2024-10-31 02:19:31 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-10-31 02:19:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Found peers: 252.17.134.150,252.17.186.134 2024-10-31 02:19:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Expect 2 peers 2024-10-31 02:19:31 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Reached quorum 2024-10-31 02:19:31 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 02:19:31 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-10-31 02:19:31 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-10-31 02:19:31 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-10-31 02:19:32 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router 2024-10-31 02:19:32 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-10-31 02:19:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Running _assess_status() 2024-10-31 02:19:32 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-10-31 02:19:32 DEBUG unit.mysql-innodb-cluster/2.update-status logger.go:60 active 2024-10-31 02:19:32 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Opening db connection for root@localhost 2024-10-31 02:19:33 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Checking cluster status. 2024-10-31 02:19:34 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 Opening db connection for root@None 2024-10-31 02:19:34 DEBUG unit.mysql-innodb-cluster/2.juju-log server.go:316 tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:240:signal_clustered 2024-10-31 02:19:34 INFO unit.mysql-innodb-cluster/2.juju-log server.go:316 coordinator.DelayedActionCoordinator Publishing state 2024-10-31 02:19:35 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-10-31 02:19:35 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for mysql-innodb-cluster/2 2024-10-31 02:19:35 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-10-31 02:19:35 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/2 uniter (run update-status hook) 2024-10-31 02:19:35 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/2 2024-10-31 02:19:35 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-10-31 02:19:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-10-31 02:19:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 3 2024-10-31 02:19:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-10-31 02:19:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-10-31 02:19:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-10-31 02:19:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/1" already joined relation 4 2024-10-31 02:19:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-10-31 02:19:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-10-31 02:19:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-10-31 02:19:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-10-31 02:19:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39