2024-11-07 00:11:08 INFO juju unit_agent.go:289 Starting unit workers for "mysql-innodb-cluster/1" 2024-11-07 00:11:08 INFO juju.worker.apicaller connect.go:163 [d6d297] "unit-mysql-innodb-cluster-1" successfully connected to "10.0.0.49:17070" 2024-11-07 00:11:08 INFO juju.worker.apicaller connect.go:260 [d6d297] password changed for "unit-mysql-innodb-cluster-1" 2024-11-07 00:11:09 INFO juju.worker.apicaller connect.go:163 [d6d297] "unit-mysql-innodb-cluster-1" successfully connected to "10.0.0.49:17070" 2024-11-07 00:11:09 INFO juju.worker.migrationminion worker.go:142 migration phase is now: NONE 2024-11-07 00:11:09 INFO juju.worker.logger logger.go:120 logger worker started 2024-11-07 00:11:09 DEBUG juju.worker.apiaddressupdater apiaddressupdater.go:98 updating API hostPorts to [[10.0.0.49:17070 252.49.0.1:17070 127.0.0.1:17070 [::1]:17070]] 2024-11-07 00:11:09 DEBUG juju.worker.meterstatus connected.go:93 got meter status change signal from watcher 2024-11-07 00:11:09 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for meterstatus (meter-status-changed) 2024-11-07 00:11:09 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for meterstatus (meter-status-changed) 2024-11-07 00:11:09 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-1/agent.socket } 2024-11-07 00:11:09 ERROR juju.worker.meterstatus runner.go:93 error running "meter-status-changed": charm missing from disk 2024-11-07 00:11:09 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-07 00:11:09 DEBUG juju.machinelock machinelock.go:186 machine lock released for meterstatus (meter-status-changed) 2024-11-07 00:11:09 DEBUG juju.worker.dependency engine.go:580 "metric-sender" manifold worker started at 2024-11-07 00:11:09.245460203 +0000 UTC 2024-11-07 00:11:09 DEBUG juju.worker.dependency engine.go:580 "uniter" manifold worker started at 2024-11-07 00:11:09.245628087 +0000 UTC 2024-11-07 00:11:09 INFO juju.worker.upgrader upgrader.go:216 no waiter, upgrader is done 2024-11-07 00:11:09 DEBUG juju.worker.dependency engine.go:603 "upgrader" manifold worker completed successfully 2024-11-07 00:11:09 DEBUG juju.worker.uniter uniter.go:883 starting local juju-run listener on {unix /var/lib/juju/agents/unit-mysql-innodb-cluster-1/run.socket } 2024-11-07 00:11:09 INFO juju.worker.uniter uniter.go:335 unit "mysql-innodb-cluster/1" started 2024-11-07 00:11:09 DEBUG juju.worker.uniter runlistener.go:117 juju-run listener running 2024-11-07 00:11:09 INFO juju.worker.uniter uniter.go:651 resuming charm install 2024-11-07 00:11:09 DEBUG juju.worker.uniter uniter.go:601 no lxd profile required for ch:amd64/jammy/mysql-innodb-cluster-153 2024-11-07 00:11:09 DEBUG juju.worker.uniter.operation executor.go:85 running operation install ch:amd64/jammy/mysql-innodb-cluster-153 for mysql-innodb-cluster/1 2024-11-07 00:11:09 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "install ch:amd64/jammy/mysql-innodb-cluster-153" for mysql-innodb-cluster/1 2024-11-07 00:11:09 INFO juju.worker.uniter.charm bundles.go:81 downloading ch:amd64/jammy/mysql-innodb-cluster-153 from API server 2024-11-07 00:11:11 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "install ch:amd64/jammy/mysql-innodb-cluster-153" for mysql-innodb-cluster/1 2024-11-07 00:11:11 DEBUG juju.worker.uniter.charm manifest_deployer.go:143 preparing to deploy charm "ch:amd64/jammy/mysql-innodb-cluster-153" 2024-11-07 00:11:11 DEBUG juju.worker.uniter.charm manifest_deployer.go:132 deploying charm "ch:amd64/jammy/mysql-innodb-cluster-153" 2024-11-07 00:11:17 DEBUG juju.worker.uniter.charm manifest_deployer.go:164 finishing deploy of charm "ch:amd64/jammy/mysql-innodb-cluster-153" 2024-11-07 00:11:17 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "install ch:amd64/jammy/mysql-innodb-cluster-153" for mysql-innodb-cluster/1 2024-11-07 00:11:17 INFO juju.worker.uniter uniter.go:361 hooks are retried true 2024-11-07 00:11:17 DEBUG juju.worker.uniter.remotestate watcher.go:613 got storage change for mysql-innodb-cluster/1: [] ok=true 2024-11-07 00:11:17 DEBUG juju.worker.uniter.remotestate watcher.go:489 got unit change for mysql-innodb-cluster/1 2024-11-07 00:11:17 DEBUG juju.worker.uniter.remotestate watcher.go:595 got action change for mysql-innodb-cluster/1: [] ok=true 2024-11-07 00:11:17 DEBUG juju.worker.uniter.remotestate watcher.go:542 got config change for mysql-innodb-cluster/1: ok=true, hashes=[16220c72d89b4caf072292fc8a79692b89ee0cd3ccb03f9ea52e6ca7cca5ed2b] 2024-11-07 00:11:17 DEBUG juju.worker.uniter.remotestate watcher.go:623 got update status interval change for mysql-innodb-cluster/1: ok=true 2024-11-07 00:11:17 DEBUG juju.worker.uniter.remotestate watcher.go:509 got instance data change for mysql-innodb-cluster/1 2024-11-07 00:11:17 DEBUG juju.worker.uniter.remotestate watcher.go:843 LXDProfileName changed to "" 2024-11-07 00:11:17 DEBUG juju.worker.uniter.remotestate watcher.go:553 got trust config change for mysql-innodb-cluster/1: ok=true, hashes=[aeddf8dcd2b7e0ac0c37321c9d8645dff25799f0d355a7d57fccc94a3c9956b2] 2024-11-07 00:11:17 DEBUG juju.worker.uniter.remotestate watcher.go:564 got upgrade series change 2024-11-07 00:11:17 DEBUG juju.worker.uniter.remotestate watcher.go:714 no upgrade series in progress, reinitializing local upgrade series state 2024-11-07 00:11:17 DEBUG juju.worker.uniter.remotestate watcher.go:499 got application change for mysql-innodb-cluster/1 2024-11-07 00:11:17 DEBUG juju.worker.uniter.remotestate watcher.go:574 got address change for mysql-innodb-cluster/1: ok=true, hashes=[f4eb3045c318653b55be25c714b120ef6f410729ac6a6b0585eca24b5e1db320] 2024-11-07 00:11:17 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for mysql-innodb-cluster/1: ok=true 2024-11-07 00:11:17 DEBUG juju.worker.uniter.remotestate watcher.go:603 got relations change for mysql-innodb-cluster/1: ok=true 2024-11-07 00:11:17 INFO juju.worker.uniter.storage resolver.go:126 initial storage attachments ready 2024-11-07 00:11:17 INFO juju.worker.uniter resolver.go:159 found queued "install" hook 2024-11-07 00:11:17 DEBUG juju.worker.uniter.operation executor.go:85 running operation run install hook for mysql-innodb-cluster/1 2024-11-07 00:11:17 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/1 uniter (run install hook) 2024-11-07 00:11:17 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/1 uniter (run install hook) 2024-11-07 00:11:17 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run install hook" for mysql-innodb-cluster/1 2024-11-07 00:11:17 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run install hook" for mysql-innodb-cluster/1 2024-11-07 00:11:17 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running install hook 2024-11-07 00:11:17 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-1/agent.socket } 2024-11-07 00:11:17 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Running the apt-get install command as .is-git-installed not set 2024-11-07 00:11:18 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Reading package lists... 2024-11-07 00:11:18 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Building dependency tree... 2024-11-07 00:11:18 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Reading state information... 2024-11-07 00:11:19 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 git is already the newest version (1:2.34.1-1ubuntu1.10). 2024-11-07 00:11:19 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 git set to manually installed. 2024-11-07 00:11:19 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 0 upgraded, 0 newly installed, 0 to remove and 0 not upgraded. 2024-11-07 00:11:19 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Reading package lists... 2024-11-07 00:11:19 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Building dependency tree... 2024-11-07 00:11:19 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Reading state information... 2024-11-07 00:11:19 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 python3-yaml is already the newest version (5.4.1-1ubuntu1). 2024-11-07 00:11:19 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 python3-yaml set to manually installed. 2024-11-07 00:11:19 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 python3-setuptools is already the newest version (59.6.0-1.2ubuntu0.22.04.1). 2024-11-07 00:11:19 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 The following additional packages will be installed: 2024-11-07 00:11:19 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 bzip2 cpp cpp-11 dpkg-dev fakeroot fontconfig-config fonts-dejavu-core g++ 2024-11-07 00:11:19 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 g++-11 gcc gcc-11 gcc-11-base javascript-common libalgorithm-diff-perl 2024-11-07 00:11:19 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 libalgorithm-diff-xs-perl libalgorithm-merge-perl libasan6 libatomic1 2024-11-07 00:11:19 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 libc-dev-bin libc-devtools libc6-dev libcc1-0 libcrypt-dev libdeflate0 2024-11-07 00:11:19 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 libdpkg-perl libexpat1-dev libfakeroot libfile-fcntllock-perl libfontconfig1 2024-11-07 00:11:19 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 libfreetype6 libgcc-11-dev libgd3 libgomp1 libisl23 libitm1 libjbig0 2024-11-07 00:11:19 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 libjpeg-turbo8 libjpeg8 libjs-jquery libjs-sphinxdoc libjs-underscore 2024-11-07 00:11:19 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 liblsan0 libmpc3 libnsl-dev libpython3-dev libpython3.10-dev libquadmath0 2024-11-07 00:11:19 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 libstdc++-11-dev libtiff5 libtirpc-dev libtsan0 libubsan1 libwebp7 libxpm4 2024-11-07 00:11:19 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 linux-libc-dev lto-disabled-list make manpages-dev python3.10-dev 2024-11-07 00:11:19 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 rpcsvc-proto zlib1g-dev 2024-11-07 00:11:19 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Suggested packages: 2024-11-07 00:11:19 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 bzip2-doc cpp-doc gcc-11-locales debian-keyring g++-multilib g++-11-multilib 2024-11-07 00:11:19 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 gcc-11-doc gcc-multilib autoconf automake libtool flex bison gdb gcc-doc 2024-11-07 00:11:19 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 gcc-11-multilib apache2 | lighttpd | httpd glibc-doc bzr libgd-tools 2024-11-07 00:11:19 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 libstdc++-11-doc make-doc 2024-11-07 00:11:19 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 The following NEW packages will be installed: 2024-11-07 00:11:19 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 build-essential bzip2 cpp cpp-11 dpkg-dev fakeroot fontconfig-config 2024-11-07 00:11:19 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 fonts-dejavu-core g++ g++-11 gcc gcc-11 gcc-11-base javascript-common 2024-11-07 00:11:19 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 libalgorithm-diff-perl libalgorithm-diff-xs-perl libalgorithm-merge-perl 2024-11-07 00:11:19 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 libasan6 libatomic1 libc-dev-bin libc-devtools libc6-dev libcc1-0 2024-11-07 00:11:19 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 libcrypt-dev libdeflate0 libdpkg-perl libexpat1-dev libfakeroot 2024-11-07 00:11:19 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 libfile-fcntllock-perl libfontconfig1 libfreetype6 libgcc-11-dev libgd3 2024-11-07 00:11:19 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 libgomp1 libisl23 libitm1 libjbig0 libjpeg-turbo8 libjpeg8 libjs-jquery 2024-11-07 00:11:19 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 libjs-sphinxdoc libjs-underscore liblsan0 libmpc3 libnsl-dev libpython3-dev 2024-11-07 00:11:19 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 libpython3.10-dev libquadmath0 libstdc++-11-dev libtiff5 libtirpc-dev 2024-11-07 00:11:19 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 libtsan0 libubsan1 libwebp7 libxpm4 linux-libc-dev lto-disabled-list make 2024-11-07 00:11:19 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 manpages-dev python3-dev python3-pip python3-wheel python3.10-dev 2024-11-07 00:11:19 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 rpcsvc-proto zlib1g-dev 2024-11-07 00:11:19 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 0 upgraded, 65 newly installed, 0 to remove and 0 not upgraded. 2024-11-07 00:11:19 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Need to get 71.7 MB of archives. 2024-11-07 00:11:19 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 After this operation, 240 MB of additional disk space will be used. 2024-11-07 00:11:19 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:1 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/main amd64 libc-dev-bin amd64 2.35-0ubuntu3.7 [20.3 kB] 2024-11-07 00:11:19 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:2 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-libc-dev amd64 5.15.0-105.115 [1330 kB] 2024-11-07 00:11:19 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:3 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 libcrypt-dev amd64 1:4.4.27-1 [112 kB] 2024-11-07 00:11:19 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:4 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 rpcsvc-proto amd64 1.4.2-0ubuntu6 [68.5 kB] 2024-11-07 00:11:19 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:5 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/main amd64 libtirpc-dev amd64 1.3.2-2ubuntu0.1 [192 kB] 2024-11-07 00:11:19 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:6 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 libnsl-dev amd64 1.3.0-2build2 [71.3 kB] 2024-11-07 00:11:19 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:7 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/main amd64 libc6-dev amd64 2.35-0ubuntu3.7 [2100 kB] 2024-11-07 00:11:19 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:8 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/main amd64 gcc-11-base amd64 11.4.0-1ubuntu1~22.04 [20.2 kB] 2024-11-07 00:11:19 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:9 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 libisl23 amd64 0.24-2build1 [727 kB] 2024-11-07 00:11:19 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:10 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 libmpc3 amd64 1.2.1-2build1 [46.9 kB] 2024-11-07 00:11:19 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:11 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/main amd64 cpp-11 amd64 11.4.0-1ubuntu1~22.04 [10.0 MB] 2024-11-07 00:11:19 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:12 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 cpp amd64 4:11.2.0-1ubuntu1 [27.7 kB] 2024-11-07 00:11:19 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:13 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/main amd64 libcc1-0 amd64 12.3.0-1ubuntu1~22.04 [48.3 kB] 2024-11-07 00:11:19 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:14 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgomp1 amd64 12.3.0-1ubuntu1~22.04 [126 kB] 2024-11-07 00:11:19 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:15 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/main amd64 libitm1 amd64 12.3.0-1ubuntu1~22.04 [30.2 kB] 2024-11-07 00:11:19 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:16 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/main amd64 libatomic1 amd64 12.3.0-1ubuntu1~22.04 [10.4 kB] 2024-11-07 00:11:19 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:17 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/main amd64 libasan6 amd64 11.4.0-1ubuntu1~22.04 [2282 kB] 2024-11-07 00:11:19 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:18 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/main amd64 liblsan0 amd64 12.3.0-1ubuntu1~22.04 [1069 kB] 2024-11-07 00:11:19 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:19 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/main amd64 libtsan0 amd64 11.4.0-1ubuntu1~22.04 [2260 kB] 2024-11-07 00:11:19 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:20 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/main amd64 libubsan1 amd64 12.3.0-1ubuntu1~22.04 [976 kB] 2024-11-07 00:11:19 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:21 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/main amd64 libquadmath0 amd64 12.3.0-1ubuntu1~22.04 [154 kB] 2024-11-07 00:11:19 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:22 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgcc-11-dev amd64 11.4.0-1ubuntu1~22.04 [2517 kB] 2024-11-07 00:11:19 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:23 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/main amd64 gcc-11 amd64 11.4.0-1ubuntu1~22.04 [20.1 MB] 2024-11-07 00:11:20 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:24 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 gcc amd64 4:11.2.0-1ubuntu1 [5112 B] 2024-11-07 00:11:20 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:25 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/main amd64 libstdc++-11-dev amd64 11.4.0-1ubuntu1~22.04 [2101 kB] 2024-11-07 00:11:20 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:26 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/main amd64 g++-11 amd64 11.4.0-1ubuntu1~22.04 [11.4 MB] 2024-11-07 00:11:20 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:27 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 g++ amd64 4:11.2.0-1ubuntu1 [1412 B] 2024-11-07 00:11:20 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:28 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 make amd64 4.3-4.1build1 [180 kB] 2024-11-07 00:11:20 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:29 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/main amd64 libdpkg-perl all 1.21.1ubuntu2.3 [237 kB] 2024-11-07 00:11:20 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:30 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 bzip2 amd64 1.0.8-5build1 [34.8 kB] 2024-11-07 00:11:20 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:31 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 lto-disabled-list all 24 [12.5 kB] 2024-11-07 00:11:20 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:32 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/main amd64 dpkg-dev all 1.21.1ubuntu2.3 [922 kB] 2024-11-07 00:11:20 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:33 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 build-essential amd64 12.9ubuntu3 [4744 B] 2024-11-07 00:11:20 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:34 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 libfakeroot amd64 1.28-1ubuntu1 [31.5 kB] 2024-11-07 00:11:20 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:35 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 fakeroot amd64 1.28-1ubuntu1 [60.4 kB] 2024-11-07 00:11:20 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:36 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 fonts-dejavu-core all 2.37-2build1 [1041 kB] 2024-11-07 00:11:20 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:37 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 fontconfig-config all 2.13.1-4.2ubuntu5 [29.1 kB] 2024-11-07 00:11:20 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:38 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 javascript-common all 11+nmu1 [5936 B] 2024-11-07 00:11:20 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:39 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 libalgorithm-diff-perl all 1.201-1 [41.8 kB] 2024-11-07 00:11:20 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:40 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 libalgorithm-diff-xs-perl amd64 0.04-6build3 [11.9 kB] 2024-11-07 00:11:20 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:41 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 libalgorithm-merge-perl all 0.08-3 [12.0 kB] 2024-11-07 00:11:20 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:42 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/main amd64 libfreetype6 amd64 2.11.1+dfsg-1ubuntu0.2 [389 kB] 2024-11-07 00:11:20 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:43 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 libfontconfig1 amd64 2.13.1-4.2ubuntu5 [131 kB] 2024-11-07 00:11:20 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:44 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 libjpeg-turbo8 amd64 2.1.2-0ubuntu1 [134 kB] 2024-11-07 00:11:20 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:45 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 libjpeg8 amd64 8c-2ubuntu10 [2264 B] 2024-11-07 00:11:20 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:46 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 libdeflate0 amd64 1.10-2 [70.9 kB] 2024-11-07 00:11:20 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:47 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/main amd64 libjbig0 amd64 2.1-3.1ubuntu0.22.04.1 [29.2 kB] 2024-11-07 00:11:20 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:48 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/main amd64 libwebp7 amd64 1.2.2-2ubuntu0.22.04.2 [206 kB] 2024-11-07 00:11:20 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:49 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/main amd64 libtiff5 amd64 4.3.0-6ubuntu0.8 [185 kB] 2024-11-07 00:11:20 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:50 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/main amd64 libxpm4 amd64 1:3.5.12-1ubuntu0.22.04.2 [36.7 kB] 2024-11-07 00:11:20 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:51 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 libgd3 amd64 2.3.0-2ubuntu2 [129 kB] 2024-11-07 00:11:20 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:52 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/main amd64 libc-devtools amd64 2.35-0ubuntu3.7 [29.0 kB] 2024-11-07 00:11:20 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:53 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/main amd64 libexpat1-dev amd64 2.4.7-1ubuntu0.3 [147 kB] 2024-11-07 00:11:20 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:54 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 libfile-fcntllock-perl amd64 0.22-3build7 [33.9 kB] 2024-11-07 00:11:20 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:55 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 libjs-jquery all 3.6.0+dfsg+~3.5.13-1 [321 kB] 2024-11-07 00:11:20 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:56 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 libjs-underscore all 1.13.2~dfsg-2 [118 kB] 2024-11-07 00:11:20 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:57 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 libjs-sphinxdoc all 4.3.2-1 [139 kB] 2024-11-07 00:11:20 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:58 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/main amd64 zlib1g-dev amd64 1:1.2.11.dfsg-2ubuntu9.2 [164 kB] 2024-11-07 00:11:20 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:59 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpython3.10-dev amd64 3.10.12-1~22.04.3 [4762 kB] 2024-11-07 00:11:20 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:60 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpython3-dev amd64 3.10.6-1~22.04 [7166 B] 2024-11-07 00:11:20 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:61 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 manpages-dev all 5.10-1ubuntu1 [2309 kB] 2024-11-07 00:11:20 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:62 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3.10-dev amd64 3.10.12-1~22.04.3 [507 kB] 2024-11-07 00:11:20 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:63 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-dev amd64 3.10.6-1~22.04 [26.0 kB] 2024-11-07 00:11:20 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:64 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/universe amd64 python3-wheel all 0.37.1-2ubuntu0.22.04.1 [32.0 kB] 2024-11-07 00:11:20 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:65 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/universe amd64 python3-pip all 22.0.2+dfsg-1ubuntu0.4 [1305 kB] 2024-11-07 00:11:21 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Fetched 71.7 MB in 1s (69.9 MB/s) 2024-11-07 00:11:21 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package libc-dev-bin. 2024-11-07 00:11:21 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 34022 files and directories currently installed.) 2024-11-07 00:11:21 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../00-libc-dev-bin_2.35-0ubuntu3.7_amd64.deb ... 2024-11-07 00:11:21 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking libc-dev-bin (2.35-0ubuntu3.7) ... 2024-11-07 00:11:21 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package linux-libc-dev:amd64. 2024-11-07 00:11:21 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../01-linux-libc-dev_5.15.0-105.115_amd64.deb ... 2024-11-07 00:11:21 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking linux-libc-dev:amd64 (5.15.0-105.115) ... 2024-11-07 00:11:23 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package libcrypt-dev:amd64. 2024-11-07 00:11:23 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../02-libcrypt-dev_1%3a4.4.27-1_amd64.deb ... 2024-11-07 00:11:23 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking libcrypt-dev:amd64 (1:4.4.27-1) ... 2024-11-07 00:11:24 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package rpcsvc-proto. 2024-11-07 00:11:24 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../03-rpcsvc-proto_1.4.2-0ubuntu6_amd64.deb ... 2024-11-07 00:11:24 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking rpcsvc-proto (1.4.2-0ubuntu6) ... 2024-11-07 00:11:24 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package libtirpc-dev:amd64. 2024-11-07 00:11:24 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../04-libtirpc-dev_1.3.2-2ubuntu0.1_amd64.deb ... 2024-11-07 00:11:24 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking libtirpc-dev:amd64 (1.3.2-2ubuntu0.1) ... 2024-11-07 00:11:24 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package libnsl-dev:amd64. 2024-11-07 00:11:24 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../05-libnsl-dev_1.3.0-2build2_amd64.deb ... 2024-11-07 00:11:24 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking libnsl-dev:amd64 (1.3.0-2build2) ... 2024-11-07 00:11:24 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package libc6-dev:amd64. 2024-11-07 00:11:24 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../06-libc6-dev_2.35-0ubuntu3.7_amd64.deb ... 2024-11-07 00:11:25 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking libc6-dev:amd64 (2.35-0ubuntu3.7) ... 2024-11-07 00:11:26 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package gcc-11-base:amd64. 2024-11-07 00:11:26 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../07-gcc-11-base_11.4.0-1ubuntu1~22.04_amd64.deb ... 2024-11-07 00:11:26 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking gcc-11-base:amd64 (11.4.0-1ubuntu1~22.04) ... 2024-11-07 00:11:26 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package libisl23:amd64. 2024-11-07 00:11:26 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../08-libisl23_0.24-2build1_amd64.deb ... 2024-11-07 00:11:26 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking libisl23:amd64 (0.24-2build1) ... 2024-11-07 00:11:26 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package libmpc3:amd64. 2024-11-07 00:11:26 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../09-libmpc3_1.2.1-2build1_amd64.deb ... 2024-11-07 00:11:26 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking libmpc3:amd64 (1.2.1-2build1) ... 2024-11-07 00:11:26 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package cpp-11. 2024-11-07 00:11:26 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../10-cpp-11_11.4.0-1ubuntu1~22.04_amd64.deb ... 2024-11-07 00:11:26 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking cpp-11 (11.4.0-1ubuntu1~22.04) ... 2024-11-07 00:11:27 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package cpp. 2024-11-07 00:11:27 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../11-cpp_4%3a11.2.0-1ubuntu1_amd64.deb ... 2024-11-07 00:11:27 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking cpp (4:11.2.0-1ubuntu1) ... 2024-11-07 00:11:27 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package libcc1-0:amd64. 2024-11-07 00:11:27 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../12-libcc1-0_12.3.0-1ubuntu1~22.04_amd64.deb ... 2024-11-07 00:11:27 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking libcc1-0:amd64 (12.3.0-1ubuntu1~22.04) ... 2024-11-07 00:11:27 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package libgomp1:amd64. 2024-11-07 00:11:27 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../13-libgomp1_12.3.0-1ubuntu1~22.04_amd64.deb ... 2024-11-07 00:11:27 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking libgomp1:amd64 (12.3.0-1ubuntu1~22.04) ... 2024-11-07 00:11:28 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package libitm1:amd64. 2024-11-07 00:11:28 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../14-libitm1_12.3.0-1ubuntu1~22.04_amd64.deb ... 2024-11-07 00:11:28 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking libitm1:amd64 (12.3.0-1ubuntu1~22.04) ... 2024-11-07 00:11:28 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package libatomic1:amd64. 2024-11-07 00:11:28 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../15-libatomic1_12.3.0-1ubuntu1~22.04_amd64.deb ... 2024-11-07 00:11:28 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking libatomic1:amd64 (12.3.0-1ubuntu1~22.04) ... 2024-11-07 00:11:28 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package libasan6:amd64. 2024-11-07 00:11:28 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../16-libasan6_11.4.0-1ubuntu1~22.04_amd64.deb ... 2024-11-07 00:11:28 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking libasan6:amd64 (11.4.0-1ubuntu1~22.04) ... 2024-11-07 00:11:28 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package liblsan0:amd64. 2024-11-07 00:11:28 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../17-liblsan0_12.3.0-1ubuntu1~22.04_amd64.deb ... 2024-11-07 00:11:28 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking liblsan0:amd64 (12.3.0-1ubuntu1~22.04) ... 2024-11-07 00:11:28 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package libtsan0:amd64. 2024-11-07 00:11:28 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../18-libtsan0_11.4.0-1ubuntu1~22.04_amd64.deb ... 2024-11-07 00:11:28 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking libtsan0:amd64 (11.4.0-1ubuntu1~22.04) ... 2024-11-07 00:11:29 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package libubsan1:amd64. 2024-11-07 00:11:29 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../19-libubsan1_12.3.0-1ubuntu1~22.04_amd64.deb ... 2024-11-07 00:11:29 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking libubsan1:amd64 (12.3.0-1ubuntu1~22.04) ... 2024-11-07 00:11:29 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package libquadmath0:amd64. 2024-11-07 00:11:29 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../20-libquadmath0_12.3.0-1ubuntu1~22.04_amd64.deb ... 2024-11-07 00:11:29 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking libquadmath0:amd64 (12.3.0-1ubuntu1~22.04) ... 2024-11-07 00:11:29 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package libgcc-11-dev:amd64. 2024-11-07 00:11:29 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../21-libgcc-11-dev_11.4.0-1ubuntu1~22.04_amd64.deb ... 2024-11-07 00:11:29 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking libgcc-11-dev:amd64 (11.4.0-1ubuntu1~22.04) ... 2024-11-07 00:11:30 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package gcc-11. 2024-11-07 00:11:30 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../22-gcc-11_11.4.0-1ubuntu1~22.04_amd64.deb ... 2024-11-07 00:11:30 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking gcc-11 (11.4.0-1ubuntu1~22.04) ... 2024-11-07 00:11:30 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package gcc. 2024-11-07 00:11:30 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../23-gcc_4%3a11.2.0-1ubuntu1_amd64.deb ... 2024-11-07 00:11:30 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking gcc (4:11.2.0-1ubuntu1) ... 2024-11-07 00:11:30 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package libstdc++-11-dev:amd64. 2024-11-07 00:11:30 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../24-libstdc++-11-dev_11.4.0-1ubuntu1~22.04_amd64.deb ... 2024-11-07 00:11:30 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking libstdc++-11-dev:amd64 (11.4.0-1ubuntu1~22.04) ... 2024-11-07 00:11:33 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package g++-11. 2024-11-07 00:11:33 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../25-g++-11_11.4.0-1ubuntu1~22.04_amd64.deb ... 2024-11-07 00:11:33 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking g++-11 (11.4.0-1ubuntu1~22.04) ... 2024-11-07 00:11:33 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package g++. 2024-11-07 00:11:33 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../26-g++_4%3a11.2.0-1ubuntu1_amd64.deb ... 2024-11-07 00:11:33 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking g++ (4:11.2.0-1ubuntu1) ... 2024-11-07 00:11:33 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package make. 2024-11-07 00:11:33 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../27-make_4.3-4.1build1_amd64.deb ... 2024-11-07 00:11:33 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking make (4.3-4.1build1) ... 2024-11-07 00:11:34 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package libdpkg-perl. 2024-11-07 00:11:34 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../28-libdpkg-perl_1.21.1ubuntu2.3_all.deb ... 2024-11-07 00:11:34 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking libdpkg-perl (1.21.1ubuntu2.3) ... 2024-11-07 00:11:34 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package bzip2. 2024-11-07 00:11:34 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../29-bzip2_1.0.8-5build1_amd64.deb ... 2024-11-07 00:11:34 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking bzip2 (1.0.8-5build1) ... 2024-11-07 00:11:34 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package lto-disabled-list. 2024-11-07 00:11:34 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../30-lto-disabled-list_24_all.deb ... 2024-11-07 00:11:34 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking lto-disabled-list (24) ... 2024-11-07 00:11:34 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package dpkg-dev. 2024-11-07 00:11:34 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../31-dpkg-dev_1.21.1ubuntu2.3_all.deb ... 2024-11-07 00:11:34 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking dpkg-dev (1.21.1ubuntu2.3) ... 2024-11-07 00:11:35 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package build-essential. 2024-11-07 00:11:35 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../32-build-essential_12.9ubuntu3_amd64.deb ... 2024-11-07 00:11:35 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking build-essential (12.9ubuntu3) ... 2024-11-07 00:11:35 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package libfakeroot:amd64. 2024-11-07 00:11:35 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../33-libfakeroot_1.28-1ubuntu1_amd64.deb ... 2024-11-07 00:11:35 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking libfakeroot:amd64 (1.28-1ubuntu1) ... 2024-11-07 00:11:36 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package fakeroot. 2024-11-07 00:11:36 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../34-fakeroot_1.28-1ubuntu1_amd64.deb ... 2024-11-07 00:11:36 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking fakeroot (1.28-1ubuntu1) ... 2024-11-07 00:11:36 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package fonts-dejavu-core. 2024-11-07 00:11:36 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../35-fonts-dejavu-core_2.37-2build1_all.deb ... 2024-11-07 00:11:36 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking fonts-dejavu-core (2.37-2build1) ... 2024-11-07 00:11:37 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package fontconfig-config. 2024-11-07 00:11:37 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../36-fontconfig-config_2.13.1-4.2ubuntu5_all.deb ... 2024-11-07 00:11:37 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking fontconfig-config (2.13.1-4.2ubuntu5) ... 2024-11-07 00:11:37 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package javascript-common. 2024-11-07 00:11:37 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../37-javascript-common_11+nmu1_all.deb ... 2024-11-07 00:11:37 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking javascript-common (11+nmu1) ... 2024-11-07 00:11:37 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package libalgorithm-diff-perl. 2024-11-07 00:11:37 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../38-libalgorithm-diff-perl_1.201-1_all.deb ... 2024-11-07 00:11:37 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking libalgorithm-diff-perl (1.201-1) ... 2024-11-07 00:11:38 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package libalgorithm-diff-xs-perl. 2024-11-07 00:11:38 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../39-libalgorithm-diff-xs-perl_0.04-6build3_amd64.deb ... 2024-11-07 00:11:38 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking libalgorithm-diff-xs-perl (0.04-6build3) ... 2024-11-07 00:11:38 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package libalgorithm-merge-perl. 2024-11-07 00:11:38 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../40-libalgorithm-merge-perl_0.08-3_all.deb ... 2024-11-07 00:11:38 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking libalgorithm-merge-perl (0.08-3) ... 2024-11-07 00:11:38 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package libfreetype6:amd64. 2024-11-07 00:11:38 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../41-libfreetype6_2.11.1+dfsg-1ubuntu0.2_amd64.deb ... 2024-11-07 00:11:38 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking libfreetype6:amd64 (2.11.1+dfsg-1ubuntu0.2) ... 2024-11-07 00:11:38 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package libfontconfig1:amd64. 2024-11-07 00:11:38 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../42-libfontconfig1_2.13.1-4.2ubuntu5_amd64.deb ... 2024-11-07 00:11:38 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking libfontconfig1:amd64 (2.13.1-4.2ubuntu5) ... 2024-11-07 00:11:38 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package libjpeg-turbo8:amd64. 2024-11-07 00:11:38 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../43-libjpeg-turbo8_2.1.2-0ubuntu1_amd64.deb ... 2024-11-07 00:11:38 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking libjpeg-turbo8:amd64 (2.1.2-0ubuntu1) ... 2024-11-07 00:11:38 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package libjpeg8:amd64. 2024-11-07 00:11:38 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../44-libjpeg8_8c-2ubuntu10_amd64.deb ... 2024-11-07 00:11:38 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking libjpeg8:amd64 (8c-2ubuntu10) ... 2024-11-07 00:11:38 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package libdeflate0:amd64. 2024-11-07 00:11:38 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../45-libdeflate0_1.10-2_amd64.deb ... 2024-11-07 00:11:38 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking libdeflate0:amd64 (1.10-2) ... 2024-11-07 00:11:38 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package libjbig0:amd64. 2024-11-07 00:11:38 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../46-libjbig0_2.1-3.1ubuntu0.22.04.1_amd64.deb ... 2024-11-07 00:11:38 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking libjbig0:amd64 (2.1-3.1ubuntu0.22.04.1) ... 2024-11-07 00:11:38 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package libwebp7:amd64. 2024-11-07 00:11:38 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../47-libwebp7_1.2.2-2ubuntu0.22.04.2_amd64.deb ... 2024-11-07 00:11:38 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking libwebp7:amd64 (1.2.2-2ubuntu0.22.04.2) ... 2024-11-07 00:11:39 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package libtiff5:amd64. 2024-11-07 00:11:39 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../48-libtiff5_4.3.0-6ubuntu0.8_amd64.deb ... 2024-11-07 00:11:39 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking libtiff5:amd64 (4.3.0-6ubuntu0.8) ... 2024-11-07 00:11:39 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package libxpm4:amd64. 2024-11-07 00:11:39 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../49-libxpm4_1%3a3.5.12-1ubuntu0.22.04.2_amd64.deb ... 2024-11-07 00:11:39 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking libxpm4:amd64 (1:3.5.12-1ubuntu0.22.04.2) ... 2024-11-07 00:11:39 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package libgd3:amd64. 2024-11-07 00:11:39 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../50-libgd3_2.3.0-2ubuntu2_amd64.deb ... 2024-11-07 00:11:39 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking libgd3:amd64 (2.3.0-2ubuntu2) ... 2024-11-07 00:11:39 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package libc-devtools. 2024-11-07 00:11:39 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../51-libc-devtools_2.35-0ubuntu3.7_amd64.deb ... 2024-11-07 00:11:39 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking libc-devtools (2.35-0ubuntu3.7) ... 2024-11-07 00:11:39 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package libexpat1-dev:amd64. 2024-11-07 00:11:39 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../52-libexpat1-dev_2.4.7-1ubuntu0.3_amd64.deb ... 2024-11-07 00:11:39 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking libexpat1-dev:amd64 (2.4.7-1ubuntu0.3) ... 2024-11-07 00:11:39 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package libfile-fcntllock-perl. 2024-11-07 00:11:39 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../53-libfile-fcntllock-perl_0.22-3build7_amd64.deb ... 2024-11-07 00:11:39 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking libfile-fcntllock-perl (0.22-3build7) ... 2024-11-07 00:11:39 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package libjs-jquery. 2024-11-07 00:11:39 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../54-libjs-jquery_3.6.0+dfsg+~3.5.13-1_all.deb ... 2024-11-07 00:11:39 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking libjs-jquery (3.6.0+dfsg+~3.5.13-1) ... 2024-11-07 00:11:40 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package libjs-underscore. 2024-11-07 00:11:40 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../55-libjs-underscore_1.13.2~dfsg-2_all.deb ... 2024-11-07 00:11:40 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking libjs-underscore (1.13.2~dfsg-2) ... 2024-11-07 00:11:40 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package libjs-sphinxdoc. 2024-11-07 00:11:40 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../56-libjs-sphinxdoc_4.3.2-1_all.deb ... 2024-11-07 00:11:40 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking libjs-sphinxdoc (4.3.2-1) ... 2024-11-07 00:11:40 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package zlib1g-dev:amd64. 2024-11-07 00:11:40 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../57-zlib1g-dev_1%3a1.2.11.dfsg-2ubuntu9.2_amd64.deb ... 2024-11-07 00:11:40 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking zlib1g-dev:amd64 (1:1.2.11.dfsg-2ubuntu9.2) ... 2024-11-07 00:11:40 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package libpython3.10-dev:amd64. 2024-11-07 00:11:40 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../58-libpython3.10-dev_3.10.12-1~22.04.3_amd64.deb ... 2024-11-07 00:11:40 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking libpython3.10-dev:amd64 (3.10.12-1~22.04.3) ... 2024-11-07 00:11:41 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package libpython3-dev:amd64. 2024-11-07 00:11:41 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../59-libpython3-dev_3.10.6-1~22.04_amd64.deb ... 2024-11-07 00:11:41 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking libpython3-dev:amd64 (3.10.6-1~22.04) ... 2024-11-07 00:11:41 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package manpages-dev. 2024-11-07 00:11:41 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../60-manpages-dev_5.10-1ubuntu1_all.deb ... 2024-11-07 00:11:41 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking manpages-dev (5.10-1ubuntu1) ... 2024-11-07 00:11:44 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package python3.10-dev. 2024-11-07 00:11:44 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../61-python3.10-dev_3.10.12-1~22.04.3_amd64.deb ... 2024-11-07 00:11:44 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking python3.10-dev (3.10.12-1~22.04.3) ... 2024-11-07 00:11:44 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package python3-dev. 2024-11-07 00:11:44 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../62-python3-dev_3.10.6-1~22.04_amd64.deb ... 2024-11-07 00:11:45 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking python3-dev (3.10.6-1~22.04) ... 2024-11-07 00:11:45 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package python3-wheel. 2024-11-07 00:11:45 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../63-python3-wheel_0.37.1-2ubuntu0.22.04.1_all.deb ... 2024-11-07 00:11:45 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking python3-wheel (0.37.1-2ubuntu0.22.04.1) ... 2024-11-07 00:11:45 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package python3-pip. 2024-11-07 00:11:45 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../64-python3-pip_22.0.2+dfsg-1ubuntu0.4_all.deb ... 2024-11-07 00:11:45 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking python3-pip (22.0.2+dfsg-1ubuntu0.4) ... 2024-11-07 00:11:48 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up javascript-common (11+nmu1) ... 2024-11-07 00:11:49 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up gcc-11-base:amd64 (11.4.0-1ubuntu1~22.04) ... 2024-11-07 00:11:49 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up manpages-dev (5.10-1ubuntu1) ... 2024-11-07 00:11:49 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up lto-disabled-list (24) ... 2024-11-07 00:11:49 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up libxpm4:amd64 (1:3.5.12-1ubuntu0.22.04.2) ... 2024-11-07 00:11:49 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up libfile-fcntllock-perl (0.22-3build7) ... 2024-11-07 00:11:49 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up libalgorithm-diff-perl (1.201-1) ... 2024-11-07 00:11:49 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up libdeflate0:amd64 (1.10-2) ... 2024-11-07 00:11:49 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up linux-libc-dev:amd64 (5.15.0-105.115) ... 2024-11-07 00:11:49 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up libgomp1:amd64 (12.3.0-1ubuntu1~22.04) ... 2024-11-07 00:11:49 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up bzip2 (1.0.8-5build1) ... 2024-11-07 00:11:49 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up python3-wheel (0.37.1-2ubuntu0.22.04.1) ... 2024-11-07 00:11:49 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up libjbig0:amd64 (2.1-3.1ubuntu0.22.04.1) ... 2024-11-07 00:11:50 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up libfakeroot:amd64 (1.28-1ubuntu1) ... 2024-11-07 00:11:50 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up libasan6:amd64 (11.4.0-1ubuntu1~22.04) ... 2024-11-07 00:11:50 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up fakeroot (1.28-1ubuntu1) ... 2024-11-07 00:11:50 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 update-alternatives: using /usr/bin/fakeroot-sysv to provide /usr/bin/fakeroot (fakeroot) in auto mode 2024-11-07 00:11:50 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up libtirpc-dev:amd64 (1.3.2-2ubuntu0.1) ... 2024-11-07 00:11:50 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up rpcsvc-proto (1.4.2-0ubuntu6) ... 2024-11-07 00:11:50 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up libfreetype6:amd64 (2.11.1+dfsg-1ubuntu0.2) ... 2024-11-07 00:11:50 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up make (4.3-4.1build1) ... 2024-11-07 00:11:50 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up libquadmath0:amd64 (12.3.0-1ubuntu1~22.04) ... 2024-11-07 00:11:50 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up libmpc3:amd64 (1.2.1-2build1) ... 2024-11-07 00:11:50 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up libatomic1:amd64 (12.3.0-1ubuntu1~22.04) ... 2024-11-07 00:11:51 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up fonts-dejavu-core (2.37-2build1) ... 2024-11-07 00:11:51 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up python3-pip (22.0.2+dfsg-1ubuntu0.4) ... 2024-11-07 00:11:53 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up libjpeg-turbo8:amd64 (2.1.2-0ubuntu1) ... 2024-11-07 00:11:53 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up libdpkg-perl (1.21.1ubuntu2.3) ... 2024-11-07 00:11:53 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up libwebp7:amd64 (1.2.2-2ubuntu0.22.04.2) ... 2024-11-07 00:11:53 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up libubsan1:amd64 (12.3.0-1ubuntu1~22.04) ... 2024-11-07 00:11:53 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up libnsl-dev:amd64 (1.3.0-2build2) ... 2024-11-07 00:11:53 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up libcrypt-dev:amd64 (1:4.4.27-1) ... 2024-11-07 00:11:53 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up libjs-jquery (3.6.0+dfsg+~3.5.13-1) ... 2024-11-07 00:11:54 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up libisl23:amd64 (0.24-2build1) ... 2024-11-07 00:11:54 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up libc-dev-bin (2.35-0ubuntu3.7) ... 2024-11-07 00:11:54 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up libalgorithm-diff-xs-perl (0.04-6build3) ... 2024-11-07 00:11:54 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up libcc1-0:amd64 (12.3.0-1ubuntu1~22.04) ... 2024-11-07 00:11:54 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up liblsan0:amd64 (12.3.0-1ubuntu1~22.04) ... 2024-11-07 00:11:54 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up libitm1:amd64 (12.3.0-1ubuntu1~22.04) ... 2024-11-07 00:11:54 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up libjs-underscore (1.13.2~dfsg-2) ... 2024-11-07 00:11:54 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up libalgorithm-merge-perl (0.08-3) ... 2024-11-07 00:11:54 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up libtsan0:amd64 (11.4.0-1ubuntu1~22.04) ... 2024-11-07 00:11:54 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up libjpeg8:amd64 (8c-2ubuntu10) ... 2024-11-07 00:11:54 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up cpp-11 (11.4.0-1ubuntu1~22.04) ... 2024-11-07 00:11:54 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up fontconfig-config (2.13.1-4.2ubuntu5) ... 2024-11-07 00:11:55 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up dpkg-dev (1.21.1ubuntu2.3) ... 2024-11-07 00:11:55 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up libjs-sphinxdoc (4.3.2-1) ... 2024-11-07 00:11:55 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up libgcc-11-dev:amd64 (11.4.0-1ubuntu1~22.04) ... 2024-11-07 00:11:55 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up gcc-11 (11.4.0-1ubuntu1~22.04) ... 2024-11-07 00:11:55 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up cpp (4:11.2.0-1ubuntu1) ... 2024-11-07 00:11:55 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up libc6-dev:amd64 (2.35-0ubuntu3.7) ... 2024-11-07 00:11:55 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up libtiff5:amd64 (4.3.0-6ubuntu0.8) ... 2024-11-07 00:11:55 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up libfontconfig1:amd64 (2.13.1-4.2ubuntu5) ... 2024-11-07 00:11:55 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up gcc (4:11.2.0-1ubuntu1) ... 2024-11-07 00:11:55 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up libexpat1-dev:amd64 (2.4.7-1ubuntu0.3) ... 2024-11-07 00:11:55 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up libgd3:amd64 (2.3.0-2ubuntu2) ... 2024-11-07 00:11:55 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up libstdc++-11-dev:amd64 (11.4.0-1ubuntu1~22.04) ... 2024-11-07 00:11:55 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up zlib1g-dev:amd64 (1:1.2.11.dfsg-2ubuntu9.2) ... 2024-11-07 00:11:55 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up libc-devtools (2.35-0ubuntu3.7) ... 2024-11-07 00:11:55 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up g++-11 (11.4.0-1ubuntu1~22.04) ... 2024-11-07 00:11:55 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up libpython3.10-dev:amd64 (3.10.12-1~22.04.3) ... 2024-11-07 00:11:55 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up python3.10-dev (3.10.12-1~22.04.3) ... 2024-11-07 00:11:55 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up g++ (4:11.2.0-1ubuntu1) ... 2024-11-07 00:11:56 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 update-alternatives: using /usr/bin/g++ to provide /usr/bin/c++ (c++) in auto mode 2024-11-07 00:11:56 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up build-essential (12.9ubuntu3) ... 2024-11-07 00:11:56 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up libpython3-dev:amd64 (3.10.6-1~22.04) ... 2024-11-07 00:11:56 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up python3-dev (3.10.6-1~22.04) ... 2024-11-07 00:11:56 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Processing triggers for man-db (2.10.2-1) ... 2024-11-07 00:11:57 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Processing triggers for libc-bin (2.35-0ubuntu3.7) ... 2024-11-07 00:11:57 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 NEEDRESTART-VER: 3.5 2024-11-07 00:11:58 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Reading package lists... 2024-11-07 00:11:59 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Building dependency tree... 2024-11-07 00:11:59 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Reading state information... 2024-11-07 00:11:59 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 The following additional packages will be installed: 2024-11-07 00:11:59 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 libmysqlclient21 libssl-dev libzstd-dev mysql-common 2024-11-07 00:11:59 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Suggested packages: 2024-11-07 00:11:59 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 libssl-doc 2024-11-07 00:11:59 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 The following NEW packages will be installed: 2024-11-07 00:11:59 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 libmysqlclient-dev libmysqlclient21 libssl-dev libzstd-dev mysql-common 2024-11-07 00:11:59 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 0 upgraded, 5 newly installed, 0 to remove and 0 not upgraded. 2024-11-07 00:11:59 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Need to get 5744 kB of archives. 2024-11-07 00:11:59 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 After this operation, 29.8 MB of additional disk space will be used. 2024-11-07 00:11:59 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:1 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 mysql-common all 5.8+1.0.8 [7212 B] 2024-11-07 00:11:59 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:2 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmysqlclient21 amd64 8.0.36-0ubuntu0.22.04.1 [1302 kB] 2024-11-07 00:11:59 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:3 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2376 kB] 2024-11-07 00:11:59 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:4 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 libzstd-dev amd64 1.4.8+dfsg-3build1 [401 kB] 2024-11-07 00:11:59 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:5 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmysqlclient-dev amd64 8.0.36-0ubuntu0.22.04.1 [1657 kB] 2024-11-07 00:11:59 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Fetched 5744 kB in 0s (77.4 MB/s) 2024-11-07 00:11:59 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package mysql-common. 2024-11-07 00:11:59 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 40815 files and directories currently installed.) 2024-11-07 00:11:59 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../mysql-common_5.8+1.0.8_all.deb ... 2024-11-07 00:11:59 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking mysql-common (5.8+1.0.8) ... 2024-11-07 00:12:00 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package libmysqlclient21:amd64. 2024-11-07 00:12:00 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../libmysqlclient21_8.0.36-0ubuntu0.22.04.1_amd64.deb ... 2024-11-07 00:12:00 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking libmysqlclient21:amd64 (8.0.36-0ubuntu0.22.04.1) ... 2024-11-07 00:12:00 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package libssl-dev:amd64. 2024-11-07 00:12:00 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-11-07 00:12:00 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-11-07 00:12:00 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package libzstd-dev:amd64. 2024-11-07 00:12:00 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../libzstd-dev_1.4.8+dfsg-3build1_amd64.deb ... 2024-11-07 00:12:00 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking libzstd-dev:amd64 (1.4.8+dfsg-3build1) ... 2024-11-07 00:12:00 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package libmysqlclient-dev. 2024-11-07 00:12:00 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../libmysqlclient-dev_8.0.36-0ubuntu0.22.04.1_amd64.deb ... 2024-11-07 00:12:00 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking libmysqlclient-dev (8.0.36-0ubuntu0.22.04.1) ... 2024-11-07 00:12:00 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up mysql-common (5.8+1.0.8) ... 2024-11-07 00:12:00 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 update-alternatives: using /etc/mysql/my.cnf.fallback to provide /etc/mysql/my.cnf (my.cnf) in auto mode 2024-11-07 00:12:00 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up libmysqlclient21:amd64 (8.0.36-0ubuntu0.22.04.1) ... 2024-11-07 00:12:00 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up libzstd-dev:amd64 (1.4.8+dfsg-3build1) ... 2024-11-07 00:12:00 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-11-07 00:12:01 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up libmysqlclient-dev (8.0.36-0ubuntu0.22.04.1) ... 2024-11-07 00:12:01 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Processing triggers for man-db (2.10.2-1) ... 2024-11-07 00:12:01 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Processing triggers for libc-bin (2.35-0ubuntu3.7) ... 2024-11-07 00:12:01 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 NEEDRESTART-VER: 3.5 2024-11-07 00:12:03 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Reading package lists... 2024-11-07 00:12:03 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Building dependency tree... 2024-11-07 00:12:03 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Reading state information... 2024-11-07 00:12:03 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 The following additional packages will be installed: 2024-11-07 00:12:03 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 python3-distlib python3-filelock python3-pip-whl python3-platformdirs 2024-11-07 00:12:03 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 python3-setuptools-whl python3-virtualenv python3-wheel-whl 2024-11-07 00:12:03 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Suggested packages: 2024-11-07 00:12:03 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 python2-pip-whl python2-setuptools-whl 2024-11-07 00:12:03 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 The following NEW packages will be installed: 2024-11-07 00:12:03 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 python3-distlib python3-filelock python3-pip-whl python3-platformdirs 2024-11-07 00:12:03 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 python3-setuptools-whl python3-virtualenv python3-wheel-whl virtualenv 2024-11-07 00:12:03 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 0 upgraded, 8 newly installed, 0 to remove and 0 not upgraded. 2024-11-07 00:12:03 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Need to get 2880 kB of archives. 2024-11-07 00:12:03 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 After this operation, 4677 kB of additional disk space will be used. 2024-11-07 00:12:03 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:1 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/universe amd64 python3-distlib all 0.3.4-1 [269 kB] 2024-11-07 00:12:04 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:2 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/universe amd64 python3-filelock all 3.6.0-1 [8788 B] 2024-11-07 00:12:04 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:3 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/universe amd64 python3-pip-whl all 22.0.2+dfsg-1ubuntu0.4 [1680 kB] 2024-11-07 00:12:04 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:4 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/universe amd64 python3-platformdirs all 2.5.1-1 [14.2 kB] 2024-11-07 00:12:04 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:5 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/universe amd64 python3-setuptools-whl all 59.6.0-1.2ubuntu0.22.04.1 [788 kB] 2024-11-07 00:12:04 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:6 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/universe amd64 python3-wheel-whl all 0.37.1-2ubuntu0.22.04.1 [38.0 kB] 2024-11-07 00:12:04 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:7 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/universe amd64 python3-virtualenv all 20.13.0+ds-2 [80.3 kB] 2024-11-07 00:12:04 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:8 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/universe amd64 virtualenv all 20.13.0+ds-2 [1968 B] 2024-11-07 00:12:04 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Fetched 2880 kB in 0s (43.4 MB/s) 2024-11-07 00:12:04 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package python3-distlib. 2024-11-07 00:12:04 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 41033 files and directories currently installed.) 2024-11-07 00:12:04 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../0-python3-distlib_0.3.4-1_all.deb ... 2024-11-07 00:12:04 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking python3-distlib (0.3.4-1) ... 2024-11-07 00:12:04 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package python3-filelock. 2024-11-07 00:12:04 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../1-python3-filelock_3.6.0-1_all.deb ... 2024-11-07 00:12:04 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking python3-filelock (3.6.0-1) ... 2024-11-07 00:12:04 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package python3-pip-whl. 2024-11-07 00:12:04 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../2-python3-pip-whl_22.0.2+dfsg-1ubuntu0.4_all.deb ... 2024-11-07 00:12:04 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking python3-pip-whl (22.0.2+dfsg-1ubuntu0.4) ... 2024-11-07 00:12:04 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package python3-platformdirs. 2024-11-07 00:12:04 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../3-python3-platformdirs_2.5.1-1_all.deb ... 2024-11-07 00:12:04 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking python3-platformdirs (2.5.1-1) ... 2024-11-07 00:12:04 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package python3-setuptools-whl. 2024-11-07 00:12:04 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../4-python3-setuptools-whl_59.6.0-1.2ubuntu0.22.04.1_all.deb ... 2024-11-07 00:12:04 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking python3-setuptools-whl (59.6.0-1.2ubuntu0.22.04.1) ... 2024-11-07 00:12:04 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package python3-wheel-whl. 2024-11-07 00:12:04 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../5-python3-wheel-whl_0.37.1-2ubuntu0.22.04.1_all.deb ... 2024-11-07 00:12:04 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking python3-wheel-whl (0.37.1-2ubuntu0.22.04.1) ... 2024-11-07 00:12:05 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package python3-virtualenv. 2024-11-07 00:12:05 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../6-python3-virtualenv_20.13.0+ds-2_all.deb ... 2024-11-07 00:12:05 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking python3-virtualenv (20.13.0+ds-2) ... 2024-11-07 00:12:05 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package virtualenv. 2024-11-07 00:12:05 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../7-virtualenv_20.13.0+ds-2_all.deb ... 2024-11-07 00:12:05 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking virtualenv (20.13.0+ds-2) ... 2024-11-07 00:12:05 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up python3-setuptools-whl (59.6.0-1.2ubuntu0.22.04.1) ... 2024-11-07 00:12:05 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up python3-filelock (3.6.0-1) ... 2024-11-07 00:12:05 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up python3-pip-whl (22.0.2+dfsg-1ubuntu0.4) ... 2024-11-07 00:12:05 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up python3-distlib (0.3.4-1) ... 2024-11-07 00:12:05 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up python3-platformdirs (2.5.1-1) ... 2024-11-07 00:12:06 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up python3-wheel-whl (0.37.1-2ubuntu0.22.04.1) ... 2024-11-07 00:12:06 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up python3-virtualenv (20.13.0+ds-2) ... 2024-11-07 00:12:06 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up virtualenv (20.13.0+ds-2) ... 2024-11-07 00:12:06 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Processing triggers for man-db (2.10.2-1) ... 2024-11-07 00:12:07 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 NEEDRESTART-VER: 3.5 2024-11-07 00:12:09 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 created virtual environment CPython3.10.12.final.0-64 in 436ms 2024-11-07 00:12:09 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 creator CPython3Posix(dest=/var/lib/juju/agents/unit-mysql-innodb-cluster-1/.venv, clear=False, no_vcs_ignore=False, global=False) 2024-11-07 00:12:09 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 seeder FromAppData(download=False, pip=bundle, setuptools=bundle, wheel=bundle, via=copy, app_data_dir=/root/.local/share/virtualenv) 2024-11-07 00:12:09 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 added seed packages: pip==22.0.2, setuptools==59.6.0, wheel==0.37.1 2024-11-07 00:12:09 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 activators BashActivator,CShellActivator,FishActivator,NushellActivator,PowerShellActivator,PythonActivator 2024-11-07 00:12:11 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Looking in links: wheelhouse 2024-11-07 00:12:11 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Requirement already satisfied: pip in /var/lib/juju/agents/unit-mysql-innodb-cluster-1/.venv/lib/python3.10/site-packages (22.0.2) 2024-11-07 00:12:11 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Processing ./wheelhouse/pip-22.0.4.tar.gz 2024-11-07 00:12:12 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Installing build dependencies: started 2024-11-07 00:12:25 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Installing build dependencies: finished with status 'done' 2024-11-07 00:12:25 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Getting requirements to build wheel: started 2024-11-07 00:12:27 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Getting requirements to build wheel: finished with status 'done' 2024-11-07 00:12:27 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing metadata (pyproject.toml): started 2024-11-07 00:12:29 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing metadata (pyproject.toml): finished with status 'done' 2024-11-07 00:12:29 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Building wheels for collected packages: pip 2024-11-07 00:12:29 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Building wheel for pip (pyproject.toml): started 2024-11-07 00:12:32 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Building wheel for pip (pyproject.toml): finished with status 'done' 2024-11-07 00:12:32 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Created wheel for pip: filename=pip-22.0.4-py3-none-any.whl size=2123598 sha256=4b276937b990dc3fa0862a1d766f252bc2d87dafd3c1084add61acb93ebc2e21 2024-11-07 00:12:32 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Stored in directory: /root/.cache/pip/wheels/73/96/f2/b60adb1f76215854f743c2b3503c70d7b993edc3ca00e73b9f 2024-11-07 00:12:32 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Successfully built pip 2024-11-07 00:12:32 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Installing collected packages: pip 2024-11-07 00:12:32 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Attempting uninstall: pip 2024-11-07 00:12:32 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Found existing installation: pip 22.0.2 2024-11-07 00:12:33 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Uninstalling pip-22.0.2: 2024-11-07 00:12:33 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Successfully uninstalled pip-22.0.2 2024-11-07 00:12:35 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Successfully installed pip-22.0.4 2024-11-07 00:12:36 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Looking in links: wheelhouse 2024-11-07 00:12:36 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Requirement already satisfied: setuptools in /var/lib/juju/agents/unit-mysql-innodb-cluster-1/.venv/lib/python3.10/site-packages (59.6.0) 2024-11-07 00:12:36 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Collecting setuptools 2024-11-07 00:12:36 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Using cached setuptools-62.1.0-py3-none-any.whl 2024-11-07 00:12:36 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Installing collected packages: setuptools 2024-11-07 00:12:36 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Attempting uninstall: setuptools 2024-11-07 00:12:36 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Found existing installation: setuptools 59.6.0 2024-11-07 00:12:36 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Uninstalling setuptools-59.6.0: 2024-11-07 00:12:36 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Successfully uninstalled setuptools-59.6.0 2024-11-07 00:12:37 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Successfully installed setuptools-62.1.0 2024-11-07 00:12:38 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Looking in links: wheelhouse 2024-11-07 00:12:38 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Processing ./wheelhouse/setuptools_scm-6.4.2.tar.gz 2024-11-07 00:12:38 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Installing build dependencies: started 2024-11-07 00:12:57 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Installing build dependencies: finished with status 'done' 2024-11-07 00:12:57 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Getting requirements to build wheel: started 2024-11-07 00:12:59 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Getting requirements to build wheel: finished with status 'done' 2024-11-07 00:12:59 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing metadata (pyproject.toml): started 2024-11-07 00:13:00 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing metadata (pyproject.toml): finished with status 'done' 2024-11-07 00:13:00 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Requirement already satisfied: setuptools in /var/lib/juju/agents/unit-mysql-innodb-cluster-1/.venv/lib/python3.10/site-packages (from setuptools-scm) (62.1.0) 2024-11-07 00:13:00 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Collecting packaging>=20.0 2024-11-07 00:13:00 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Using cached packaging-21.3-py3-none-any.whl 2024-11-07 00:13:00 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Collecting tomli>=1.0.0 2024-11-07 00:13:00 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Using cached tomli-2.0.1-py3-none-any.whl 2024-11-07 00:13:00 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Collecting pyparsing!=3.0.5,>=2.0.2 2024-11-07 00:13:00 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Using cached pyparsing-3.0.8-py3-none-any.whl 2024-11-07 00:13:00 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Building wheels for collected packages: setuptools-scm 2024-11-07 00:13:00 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Building wheel for setuptools-scm (pyproject.toml): started 2024-11-07 00:13:02 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Building wheel for setuptools-scm (pyproject.toml): finished with status 'done' 2024-11-07 00:13:02 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Created wheel for setuptools-scm: filename=setuptools_scm-6.4.2-py3-none-any.whl size=37098 sha256=ff8680d59da5ef968ba178a02f888185d858ecc59f7f5352ceae439aa3060ec9 2024-11-07 00:13:02 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Stored in directory: /root/.cache/pip/wheels/b1/65/f2/8af07673114aed43720b1f20e9b768205138d85ac2bc51788b 2024-11-07 00:13:02 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Successfully built setuptools-scm 2024-11-07 00:13:02 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Installing collected packages: tomli, pyparsing, packaging, setuptools-scm 2024-11-07 00:13:02 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Successfully installed packaging-21.3 pyparsing-3.0.8 setuptools-scm-6.4.2 tomli-2.0.1 2024-11-07 00:13:03 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Looking in links: wheelhouse 2024-11-07 00:13:03 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Processing ./wheelhouse/wheel-0.37.1.tar.gz 2024-11-07 00:13:03 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing metadata (setup.py): started 2024-11-07 00:13:04 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing metadata (setup.py): finished with status 'done' 2024-11-07 00:13:04 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Processing ./wheelhouse/MarkupSafe-2.1.1.tar.gz 2024-11-07 00:13:04 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing metadata (setup.py): started 2024-11-07 00:13:05 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing metadata (setup.py): finished with status 'done' 2024-11-07 00:13:05 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Building wheels for collected packages: wheel, MarkupSafe 2024-11-07 00:13:05 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Building wheel for wheel (setup.py): started 2024-11-07 00:13:07 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Building wheel for wheel (setup.py): finished with status 'done' 2024-11-07 00:13:07 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Created wheel for wheel: filename=wheel-0.37.1-py2.py3-none-any.whl size=35318 sha256=82f984531d4db5e864441e1313843f7627bf1d4a0eaa5c7039b861af263b5077 2024-11-07 00:13:07 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-9ck7iyfe/wheels/8d/36/87/02fdc95f2363519e739c63db4fcaaae6c26219d12ced51bfa3 2024-11-07 00:13:07 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Building wheel for MarkupSafe (setup.py): started 2024-11-07 00:13:09 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Building wheel for MarkupSafe (setup.py): finished with status 'done' 2024-11-07 00:13:09 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Created wheel for MarkupSafe: filename=MarkupSafe-2.1.1-cp310-cp310-linux_x86_64.whl size=25125 sha256=519f6676ea7ef67e4c93800c542ba148f75dc6bc8eaebeb94531520d7e236f42 2024-11-07 00:13:09 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-9ck7iyfe/wheels/ee/54/54/e78577cebb2d8c0197682df599c3f8d3c21d47f1082837aaca 2024-11-07 00:13:09 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Successfully built wheel MarkupSafe 2024-11-07 00:13:09 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Installing collected packages: wheel, MarkupSafe 2024-11-07 00:13:09 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Attempting uninstall: wheel 2024-11-07 00:13:09 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Found existing installation: wheel 0.37.1 2024-11-07 00:13:09 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Uninstalling wheel-0.37.1: 2024-11-07 00:13:09 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Successfully uninstalled wheel-0.37.1 2024-11-07 00:13:09 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Successfully installed MarkupSafe-2.1.1 wheel-0.37.1 2024-11-07 00:13:10 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Looking in links: wheelhouse 2024-11-07 00:13:10 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Processing ./wheelhouse/mysqlclient-2.1.0.tar.gz 2024-11-07 00:13:10 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing metadata (setup.py): started 2024-11-07 00:13:11 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing metadata (setup.py): finished with status 'done' 2024-11-07 00:13:11 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Processing ./wheelhouse/charms.openstack-0.0.1.dev1.zip 2024-11-07 00:13:11 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing metadata (setup.py): started 2024-11-07 00:13:13 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing metadata (setup.py): finished with status 'done' 2024-11-07 00:13:13 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Processing ./wheelhouse/PyYAML-6.0.1.tar.gz 2024-11-07 00:13:13 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Installing build dependencies: started 2024-11-07 00:14:17 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Installing build dependencies: still running... 2024-11-07 00:14:19 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Installing build dependencies: finished with status 'done' 2024-11-07 00:14:19 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Getting requirements to build wheel: started 2024-11-07 00:14:21 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Getting requirements to build wheel: finished with status 'done' 2024-11-07 00:14:21 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing metadata (pyproject.toml): started 2024-11-07 00:14:22 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing metadata (pyproject.toml): finished with status 'done' 2024-11-07 00:14:22 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Processing ./wheelhouse/Cython-0.29.37.tar.gz 2024-11-07 00:14:23 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing metadata (setup.py): started 2024-11-07 00:14:31 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing metadata (setup.py): finished with status 'done' 2024-11-07 00:14:31 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Processing ./wheelhouse/Jinja2-3.1.1.tar.gz 2024-11-07 00:14:31 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing metadata (setup.py): started 2024-11-07 00:14:33 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing metadata (setup.py): finished with status 'done' 2024-11-07 00:14:33 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Processing ./wheelhouse/charmhelpers-1.1.1.dev44.zip 2024-11-07 00:14:33 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing metadata (setup.py): started 2024-11-07 00:14:40 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing metadata (setup.py): finished with status 'done' 2024-11-07 00:14:40 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Processing ./wheelhouse/Tempita-0.4.tar.gz 2024-11-07 00:14:40 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing metadata (setup.py): started 2024-11-07 00:14:42 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing metadata (setup.py): finished with status 'done' 2024-11-07 00:14:42 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Processing ./wheelhouse/tomli-2.0.1.tar.gz 2024-11-07 00:14:42 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Installing build dependencies: started 2024-11-07 00:14:45 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Installing build dependencies: finished with status 'done' 2024-11-07 00:14:45 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Getting requirements to build wheel: started 2024-11-07 00:14:45 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Getting requirements to build wheel: finished with status 'done' 2024-11-07 00:14:45 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing metadata (pyproject.toml): started 2024-11-07 00:14:46 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing metadata (pyproject.toml): finished with status 'done' 2024-11-07 00:14:46 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Processing ./wheelhouse/flit_core-3.7.1.tar.gz 2024-11-07 00:14:46 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Getting requirements to build wheel: started 2024-11-07 00:14:46 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Getting requirements to build wheel: finished with status 'done' 2024-11-07 00:14:46 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing metadata (pyproject.toml): started 2024-11-07 00:14:46 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing metadata (pyproject.toml): finished with status 'done' 2024-11-07 00:14:46 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Processing ./wheelhouse/netifaces-0.11.0.tar.gz 2024-11-07 00:14:46 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing metadata (setup.py): started 2024-11-07 00:14:48 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing metadata (setup.py): finished with status 'done' 2024-11-07 00:14:48 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Processing ./wheelhouse/psutil-5.9.0.tar.gz 2024-11-07 00:14:48 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing metadata (setup.py): started 2024-11-07 00:14:50 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing metadata (setup.py): finished with status 'done' 2024-11-07 00:14:50 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Processing ./wheelhouse/pyaml-21.10.1.tar.gz 2024-11-07 00:14:50 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing metadata (setup.py): started 2024-11-07 00:14:51 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing metadata (setup.py): finished with status 'done' 2024-11-07 00:14:51 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Processing ./wheelhouse/dnspython-1.16.0.zip 2024-11-07 00:14:51 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing metadata (setup.py): started 2024-11-07 00:14:53 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing metadata (setup.py): finished with status 'done' 2024-11-07 00:14:53 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Processing ./wheelhouse/pbr-5.8.1.tar.gz 2024-11-07 00:14:53 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing metadata (setup.py): started 2024-11-07 00:14:56 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing metadata (setup.py): finished with status 'done' 2024-11-07 00:14:56 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Processing ./wheelhouse/six-1.16.0.tar.gz 2024-11-07 00:14:56 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing metadata (setup.py): started 2024-11-07 00:14:58 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing metadata (setup.py): finished with status 'done' 2024-11-07 00:14:58 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Processing ./wheelhouse/pyparsing-3.0.8.tar.gz 2024-11-07 00:14:59 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Installing build dependencies: started 2024-11-07 00:15:01 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Installing build dependencies: finished with status 'done' 2024-11-07 00:15:01 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Getting requirements to build wheel: started 2024-11-07 00:15:01 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Getting requirements to build wheel: finished with status 'done' 2024-11-07 00:15:02 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Installing backend dependencies: started 2024-11-07 00:15:04 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Installing backend dependencies: finished with status 'done' 2024-11-07 00:15:04 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing metadata (pyproject.toml): started 2024-11-07 00:15:04 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing metadata (pyproject.toml): finished with status 'done' 2024-11-07 00:15:04 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Processing ./wheelhouse/tenacity-7.0.0.tar.gz 2024-11-07 00:15:04 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing metadata (setup.py): started 2024-11-07 00:15:06 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing metadata (setup.py): finished with status 'done' 2024-11-07 00:15:07 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Processing ./wheelhouse/netaddr-0.7.19.tar.gz 2024-11-07 00:15:07 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing metadata (setup.py): started 2024-11-07 00:15:09 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing metadata (setup.py): finished with status 'done' 2024-11-07 00:15:09 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Processing ./wheelhouse/charms.reactive-1.5.0.tar.gz 2024-11-07 00:15:09 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing metadata (setup.py): started 2024-11-07 00:15:10 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing metadata (setup.py): finished with status 'done' 2024-11-07 00:15:10 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Processing ./wheelhouse/packaging-21.3.tar.gz 2024-11-07 00:15:10 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Installing build dependencies: started 2024-11-07 00:15:14 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Installing build dependencies: finished with status 'done' 2024-11-07 00:15:14 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Getting requirements to build wheel: started 2024-11-07 00:15:15 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Getting requirements to build wheel: finished with status 'done' 2024-11-07 00:15:15 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing metadata (pyproject.toml): started 2024-11-07 00:15:17 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing metadata (pyproject.toml): finished with status 'done' 2024-11-07 00:15:17 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Processing ./wheelhouse/MarkupSafe-2.1.1.tar.gz 2024-11-07 00:15:17 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing metadata (setup.py): started 2024-11-07 00:15:18 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing metadata (setup.py): finished with status 'done' 2024-11-07 00:15:18 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Building wheels for collected packages: mysqlclient, charms.openstack, PyYAML, Cython, Jinja2, charmhelpers, Tempita, tomli, flit-core, netifaces, psutil, pyaml, dnspython, pbr, six, pyparsing, tenacity, netaddr, charms.reactive, packaging, MarkupSafe 2024-11-07 00:15:18 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Building wheel for mysqlclient (setup.py): started 2024-11-07 00:15:22 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Building wheel for mysqlclient (setup.py): finished with status 'done' 2024-11-07 00:15:22 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Created wheel for mysqlclient: filename=mysqlclient-2.1.0-cp310-cp310-linux_x86_64.whl size=104298 sha256=f67672e9a2083cf0e166c392c8e6b25b492bb52fa37bf024b2165543935863d2 2024-11-07 00:15:22 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-i8wfzdu3/wheels/80/f2/41/7a90e5fb18f33e229b289bf4b9630f4c1d5b667e6f6e29f525 2024-11-07 00:15:22 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Building wheel for charms.openstack (setup.py): started 2024-11-07 00:15:24 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Building wheel for charms.openstack (setup.py): finished with status 'done' 2024-11-07 00:15:24 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Created wheel for charms.openstack: filename=charms.openstack-0.0.1.dev1-py3-none-any.whl size=108498 sha256=245283850be53627bc0d7b18c6f187bb372e0a492225a70cbde95b6df5115e44 2024-11-07 00:15:24 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-i8wfzdu3/wheels/15/31/88/4fb7b27ab85dfc3a9edfbb69c68a0d63198e488700cc34eb55 2024-11-07 00:15:24 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Building wheel for PyYAML (pyproject.toml): started 2024-11-07 00:15:27 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Building wheel for PyYAML (pyproject.toml): finished with status 'done' 2024-11-07 00:15:27 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Created wheel for PyYAML: filename=PyYAML-6.0.1-cp310-cp310-linux_x86_64.whl size=45360 sha256=3ac3a2f097ff3ab0d72759e8f572c09f3861654aee737fa2bf6d1abb87a64c78 2024-11-07 00:15:27 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-i8wfzdu3/wheels/01/91/61/b1dac1cb3144dd1822b0ddbcada5da23682822ede93ac1d2e1 2024-11-07 00:15:27 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Building wheel for Cython (setup.py): started 2024-11-07 00:16:27 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Building wheel for Cython (setup.py): still running... 2024-11-07 00:16:27 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Building wheel for Cython (setup.py): finished with status 'done' 2024-11-07 00:16:27 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Created wheel for Cython: filename=Cython-0.29.37-cp310-cp310-linux_x86_64.whl size=4835624 sha256=72f9658879adb72e24c3b09d39fca2a1709f0179eb7a4c133d29e315e0ac828d 2024-11-07 00:16:27 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-i8wfzdu3/wheels/d5/df/93/bdd842d739f2490117a7bb9dc4e850ee1b87ea2645bba231fa 2024-11-07 00:16:27 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Building wheel for Jinja2 (setup.py): started 2024-11-07 00:16:29 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Building wheel for Jinja2 (setup.py): finished with status 'done' 2024-11-07 00:16:29 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Created wheel for Jinja2: filename=Jinja2-3.1.1-py3-none-any.whl size=132603 sha256=32e5a2540fa0c9101ab6bb54e3c77fd116cc7dfc441f65f533ce7f1a89d68edc 2024-11-07 00:16:29 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-i8wfzdu3/wheels/d1/91/fb/9ed54832d90c665853cba51d41c50a21552d686f01e462a48f 2024-11-07 00:16:29 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Building wheel for charmhelpers (setup.py): started 2024-11-07 00:16:33 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Building wheel for charmhelpers (setup.py): finished with status 'done' 2024-11-07 00:16:33 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Created wheel for charmhelpers: filename=charmhelpers-1.1.1.dev44-py3-none-any.whl size=415522 sha256=9a9b4a89a59c47f2256f6c38a1364f33b3b0380b91a1df12a10d9e69ca911a99 2024-11-07 00:16:33 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-i8wfzdu3/wheels/1c/84/e7/adb8c2e7e0e3232e0f89ad6e29ba90b1071b8fda12c279a7a6 2024-11-07 00:16:33 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Building wheel for Tempita (setup.py): started 2024-11-07 00:16:33 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for mysql-innodb-cluster/1 2024-11-07 00:16:35 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Building wheel for Tempita (setup.py): finished with status 'done' 2024-11-07 00:16:35 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Created wheel for Tempita: filename=Tempita-0.4-py3-none-any.whl size=11794 sha256=734171025ea639f036091ae195418b1a66530621dc651a2a17a1bbcdbac620bb 2024-11-07 00:16:35 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-i8wfzdu3/wheels/d2/30/9f/4559b3bf82e78a631892a83ab319da6108fa1bc1c2df05278e 2024-11-07 00:16:35 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Building wheel for tomli (pyproject.toml): started 2024-11-07 00:16:36 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Building wheel for tomli (pyproject.toml): finished with status 'done' 2024-11-07 00:16:36 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Created wheel for tomli: filename=tomli-2.0.1-py3-none-any.whl size=12759 sha256=ea938b47d3fc357aff859dd096b47df090e2a49b7637d99c9e37887145c9c9a8 2024-11-07 00:16:36 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-i8wfzdu3/wheels/a9/76/c6/5eda8479dd7843c59c6636765f67c8840cb78659cb84fbcfa8 2024-11-07 00:16:36 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Building wheel for flit-core (pyproject.toml): started 2024-11-07 00:16:36 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Building wheel for flit-core (pyproject.toml): finished with status 'done' 2024-11-07 00:16:36 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Created wheel for flit-core: filename=flit_core-3.7.1-py3-none-any.whl size=60195 sha256=e454fdbf68c7036e1c7435ec7479383f9d9a1650ca5b304feb184eba1efcdcef 2024-11-07 00:16:36 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-i8wfzdu3/wheels/fe/b7/7b/403a3d4f3b4560b21f4cee3428f069703af89426beba219999 2024-11-07 00:16:36 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Building wheel for netifaces (setup.py): started 2024-11-07 00:16:41 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Building wheel for netifaces (setup.py): finished with status 'done' 2024-11-07 00:16:41 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Created wheel for netifaces: filename=netifaces-0.11.0-cp310-cp310-linux_x86_64.whl size=35022 sha256=3aeb18f77ac6e8a051fe42d73175d2e10d5836de02ab9b28226d63987b63aa05 2024-11-07 00:16:41 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-i8wfzdu3/wheels/c7/72/a0/aab799545ddc3d29543e8185cb21fb3ca9036e96f76f9c0ab7 2024-11-07 00:16:41 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Building wheel for psutil (setup.py): started 2024-11-07 00:16:45 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Building wheel for psutil (setup.py): finished with status 'done' 2024-11-07 00:16:45 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Created wheel for psutil: filename=psutil-5.9.0-cp310-cp310-linux_x86_64.whl size=283004 sha256=aa494bfa1a81e6162606b67fa9ae340c592174befd85135cd25e5be95523e0a0 2024-11-07 00:16:45 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-i8wfzdu3/wheels/fd/32/30/1eb9c875fd98f73e2848b03f4d1e6abed82a3219a7d229c32b 2024-11-07 00:16:45 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Building wheel for pyaml (setup.py): started 2024-11-07 00:16:47 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Building wheel for pyaml (setup.py): finished with status 'done' 2024-11-07 00:16:47 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Created wheel for pyaml: filename=pyaml-21.10.1-py2.py3-none-any.whl size=17642 sha256=bdf05418a919ff5493f662110c893ad8df2ca8ba3c944209244af64afc6640a0 2024-11-07 00:16:47 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-i8wfzdu3/wheels/58/bd/7e/905d326a78f63205e065b5480aadaf7845f452787f9e7f22a9 2024-11-07 00:16:47 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Building wheel for dnspython (setup.py): started 2024-11-07 00:16:49 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Building wheel for dnspython (setup.py): finished with status 'done' 2024-11-07 00:16:49 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Created wheel for dnspython: filename=dnspython-1.16.0-py2.py3-none-any.whl size=186988 sha256=cd8770ddb3e12b7dd4550d42118f49fe791728c523a7b1c75d5c81c91d84982e 2024-11-07 00:16:49 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-i8wfzdu3/wheels/f8/d3/8d/dd30060aa20a1179a3cd2cda87bdc37755ae0003fe14054d1b 2024-11-07 00:16:49 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Building wheel for pbr (setup.py): started 2024-11-07 00:16:51 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Building wheel for pbr (setup.py): finished with status 'done' 2024-11-07 00:16:51 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Created wheel for pbr: filename=pbr-5.8.1-py2.py3-none-any.whl size=113061 sha256=6511b84fb8f12bf18f7961755fb5a749fedc1202919a7f4513cb1ab6d41f194c 2024-11-07 00:16:51 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-i8wfzdu3/wheels/4a/ce/cc/5b9658206bdf587734abe7ae4ef8da2ea6ef12b0e3b163dc47 2024-11-07 00:16:51 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Building wheel for six (setup.py): started 2024-11-07 00:16:53 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Building wheel for six (setup.py): finished with status 'done' 2024-11-07 00:16:53 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Created wheel for six: filename=six-1.16.0-py2.py3-none-any.whl size=11061 sha256=25f8ae942484a28c4a3d2a4feb60e809ca2806c6e5ac78dce981736402cd1826 2024-11-07 00:16:53 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-i8wfzdu3/wheels/60/a0/b3/001bde52f23d4c26fde4569e6832e1f47274e62fa4de3d668a 2024-11-07 00:16:53 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Building wheel for pyparsing (pyproject.toml): started 2024-11-07 00:16:53 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Building wheel for pyparsing (pyproject.toml): finished with status 'done' 2024-11-07 00:16:53 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Created wheel for pyparsing: filename=pyparsing-3.0.8-py3-none-any.whl size=98502 sha256=b850c29c308b5e6e9d94520a175c37dfbf2b9b067afe37c899518f00a4cb90c1 2024-11-07 00:16:53 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-i8wfzdu3/wheels/60/d3/8e/acf83d6d1a31a21478d0dd0a1a90d03a331cf68f135d467052 2024-11-07 00:16:53 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Building wheel for tenacity (setup.py): started 2024-11-07 00:16:55 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Building wheel for tenacity (setup.py): finished with status 'done' 2024-11-07 00:16:55 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Created wheel for tenacity: filename=tenacity-7.0.0-py2.py3-none-any.whl size=23320 sha256=49feb3808f30e52e4029bc95c8fb192486cb311bca6611a04b3ccaa943348a55 2024-11-07 00:16:55 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-i8wfzdu3/wheels/cc/e8/bb/26d039d69d48f7d1f01ba4ed894b59df5704d323c808a5db69 2024-11-07 00:16:55 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Building wheel for netaddr (setup.py): started 2024-11-07 00:16:58 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Building wheel for netaddr (setup.py): finished with status 'done' 2024-11-07 00:16:58 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Created wheel for netaddr: filename=netaddr-0.7.19-py3-none-any.whl size=1627931 sha256=9062e04166f11320c4d1cfb9b9e84dd32f91391d30ed1567079bf079d8a55173 2024-11-07 00:16:58 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-i8wfzdu3/wheels/2f/08/14/fd083ea24bae8aee0d887233356ce18f5c419a1e599a6a8f4c 2024-11-07 00:16:58 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Building wheel for charms.reactive (setup.py): started 2024-11-07 00:17:00 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Building wheel for charms.reactive (setup.py): finished with status 'done' 2024-11-07 00:17:00 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Created wheel for charms.reactive: filename=charms.reactive-1.5.0-py3-none-any.whl size=48112 sha256=f9bec8aa7d2e1ff558b0f5061a137b68024d9ff03ff0e6b3685321c533f2aa69 2024-11-07 00:17:00 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-i8wfzdu3/wheels/e7/70/c2/fedf7ce924f91596d279351e506a9862bcab0a55bff52fd971 2024-11-07 00:17:00 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Building wheel for packaging (pyproject.toml): started 2024-11-07 00:17:02 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Building wheel for packaging (pyproject.toml): finished with status 'done' 2024-11-07 00:17:02 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Created wheel for packaging: filename=packaging-21.3-py3-none-any.whl size=40749 sha256=e6b6fa4cc506589bad64f9d2a9f41dcdf4ef192e133d5eed9138571c471ea14d 2024-11-07 00:17:02 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-i8wfzdu3/wheels/72/43/16/423ccc7c82045b879b456a43611ccfa32cbc4868a9d9faafe1 2024-11-07 00:17:02 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Building wheel for MarkupSafe (setup.py): started 2024-11-07 00:17:04 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Building wheel for MarkupSafe (setup.py): finished with status 'done' 2024-11-07 00:17:04 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Created wheel for MarkupSafe: filename=MarkupSafe-2.1.1-cp310-cp310-linux_x86_64.whl size=25124 sha256=a2941fa7c442c2c9351f01e758619c496d635673fc4ab5494b1884e3a12100b6 2024-11-07 00:17:04 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-i8wfzdu3/wheels/ee/54/54/e78577cebb2d8c0197682df599c3f8d3c21d47f1082837aaca 2024-11-07 00:17:04 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Successfully built mysqlclient charms.openstack PyYAML Cython Jinja2 charmhelpers Tempita tomli flit-core netifaces psutil pyaml dnspython pbr six pyparsing tenacity netaddr charms.reactive packaging MarkupSafe 2024-11-07 00:17:04 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Installing collected packages: Tempita, netifaces, netaddr, charms.openstack, tomli, six, PyYAML, pyparsing, psutil, pbr, mysqlclient, MarkupSafe, flit-core, dnspython, Cython, tenacity, pyaml, packaging, Jinja2, charmhelpers, charms.reactive 2024-11-07 00:17:05 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Attempting uninstall: tomli 2024-11-07 00:17:05 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Found existing installation: tomli 2.0.1 2024-11-07 00:17:05 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Uninstalling tomli-2.0.1: 2024-11-07 00:17:05 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Successfully uninstalled tomli-2.0.1 2024-11-07 00:17:05 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Attempting uninstall: pyparsing 2024-11-07 00:17:05 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Found existing installation: pyparsing 3.0.8 2024-11-07 00:17:05 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Uninstalling pyparsing-3.0.8: 2024-11-07 00:17:05 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Successfully uninstalled pyparsing-3.0.8 2024-11-07 00:17:06 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Attempting uninstall: MarkupSafe 2024-11-07 00:17:06 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Found existing installation: MarkupSafe 2.1.1 2024-11-07 00:17:06 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Uninstalling MarkupSafe-2.1.1: 2024-11-07 00:17:06 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Successfully uninstalled MarkupSafe-2.1.1 2024-11-07 00:17:09 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Attempting uninstall: packaging 2024-11-07 00:17:09 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Found existing installation: packaging 21.3 2024-11-07 00:17:09 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Uninstalling packaging-21.3: 2024-11-07 00:17:09 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Successfully uninstalled packaging-21.3 2024-11-07 00:17:10 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Successfully installed Cython-0.29.37 Jinja2-3.1.1 MarkupSafe-2.1.1 PyYAML-6.0.1 Tempita-0.4 charmhelpers-1.1.1.dev44 charms.openstack-0.0.1.dev1 charms.reactive-1.5.0 dnspython-1.16.0 flit-core-3.7.1 mysqlclient-2.1.0 netaddr-0.7.19 netifaces-0.11.0 packaging-21.3 pbr-5.8.1 psutil-5.9.0 pyaml-21.10.1 pyparsing-3.0.8 six-1.16.0 tenacity-7.0.0 tomli-2.0.1 2024-11-07 00:17:11 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Reactive main running for hook install 2024-11-07 00:17:12 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.changed 2024-11-07 00:17:12 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.changed.snapd_refresh 2024-11-07 00:17:12 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.snapd_refresh 2024-11-07 00:17:12 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.changed.ssl_cert 2024-11-07 00:17:12 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_cert 2024-11-07 00:17:12 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.changed.ssl_key 2024-11-07 00:17:12 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_key 2024-11-07 00:17:12 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.changed.ssl_ca 2024-11-07 00:17:12 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_ca 2024-11-07 00:17:12 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.changed.source 2024-11-07 00:17:12 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.source 2024-11-07 00:17:12 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.source 2024-11-07 00:17:12 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.changed.cluster-name 2024-11-07 00:17:12 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.cluster-name 2024-11-07 00:17:12 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.cluster-name 2024-11-07 00:17:12 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.changed.auto-rejoin-tries 2024-11-07 00:17:12 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.auto-rejoin-tries 2024-11-07 00:17:12 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.auto-rejoin-tries 2024-11-07 00:17:12 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.changed.expel-timeout 2024-11-07 00:17:12 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.expel-timeout 2024-11-07 00:17:12 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.expel-timeout 2024-11-07 00:17:12 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.changed.innodb-buffer-pool-size 2024-11-07 00:17:12 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-buffer-pool-size 2024-11-07 00:17:13 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.changed.innodb-change-buffering 2024-11-07 00:17:13 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-change-buffering 2024-11-07 00:17:13 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-change-buffering 2024-11-07 00:17:13 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.changed.innodb-io-capacity 2024-11-07 00:17:13 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-io-capacity 2024-11-07 00:17:13 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-io-capacity 2024-11-07 00:17:13 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.changed.innodb-file-per-table 2024-11-07 00:17:13 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-file-per-table 2024-11-07 00:17:13 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-file-per-table 2024-11-07 00:17:13 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.changed.tuning-level 2024-11-07 00:17:13 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.tuning-level 2024-11-07 00:17:13 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.tuning-level 2024-11-07 00:17:13 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.changed.table-open-cache 2024-11-07 00:17:13 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.table-open-cache 2024-11-07 00:17:13 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.table-open-cache 2024-11-07 00:17:13 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.changed.max-connections 2024-11-07 00:17:13 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.max-connections 2024-11-07 00:17:13 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.changed.enable-binlogs 2024-11-07 00:17:13 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.enable-binlogs 2024-11-07 00:17:13 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.changed.binlogs-path 2024-11-07 00:17:13 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-path 2024-11-07 00:17:13 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-path 2024-11-07 00:17:13 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.changed.binlogs-max-size 2024-11-07 00:17:13 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-max-size 2024-11-07 00:17:13 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-max-size 2024-11-07 00:17:13 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.changed.binlogs-expire-days 2024-11-07 00:17:13 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-expire-days 2024-11-07 00:17:13 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-expire-days 2024-11-07 00:17:13 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.changed.prefer-ipv6 2024-11-07 00:17:13 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.prefer-ipv6 2024-11-07 00:17:13 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.changed.wait-timeout 2024-11-07 00:17:13 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.wait-timeout 2024-11-07 00:17:13 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.wait-timeout 2024-11-07 00:17:13 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.changed.os-db-router-hostname 2024-11-07 00:17:13 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.os-db-router-hostname 2024-11-07 00:17:13 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Initializing Snap Layer 2024-11-07 00:17:15 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Installing mysql-shell from store 2024-11-07 00:17:32 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for mysql-innodb-cluster/1 : {3 {map[mysql-innodb-cluster/0:{0}] map[] []}} 2024-11-07 00:17:32 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for mysql-innodb-cluster/1 : {4 {map[mysql-innodb-cluster/0:{0}] map[] []}} 2024-11-07 00:17:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Installation successful cmd="['snap', 'install', '--channel=stable', 'mysql-shell']" output="b'mysql-shell 8.0.23 from Canonical** installed\n'" 2024-11-07 00:17:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag snap.installed.mysql-shell 2024-11-07 00:17:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag snap.installed.core 2024-11-07 00:17:34 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Loading state 2024-11-07 00:17:34 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator No peer relation. Loading local state 2024-11-07 00:17:34 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:17:34 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Coordinator: Initializing coordinator layer 2024-11-07 00:17:34 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Initializing Leadership Layer (is leader) 2024-11-07 00:17:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag leadership.is_leader 2024-11-07 00:17:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: starting handler dispatch, 62 flags set tracer: set flag charms.openstack.do-default-update-status tracer: set flag config.changed tracer: set flag config.changed.auto-rejoin-tries tracer: set flag config.changed.binlogs-expire-days tracer: set flag config.changed.binlogs-max-size tracer: set flag config.changed.binlogs-path tracer: set flag config.changed.cluster-name tracer: set flag config.changed.enable-binlogs tracer: set flag config.changed.expel-timeout tracer: set flag config.changed.innodb-buffer-pool-size tracer: set flag config.changed.innodb-change-buffering tracer: set flag config.changed.innodb-file-per-table tracer: set flag config.changed.innodb-io-capacity tracer: set flag config.changed.max-connections tracer: set flag config.changed.os-db-router-hostname tracer: set flag config.changed.prefer-ipv6 tracer: set flag config.changed.snapd_refresh tracer: set flag config.changed.source tracer: set flag config.changed.ssl_ca tracer: set flag config.changed.ssl_cert tracer: set flag config.changed.ssl_key tracer: set flag config.changed.table-open-cache tracer: set flag config.changed.tuning-level tracer: set flag config.changed.wait-timeout tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag leadership.is_leader tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell 2024-11-07 00:17:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-11-07 00:17:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: main dispatch loop, 3 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:40:leader_install tracer: ++ queue handler reactive/snap.py:321:change_snapd_refresh 2024-11-07 00:17:34 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/snap.py:321:change_snapd_refresh 2024-11-07 00:17:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: set flag snap.refresh.set tracer: -- dequeue handler reactive/snap.py:321:change_snapd_refresh 2024-11-07 00:17:34 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:40:leader_install 2024-11-07 00:17:35 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for mysql-innodb-cluster/1 : {4 {map[mysql-innodb-cluster/0:{1}] map[] []}} 2024-11-07 00:17:35 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for mysql-innodb-cluster/1: ok=true 2024-11-07 00:17:35 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Hit:1 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy InRelease 2024-11-07 00:17:35 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Hit:2 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-11-07 00:17:35 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Hit:3 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-11-07 00:17:35 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Hit:4 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-security InRelease 2024-11-07 00:17:38 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Reading package lists... 2024-11-07 00:17:41 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Installing ['mysql-router', 'mysql-server-8.0', 'python3-dnspython', 'libpython2.7'] with options: ['--option=Dpkg::Options::=--force-confold'] 2024-11-07 00:17:41 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Reading package lists... 2024-11-07 00:17:41 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Building dependency tree... 2024-11-07 00:17:41 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Reading state information... 2024-11-07 00:17:41 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 The following additional packages will be installed: 2024-11-07 00:17:41 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 libcgi-fast-perl libcgi-pm-perl libclone-perl libencode-locale-perl 2024-11-07 00:17:41 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 libevent-extra-2.1-7 libevent-openssl-2.1-7 libevent-pthreads-2.1-7 2024-11-07 00:17:41 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 libfcgi-bin libfcgi-perl libfcgi0ldbl libhtml-parser-perl 2024-11-07 00:17:41 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 libhtml-tagset-perl libhtml-template-perl libhttp-date-perl 2024-11-07 00:17:41 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 libhttp-message-perl libio-html-perl liblwp-mediatypes-perl libmecab2 2024-11-07 00:17:41 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 libprotobuf-lite23 libpython2.7-minimal libpython2.7-stdlib libtimedate-perl 2024-11-07 00:17:41 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 liburi-perl mecab-ipadic mecab-ipadic-utf8 mecab-utils mysql-client-8.0 2024-11-07 00:17:41 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 mysql-client-core-8.0 mysql-server-core-8.0 python3-requests-toolbelt 2024-11-07 00:17:41 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Suggested packages: 2024-11-07 00:17:41 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 libdata-dump-perl libipc-sharedcache-perl libbusiness-isbn-perl libwww-perl 2024-11-07 00:17:41 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 mailx tinyca python3-sniffio python3-trio 2024-11-07 00:17:41 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 The following NEW packages will be installed: 2024-11-07 00:17:41 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 libcgi-fast-perl libcgi-pm-perl libclone-perl libencode-locale-perl 2024-11-07 00:17:41 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 libevent-extra-2.1-7 libevent-openssl-2.1-7 libevent-pthreads-2.1-7 2024-11-07 00:17:41 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 libfcgi-bin libfcgi-perl libfcgi0ldbl libhtml-parser-perl 2024-11-07 00:17:41 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 libhtml-tagset-perl libhtml-template-perl libhttp-date-perl 2024-11-07 00:17:41 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 libhttp-message-perl libio-html-perl liblwp-mediatypes-perl libmecab2 2024-11-07 00:17:41 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 libprotobuf-lite23 libpython2.7 libpython2.7-minimal libpython2.7-stdlib 2024-11-07 00:17:41 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 libtimedate-perl liburi-perl mecab-ipadic mecab-ipadic-utf8 mecab-utils 2024-11-07 00:17:41 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 mysql-client-8.0 mysql-client-core-8.0 mysql-router mysql-server-8.0 2024-11-07 00:17:41 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 mysql-server-core-8.0 python3-dnspython python3-requests-toolbelt 2024-11-07 00:17:41 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 0 upgraded, 34 newly installed, 0 to remove and 0 not upgraded. 2024-11-07 00:17:41 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Need to get 37.8 MB of archives. 2024-11-07 00:17:41 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 After this operation, 293 MB of additional disk space will be used. 2024-11-07 00:17:41 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:1 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/main amd64 mysql-client-core-8.0 amd64 8.0.36-0ubuntu0.22.04.1 [2692 kB] 2024-11-07 00:17:41 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:2 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/main amd64 mysql-client-8.0 amd64 8.0.36-0ubuntu0.22.04.1 [22.7 kB] 2024-11-07 00:17:41 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:3 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 libevent-pthreads-2.1-7 amd64 2.1.12-stable-1build3 [7642 B] 2024-11-07 00:17:41 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:4 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 libmecab2 amd64 0.996-14build9 [199 kB] 2024-11-07 00:17:42 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:5 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/main amd64 libprotobuf-lite23 amd64 3.12.4-1ubuntu7.22.04.1 [209 kB] 2024-11-07 00:17:42 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:6 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/main amd64 mysql-server-core-8.0 amd64 8.0.36-0ubuntu0.22.04.1 [17.5 MB] 2024-11-07 00:17:42 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:7 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/main amd64 mysql-server-8.0 amd64 8.0.36-0ubuntu0.22.04.1 [1437 kB] 2024-11-07 00:17:42 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:8 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 libhtml-tagset-perl all 3.20-4 [12.5 kB] 2024-11-07 00:17:42 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:9 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 liburi-perl all 5.10-1 [78.8 kB] 2024-11-07 00:17:42 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:10 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 libhtml-parser-perl amd64 3.76-1build2 [88.4 kB] 2024-11-07 00:17:42 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:11 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 libcgi-pm-perl all 4.54-1 [188 kB] 2024-11-07 00:17:42 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:12 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 libfcgi0ldbl amd64 2.4.2-2build2 [28.0 kB] 2024-11-07 00:17:42 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:13 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 libfcgi-perl amd64 0.82+ds-1build1 [22.8 kB] 2024-11-07 00:17:42 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:14 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 libcgi-fast-perl all 1:2.15-1 [10.5 kB] 2024-11-07 00:17:42 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:15 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 libclone-perl amd64 0.45-1build3 [11.0 kB] 2024-11-07 00:17:42 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:16 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 libencode-locale-perl all 1.05-1.1 [11.8 kB] 2024-11-07 00:17:42 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:17 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 libevent-extra-2.1-7 amd64 2.1.12-stable-1build3 [65.4 kB] 2024-11-07 00:17:43 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:18 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 libevent-openssl-2.1-7 amd64 2.1.12-stable-1build3 [15.8 kB] 2024-11-07 00:17:43 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:19 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 libfcgi-bin amd64 2.4.2-2build2 [11.2 kB] 2024-11-07 00:17:43 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:20 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 libhtml-template-perl all 2.97-1.1 [59.1 kB] 2024-11-07 00:17:43 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:21 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 libtimedate-perl all 2.3300-2 [34.0 kB] 2024-11-07 00:17:43 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:22 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 libhttp-date-perl all 6.05-1 [9920 B] 2024-11-07 00:17:43 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:23 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 libio-html-perl all 1.004-2 [15.4 kB] 2024-11-07 00:17:43 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:24 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 liblwp-mediatypes-perl all 6.04-1 [19.5 kB] 2024-11-07 00:17:43 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:25 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 libhttp-message-perl all 6.36-1 [76.8 kB] 2024-11-07 00:17:43 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:26 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libpython2.7-minimal amd64 2.7.18-13ubuntu1.2 [347 kB] 2024-11-07 00:17:43 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:27 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libpython2.7-stdlib amd64 2.7.18-13ubuntu1.2 [1977 kB] 2024-11-07 00:17:43 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:28 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libpython2.7 amd64 2.7.18-13ubuntu1.2 [1160 kB] 2024-11-07 00:17:43 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:29 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 mecab-utils amd64 0.996-14build9 [4850 B] 2024-11-07 00:17:43 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:30 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 mecab-ipadic all 2.7.0-20070801+main-3 [6718 kB] 2024-11-07 00:17:43 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:31 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 mecab-ipadic-utf8 all 2.7.0-20070801+main-3 [4384 B] 2024-11-07 00:17:43 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:32 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy-updates/universe amd64 mysql-router amd64 8.0.36-0ubuntu0.22.04.1 [4603 kB] 2024-11-07 00:17:43 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:33 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 python3-dnspython all 2.1.0-1ubuntu1 [123 kB] 2024-11-07 00:17:43 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Get:34 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu jammy/main amd64 python3-requests-toolbelt all 0.9.1-1 [38.0 kB] 2024-11-07 00:17:43 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preconfiguring packages ... 2024-11-07 00:17:44 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Fetched 37.8 MB in 2s (24.7 MB/s) 2024-11-07 00:17:44 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package mysql-client-core-8.0. 2024-11-07 00:17:44 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 41272 files and directories currently installed.) 2024-11-07 00:17:44 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../00-mysql-client-core-8.0_8.0.36-0ubuntu0.22.04.1_amd64.deb ... 2024-11-07 00:17:44 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking mysql-client-core-8.0 (8.0.36-0ubuntu0.22.04.1) ... 2024-11-07 00:17:44 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package mysql-client-8.0. 2024-11-07 00:17:44 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../01-mysql-client-8.0_8.0.36-0ubuntu0.22.04.1_amd64.deb ... 2024-11-07 00:17:44 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking mysql-client-8.0 (8.0.36-0ubuntu0.22.04.1) ... 2024-11-07 00:17:44 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package libevent-pthreads-2.1-7:amd64. 2024-11-07 00:17:44 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../02-libevent-pthreads-2.1-7_2.1.12-stable-1build3_amd64.deb ... 2024-11-07 00:17:44 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking libevent-pthreads-2.1-7:amd64 (2.1.12-stable-1build3) ... 2024-11-07 00:17:44 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package libmecab2:amd64. 2024-11-07 00:17:44 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../03-libmecab2_0.996-14build9_amd64.deb ... 2024-11-07 00:17:44 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking libmecab2:amd64 (0.996-14build9) ... 2024-11-07 00:17:45 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package libprotobuf-lite23:amd64. 2024-11-07 00:17:45 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../04-libprotobuf-lite23_3.12.4-1ubuntu7.22.04.1_amd64.deb ... 2024-11-07 00:17:45 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking libprotobuf-lite23:amd64 (3.12.4-1ubuntu7.22.04.1) ... 2024-11-07 00:17:45 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package mysql-server-core-8.0. 2024-11-07 00:17:45 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../05-mysql-server-core-8.0_8.0.36-0ubuntu0.22.04.1_amd64.deb ... 2024-11-07 00:17:45 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking mysql-server-core-8.0 (8.0.36-0ubuntu0.22.04.1) ... 2024-11-07 00:17:47 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package mysql-server-8.0. 2024-11-07 00:17:47 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../06-mysql-server-8.0_8.0.36-0ubuntu0.22.04.1_amd64.deb ... 2024-11-07 00:17:49 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking mysql-server-8.0 (8.0.36-0ubuntu0.22.04.1) ... 2024-11-07 00:17:49 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package libhtml-tagset-perl. 2024-11-07 00:17:49 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../07-libhtml-tagset-perl_3.20-4_all.deb ... 2024-11-07 00:17:49 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking libhtml-tagset-perl (3.20-4) ... 2024-11-07 00:17:50 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package liburi-perl. 2024-11-07 00:17:50 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../08-liburi-perl_5.10-1_all.deb ... 2024-11-07 00:17:50 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking liburi-perl (5.10-1) ... 2024-11-07 00:17:51 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package libhtml-parser-perl:amd64. 2024-11-07 00:17:51 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../09-libhtml-parser-perl_3.76-1build2_amd64.deb ... 2024-11-07 00:17:51 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking libhtml-parser-perl:amd64 (3.76-1build2) ... 2024-11-07 00:17:52 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package libcgi-pm-perl. 2024-11-07 00:17:52 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../10-libcgi-pm-perl_4.54-1_all.deb ... 2024-11-07 00:17:52 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking libcgi-pm-perl (4.54-1) ... 2024-11-07 00:17:52 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package libfcgi0ldbl:amd64. 2024-11-07 00:17:52 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../11-libfcgi0ldbl_2.4.2-2build2_amd64.deb ... 2024-11-07 00:17:52 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking libfcgi0ldbl:amd64 (2.4.2-2build2) ... 2024-11-07 00:17:53 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package libfcgi-perl:amd64. 2024-11-07 00:17:53 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../12-libfcgi-perl_0.82+ds-1build1_amd64.deb ... 2024-11-07 00:17:53 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking libfcgi-perl:amd64 (0.82+ds-1build1) ... 2024-11-07 00:17:53 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package libcgi-fast-perl. 2024-11-07 00:17:53 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../13-libcgi-fast-perl_1%3a2.15-1_all.deb ... 2024-11-07 00:17:53 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking libcgi-fast-perl (1:2.15-1) ... 2024-11-07 00:17:53 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package libclone-perl. 2024-11-07 00:17:53 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../14-libclone-perl_0.45-1build3_amd64.deb ... 2024-11-07 00:17:53 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking libclone-perl (0.45-1build3) ... 2024-11-07 00:17:54 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package libencode-locale-perl. 2024-11-07 00:17:54 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../15-libencode-locale-perl_1.05-1.1_all.deb ... 2024-11-07 00:17:55 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking libencode-locale-perl (1.05-1.1) ... 2024-11-07 00:17:56 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package libevent-extra-2.1-7:amd64. 2024-11-07 00:17:56 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../16-libevent-extra-2.1-7_2.1.12-stable-1build3_amd64.deb ... 2024-11-07 00:17:56 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking libevent-extra-2.1-7:amd64 (2.1.12-stable-1build3) ... 2024-11-07 00:17:56 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package libevent-openssl-2.1-7:amd64. 2024-11-07 00:17:56 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../17-libevent-openssl-2.1-7_2.1.12-stable-1build3_amd64.deb ... 2024-11-07 00:17:56 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking libevent-openssl-2.1-7:amd64 (2.1.12-stable-1build3) ... 2024-11-07 00:17:56 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package libfcgi-bin. 2024-11-07 00:17:56 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../18-libfcgi-bin_2.4.2-2build2_amd64.deb ... 2024-11-07 00:17:56 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking libfcgi-bin (2.4.2-2build2) ... 2024-11-07 00:17:56 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package libhtml-template-perl. 2024-11-07 00:17:56 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../19-libhtml-template-perl_2.97-1.1_all.deb ... 2024-11-07 00:17:56 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking libhtml-template-perl (2.97-1.1) ... 2024-11-07 00:17:56 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package libtimedate-perl. 2024-11-07 00:17:56 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../20-libtimedate-perl_2.3300-2_all.deb ... 2024-11-07 00:17:57 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking libtimedate-perl (2.3300-2) ... 2024-11-07 00:17:57 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package libhttp-date-perl. 2024-11-07 00:17:57 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../21-libhttp-date-perl_6.05-1_all.deb ... 2024-11-07 00:17:57 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking libhttp-date-perl (6.05-1) ... 2024-11-07 00:17:57 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package libio-html-perl. 2024-11-07 00:17:57 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../22-libio-html-perl_1.004-2_all.deb ... 2024-11-07 00:17:57 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking libio-html-perl (1.004-2) ... 2024-11-07 00:17:57 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package liblwp-mediatypes-perl. 2024-11-07 00:17:57 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../23-liblwp-mediatypes-perl_6.04-1_all.deb ... 2024-11-07 00:17:57 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking liblwp-mediatypes-perl (6.04-1) ... 2024-11-07 00:17:57 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package libhttp-message-perl. 2024-11-07 00:17:57 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../24-libhttp-message-perl_6.36-1_all.deb ... 2024-11-07 00:17:57 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking libhttp-message-perl (6.36-1) ... 2024-11-07 00:17:58 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package libpython2.7-minimal:amd64. 2024-11-07 00:17:58 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../25-libpython2.7-minimal_2.7.18-13ubuntu1.2_amd64.deb ... 2024-11-07 00:17:58 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking libpython2.7-minimal:amd64 (2.7.18-13ubuntu1.2) ... 2024-11-07 00:17:59 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package libpython2.7-stdlib:amd64. 2024-11-07 00:17:59 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../26-libpython2.7-stdlib_2.7.18-13ubuntu1.2_amd64.deb ... 2024-11-07 00:17:59 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking libpython2.7-stdlib:amd64 (2.7.18-13ubuntu1.2) ... 2024-11-07 00:18:01 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package libpython2.7:amd64. 2024-11-07 00:18:01 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../27-libpython2.7_2.7.18-13ubuntu1.2_amd64.deb ... 2024-11-07 00:18:01 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking libpython2.7:amd64 (2.7.18-13ubuntu1.2) ... 2024-11-07 00:18:01 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package mecab-utils. 2024-11-07 00:18:01 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../28-mecab-utils_0.996-14build9_amd64.deb ... 2024-11-07 00:18:01 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking mecab-utils (0.996-14build9) ... 2024-11-07 00:18:02 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package mecab-ipadic. 2024-11-07 00:18:02 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../29-mecab-ipadic_2.7.0-20070801+main-3_all.deb ... 2024-11-07 00:18:02 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking mecab-ipadic (2.7.0-20070801+main-3) ... 2024-11-07 00:18:06 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package mecab-ipadic-utf8. 2024-11-07 00:18:06 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../30-mecab-ipadic-utf8_2.7.0-20070801+main-3_all.deb ... 2024-11-07 00:18:06 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking mecab-ipadic-utf8 (2.7.0-20070801+main-3) ... 2024-11-07 00:18:07 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package mysql-router. 2024-11-07 00:18:07 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../31-mysql-router_8.0.36-0ubuntu0.22.04.1_amd64.deb ... 2024-11-07 00:18:07 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking mysql-router (8.0.36-0ubuntu0.22.04.1) ... 2024-11-07 00:18:08 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package python3-dnspython. 2024-11-07 00:18:08 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../32-python3-dnspython_2.1.0-1ubuntu1_all.deb ... 2024-11-07 00:18:08 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking python3-dnspython (2.1.0-1ubuntu1) ... 2024-11-07 00:18:08 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Selecting previously unselected package python3-requests-toolbelt. 2024-11-07 00:18:08 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Preparing to unpack .../33-python3-requests-toolbelt_0.9.1-1_all.deb ... 2024-11-07 00:18:08 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Unpacking python3-requests-toolbelt (0.9.1-1) ... 2024-11-07 00:18:09 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up libmecab2:amd64 (0.996-14build9) ... 2024-11-07 00:18:09 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up mysql-client-core-8.0 (8.0.36-0ubuntu0.22.04.1) ... 2024-11-07 00:18:09 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up libevent-extra-2.1-7:amd64 (2.1.12-stable-1build3) ... 2024-11-07 00:18:09 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up python3-requests-toolbelt (0.9.1-1) ... 2024-11-07 00:18:09 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up libfcgi0ldbl:amd64 (2.4.2-2build2) ... 2024-11-07 00:18:09 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up libclone-perl (0.45-1build3) ... 2024-11-07 00:18:09 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up libhtml-tagset-perl (3.20-4) ... 2024-11-07 00:18:10 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up liblwp-mediatypes-perl (6.04-1) ... 2024-11-07 00:18:10 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up libfcgi-bin (2.4.2-2build2) ... 2024-11-07 00:18:10 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up libevent-openssl-2.1-7:amd64 (2.1.12-stable-1build3) ... 2024-11-07 00:18:10 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up libencode-locale-perl (1.05-1.1) ... 2024-11-07 00:18:10 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up libprotobuf-lite23:amd64 (3.12.4-1ubuntu7.22.04.1) ... 2024-11-07 00:18:10 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up libpython2.7-minimal:amd64 (2.7.18-13ubuntu1.2) ... 2024-11-07 00:18:10 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up mecab-utils (0.996-14build9) ... 2024-11-07 00:18:10 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up libio-html-perl (1.004-2) ... 2024-11-07 00:18:10 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up libtimedate-perl (2.3300-2) ... 2024-11-07 00:18:11 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up python3-dnspython (2.1.0-1ubuntu1) ... 2024-11-07 00:18:11 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up mysql-client-8.0 (8.0.36-0ubuntu0.22.04.1) ... 2024-11-07 00:18:11 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up libfcgi-perl:amd64 (0.82+ds-1build1) ... 2024-11-07 00:18:11 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up liburi-perl (5.10-1) ... 2024-11-07 00:18:11 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up libevent-pthreads-2.1-7:amd64 (2.1.12-stable-1build3) ... 2024-11-07 00:18:12 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up libhttp-date-perl (6.05-1) ... 2024-11-07 00:18:12 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up mecab-ipadic (2.7.0-20070801+main-3) ... 2024-11-07 00:18:12 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Compiling IPA dictionary for Mecab. This takes long time... 2024-11-07 00:18:12 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 reading /usr/share/mecab/dic/ipadic/unk.def ... 40 2024-11-07 00:18:12 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 emitting double-array: 9% |### | emitting double-array: 18% |####### | emitting double-array: 27% |########### | emitting double-array: 36% |############### | emitting double-array: 45% |################### | emitting double-array: 54% |####################### | emitting double-array: 63% |########################### | emitting double-array: 72% |############################### | emitting double-array: 81% |################################### | emitting double-array: 90% |####################################### | emitting double-array: 100% |###########################################| 2024-11-07 00:18:12 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 /usr/share/mecab/dic/ipadic/model.def is not found. skipped. 2024-11-07 00:18:12 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 reading /usr/share/mecab/dic/ipadic/Adnominal.csv ... 135 2024-11-07 00:18:12 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 reading /usr/share/mecab/dic/ipadic/Verb.csv ... 130750 2024-11-07 00:18:12 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 reading /usr/share/mecab/dic/ipadic/Noun.number.csv ... 42 2024-11-07 00:18:12 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 reading /usr/share/mecab/dic/ipadic/Noun.place.csv ... 72999 2024-11-07 00:18:12 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 reading /usr/share/mecab/dic/ipadic/Filler.csv ... 19 2024-11-07 00:18:12 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 reading /usr/share/mecab/dic/ipadic/Adverb.csv ... 3032 2024-11-07 00:18:12 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 reading /usr/share/mecab/dic/ipadic/Interjection.csv ... 252 2024-11-07 00:18:12 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 reading /usr/share/mecab/dic/ipadic/Others.csv ... 2 2024-11-07 00:18:12 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 reading /usr/share/mecab/dic/ipadic/Conjunction.csv ... 171 2024-11-07 00:18:12 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 reading /usr/share/mecab/dic/ipadic/Postp-col.csv ... 91 2024-11-07 00:18:12 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 reading /usr/share/mecab/dic/ipadic/Noun.verbal.csv ... 12146 2024-11-07 00:18:12 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 reading /usr/share/mecab/dic/ipadic/Noun.adverbal.csv ... 795 2024-11-07 00:18:12 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 reading /usr/share/mecab/dic/ipadic/Noun.csv ... 60477 2024-11-07 00:18:12 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 reading /usr/share/mecab/dic/ipadic/Noun.name.csv ... 34202 2024-11-07 00:18:12 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 reading /usr/share/mecab/dic/ipadic/Noun.demonst.csv ... 120 2024-11-07 00:18:12 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 reading /usr/share/mecab/dic/ipadic/Suffix.csv ... 1393 2024-11-07 00:18:12 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 reading /usr/share/mecab/dic/ipadic/Noun.others.csv ... 151 2024-11-07 00:18:12 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 reading /usr/share/mecab/dic/ipadic/Prefix.csv ... 221 2024-11-07 00:18:13 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 reading /usr/share/mecab/dic/ipadic/Noun.proper.csv ... 27328 2024-11-07 00:18:13 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 reading /usr/share/mecab/dic/ipadic/Noun.adjv.csv ... 3328 2024-11-07 00:18:13 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 reading /usr/share/mecab/dic/ipadic/Noun.org.csv ... 16668 2024-11-07 00:18:13 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 reading /usr/share/mecab/dic/ipadic/Auxil.csv ... 199 2024-11-07 00:18:13 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 reading /usr/share/mecab/dic/ipadic/Noun.nai.csv ... 42 2024-11-07 00:18:13 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 reading /usr/share/mecab/dic/ipadic/Symbol.csv ... 208 2024-11-07 00:18:13 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 reading /usr/share/mecab/dic/ipadic/Adj.csv ... 27210 2024-11-07 00:18:13 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 reading /usr/share/mecab/dic/ipadic/Postp.csv ... 146 2024-11-07 00:18:13 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 emitting double-array: 0% | | emitting double-array: 1% | | emitting double-array: 2% | | emitting double-array: 3% |# | emitting double-array: 4% |# | emitting double-array: 5% |## | emitting double-array: 6% |## | emitting double-array: 7% |### | emitting double-array: 8% |### | emitting double-array: 9% |### | emitting double-array: 10% |#### | emitting double-array: 11% |#### | emitting double-array: 12% |##### | emitting double-array: 13% |##### | emitting double-array: 14% |###### | emitting double-array: 15% |###### | emitting double-array: 16% |###### | emitting double-array: 17% |####### | emitting double-array: 18% |####### | emitting double-array: 19% |######## | emitting double-array: 20% |######## | emitting double-array: 21% |######### | emitting double-array: 22% |######### | emitting double-array: 23% |######### | emitting double-array: 24% |########## | emitting double-array: 25% |########## | emitting double-array: 26% |########### | emitting double-array: 27% |########### | emitting double-array: 28% |############ | emitting double-array: 29% |############ | emitting double-array: 30% |############ | emitting double-array: 31% |############# | emitting double-array: 32% |############# | emitting double-array: 33% |############## | emitting double-array: 34% |############## | emitting double-array: 35% |############### | emitting double-array: 36% |############### | emitting double-array: 37% |############### | emitting double-array: 38% |################ | emitting double-array: 39% |################ | emitting double-array: 40% |################# | emitting double-array: 41% |################# | emitting double-array: 42% |################## | emitting double-array: 43% |################## | emitting double-array: 44% |################## | emitting double-array: 45% |################### | emitting double-array: 46% |################### | emitting double-array: 47% |#################### | emitting double-array: 48% |#################### | emitting double-array: 49% |##################### | emitting double-array: 50% |##################### | emitting double-array: 51% |##################### | emitting double-array: 52% |###################### | emitting double-array: 53% |###################### | emitting double-array: 54% |################# 2024-11-07 00:18:13 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 ###### | emitting double-array: 55% |####################### | emitting double-array: 56% |######################## | emitting double-array: 57% |######################## | emitting double-array: 58% |######################## | emitting double-array: 59% |######################### | emitting double-array: 60% |######################### | emitting double-array: 61% |########################## | emitting double-array: 62% |########################## | emitting double-array: 63% |########################### | emitting double-array: 64% |########################### | emitting double-array: 65% |########################### | emitting double-array: 66% |############################ | emitting double-array: 67% |############################ | emitting double-array: 68% |############################# | emitting double-array: 69% |############################# | emitting double-array: 70% |############################## | emitting double-array: 71% |############################## | emitting double-array: 72% |############################## | emitting double-array: 73% |############################### | emitting double-array: 74% |############################### | emitting double-array: 75% |################################ | emitting double-array: 76% |################################ | emitting double-array: 77% |################################# | emitting double-array: 78% |################################# | emitting double-array: 79% |################################# | emitting double-array: 80% |################################## | emitting double-array: 81% |################################## | emitting double-array: 82% |################################### | emitting double-array: 83% |################################### | emitting double-array: 84% |#################################### | emitting double-array: 85% |#################################### | emitting double-array: 86% |#################################### | emitting double-array: 87% |##################################### | emitting double-array: 88% |##################################### | emitting double-array: 89% |###################################### | emitting double-array: 90% |###################################### | emitting double-array: 91% |####################################### | emitting double-array: 92% |####################################### | emitting double-array: 93% |####################################### | emitting double-array: 94% |######################################## | emitting double-array: 95% |######################################## | emitting double-array: 96% |######################################### | emitting double-array: 97% |######################################### | emitting double-array: 98% |########################################## | emitting double-array: 99% |########################################## | emitting double-array: 100% |###########################################| 2024-11-07 00:18:13 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 reading /usr/share/mecab/dic/ipadic/matrix.def ... 1316x1316 2024-11-07 00:18:13 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 emitting matrix : 0% | | emitting matrix : 1% | | emitting matrix : 2% | | emitting matrix : 3% |# | emitting matrix : 4% |# | emitting matrix : 5% |## | emitting matrix : 6% |## | emitting matrix : 7% |### | emitting matrix : 8% |### | emitting matrix : 9% |### | emitting matrix : 10% |#### | emitting matrix : 11% |#### | emitting matrix : 12% |##### | emitting matrix : 13% |##### | emitting matrix : 14% |###### | emitting matrix : 15% |###### | emitting matrix : 16% |###### | emitting matrix : 17% |####### | emitting matrix : 18% |####### | emitting matrix : 19% |######## | emitting matrix : 20% |######## | emitting matrix : 21% |######### | emitting matrix : 22% |######### | emitting matrix : 23% |######### | emitting matrix : 24% |########## | emitting matrix : 25% |########## | emitting matrix : 26% |########### | emitting matrix : 27% |########### | emitting matrix : 28% |############ | emitting matrix : 29% |############ | emitting matrix : 30% |############ | emitting matrix : 31% |############# | emitting matrix : 32% |############# | emitting matrix : 33% |############## | emitting matrix : 34% |############## | emitting matrix : 35% |############### | emitting matrix : 36% |############### | emitting matrix : 37% |############### | emitting matrix : 38% |################ | emitting matrix : 39% |################ | emitting matrix : 40% |################# | emitting matrix : 41% |################# | emitting matrix : 42% |################## | emitting matrix : 43% |################## | emitting matrix : 44% |################## | emitting matrix : 45% |################### | emitting matrix : 46% |################### | emitting matrix : 47% |#################### | emitting matrix : 48% |#################### | emitting matrix : 49% |##################### | emitting matrix : 50% |##################### | emitting matrix : 51% |##################### | emitting matrix : 52% |###################### | emitting matrix : 53% |###################### | emitting matrix : 54% |################# 2024-11-07 00:18:13 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 ###### | emitting matrix : 55% |####################### | emitting matrix : 56% |######################## | emitting matrix : 57% |######################## | emitting matrix : 58% |######################## | emitting matrix : 59% |######################### | emitting matrix : 60% |######################### | emitting matrix : 61% |########################## | emitting matrix : 62% |########################## | emitting matrix : 63% |########################### | emitting matrix : 64% |########################### | emitting matrix : 65% |########################### | emitting matrix : 66% |############################ | emitting matrix : 67% |############################ | emitting matrix : 68% |############################# | emitting matrix : 69% |############################# | emitting matrix : 70% |############################## | emitting matrix : 71% |############################## | emitting matrix : 72% |############################## | emitting matrix : 73% |############################### | emitting matrix : 74% |############################### | emitting matrix : 75% |################################ | emitting matrix : 76% |################################ | emitting matrix : 77% |################################# | emitting matrix : 78% |################################# | emitting matrix : 79% |################################# | emitting matrix : 80% |################################## | emitting matrix : 81% |################################## | emitting matrix : 82% |################################### | emitting matrix : 83% |################################### | emitting matrix : 84% |#################################### | emitting matrix : 85% |#################################### | emitting matrix : 86% |#################################### | emitting matrix : 87% |##################################### | emitting matrix : 88% |##################################### | emitting matrix : 89% |###################################### | emitting matrix : 90% |###################################### | emitting matrix : 91% |####################################### | emitting matrix : 92% |####################################### | emitting matrix : 93% |####################################### | emitting matrix : 94% |######################################## | emitting matrix : 95% |######################################## | emitting matrix : 96% |######################################### | emitting matrix : 97% |######################################### | emitting matrix : 98% |########################################## | emitting matrix : 99% |########################################## | emitting matrix : 100% |###########################################| 2024-11-07 00:18:13 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 2024-11-07 00:18:13 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 done! 2024-11-07 00:18:14 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 update-alternatives: using /var/lib/mecab/dic/ipadic to provide /var/lib/mecab/dic/debian (mecab-dictionary) in auto mode 2024-11-07 00:18:14 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up libpython2.7-stdlib:amd64 (2.7.18-13ubuntu1.2) ... 2024-11-07 00:18:14 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up mysql-server-core-8.0 (8.0.36-0ubuntu0.22.04.1) ... 2024-11-07 00:18:14 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up mecab-ipadic-utf8 (2.7.0-20070801+main-3) ... 2024-11-07 00:18:14 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Compiling IPA dictionary for Mecab. This takes long time... 2024-11-07 00:18:14 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 reading /usr/share/mecab/dic/ipadic/unk.def ... 40 2024-11-07 00:18:14 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 emitting double-array: 9% |### | emitting double-array: 18% |####### | emitting double-array: 27% |########### | emitting double-array: 36% |############### | emitting double-array: 45% |################### | emitting double-array: 54% |####################### | emitting double-array: 63% |########################### | emitting double-array: 72% |############################### | emitting double-array: 81% |################################### | emitting double-array: 90% |####################################### | emitting double-array: 100% |###########################################| 2024-11-07 00:18:14 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 /usr/share/mecab/dic/ipadic/model.def is not found. skipped. 2024-11-07 00:18:14 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 reading /usr/share/mecab/dic/ipadic/Adnominal.csv ... 135 2024-11-07 00:18:15 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 reading /usr/share/mecab/dic/ipadic/Verb.csv ... 130750 2024-11-07 00:18:15 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 reading /usr/share/mecab/dic/ipadic/Noun.number.csv ... 42 2024-11-07 00:18:15 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 reading /usr/share/mecab/dic/ipadic/Noun.place.csv ... 72999 2024-11-07 00:18:15 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 reading /usr/share/mecab/dic/ipadic/Filler.csv ... 19 2024-11-07 00:18:15 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 reading /usr/share/mecab/dic/ipadic/Adverb.csv ... 3032 2024-11-07 00:18:15 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 reading /usr/share/mecab/dic/ipadic/Interjection.csv ... 252 2024-11-07 00:18:15 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 reading /usr/share/mecab/dic/ipadic/Others.csv ... 2 2024-11-07 00:18:15 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 reading /usr/share/mecab/dic/ipadic/Conjunction.csv ... 171 2024-11-07 00:18:15 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 reading /usr/share/mecab/dic/ipadic/Postp-col.csv ... 91 2024-11-07 00:18:15 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 reading /usr/share/mecab/dic/ipadic/Noun.verbal.csv ... 12146 2024-11-07 00:18:15 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 reading /usr/share/mecab/dic/ipadic/Noun.adverbal.csv ... 795 2024-11-07 00:18:15 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 reading /usr/share/mecab/dic/ipadic/Noun.csv ... 60477 2024-11-07 00:18:15 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 reading /usr/share/mecab/dic/ipadic/Noun.name.csv ... 34202 2024-11-07 00:18:15 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 reading /usr/share/mecab/dic/ipadic/Noun.demonst.csv ... 120 2024-11-07 00:18:15 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 reading /usr/share/mecab/dic/ipadic/Suffix.csv ... 1393 2024-11-07 00:18:15 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 reading /usr/share/mecab/dic/ipadic/Noun.others.csv ... 151 2024-11-07 00:18:15 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 reading /usr/share/mecab/dic/ipadic/Prefix.csv ... 221 2024-11-07 00:18:15 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 reading /usr/share/mecab/dic/ipadic/Noun.proper.csv ... 27328 2024-11-07 00:18:15 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 reading /usr/share/mecab/dic/ipadic/Noun.adjv.csv ... 3328 2024-11-07 00:18:15 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 reading /usr/share/mecab/dic/ipadic/Noun.org.csv ... 16668 2024-11-07 00:18:15 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 reading /usr/share/mecab/dic/ipadic/Auxil.csv ... 199 2024-11-07 00:18:15 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 reading /usr/share/mecab/dic/ipadic/Noun.nai.csv ... 42 2024-11-07 00:18:15 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 reading /usr/share/mecab/dic/ipadic/Symbol.csv ... 208 2024-11-07 00:18:15 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 reading /usr/share/mecab/dic/ipadic/Adj.csv ... 27210 2024-11-07 00:18:15 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 reading /usr/share/mecab/dic/ipadic/Postp.csv ... 146 2024-11-07 00:18:15 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 emitting double-array: 0% | | emitting double-array: 1% | | emitting double-array: 2% | | emitting double-array: 3% |# | emitting double-array: 4% |# | emitting double-array: 5% |## | emitting double-array: 6% |## | emitting double-array: 7% |### | emitting double-array: 8% |### | emitting double-array: 9% |### | emitting double-array: 10% |#### | emitting double-array: 11% |#### | emitting double-array: 12% |##### | emitting double-array: 13% |##### | emitting double-array: 14% |###### | emitting double-array: 15% |###### | emitting double-array: 16% |###### | emitting double-array: 17% |####### | emitting double-array: 18% |####### | emitting double-array: 19% |######## | emitting double-array: 20% |######## | emitting double-array: 21% |######### | emitting double-array: 22% |######### | emitting double-array: 23% |######### | emitting double-array: 24% |########## | emitting double-array: 25% |########## | emitting double-array: 26% |########### | emitting double-array: 27% |########### | emitting double-array: 28% |############ | emitting double-array: 29% |############ | emitting double-array: 30% |############ | emitting double-array: 31% |############# | emitting double-array: 32% |############# | emitting double-array: 33% |############## | emitting double-array: 34% |############## | emitting double-array: 35% |############### | emitting double-array: 36% |############### | emitting double-array: 37% |############### | emitting double-array: 38% |################ | emitting double-array: 39% |################ | emitting double-array: 40% |################# | emitting double-array: 41% |################# | emitting double-array: 42% |################## | emitting double-array: 43% |################## | emitting double-array: 44% |################## | emitting double-array: 45% |################### | emitting double-array: 46% |################### | emitting double-array: 47% |#################### | emitting double-array: 48% |#################### | emitting double-array: 49% |##################### | emitting double-array: 50% |##################### | emitting double-array: 51% |##################### | emitting double-array: 52% |###################### | emitting double-array: 53% |###################### | emitting double-array: 54% |################# 2024-11-07 00:18:15 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 ###### | emitting double-array: 55% |####################### | emitting double-array: 56% |######################## | emitting double-array: 57% |######################## | emitting double-array: 58% |######################## | emitting double-array: 59% |######################### | emitting double-array: 60% |######################### | emitting double-array: 61% |########################## | emitting double-array: 62% |########################## | emitting double-array: 63% |########################### | emitting double-array: 64% |########################### | emitting double-array: 65% |########################### | emitting double-array: 66% |############################ | emitting double-array: 67% |############################ | emitting double-array: 68% |############################# | emitting double-array: 69% |############################# | emitting double-array: 70% |############################## | emitting double-array: 71% |############################## | emitting double-array: 72% |############################## | emitting double-array: 73% |############################### | emitting double-array: 74% |############################### | emitting double-array: 75% |################################ | emitting double-array: 76% |################################ | emitting double-array: 77% |################################# | emitting double-array: 78% |################################# | emitting double-array: 79% |################################# | emitting double-array: 80% |################################## | emitting double-array: 81% |################################## | emitting double-array: 82% |################################### | emitting double-array: 83% |################################### | emitting double-array: 84% |#################################### | emitting double-array: 85% |#################################### | emitting double-array: 86% |#################################### | emitting double-array: 87% |##################################### | emitting double-array: 88% |##################################### | emitting double-array: 89% |###################################### | emitting double-array: 90% |###################################### | emitting double-array: 91% |####################################### | emitting double-array: 92% |####################################### | emitting double-array: 93% |####################################### | emitting double-array: 94% |######################################## | emitting double-array: 95% |######################################## | emitting double-array: 96% |######################################### | emitting double-array: 97% |######################################### | emitting double-array: 98% |########################################## | emitting double-array: 99% |########################################## | emitting double-array: 100% |###########################################| 2024-11-07 00:18:16 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 reading /usr/share/mecab/dic/ipadic/matrix.def ... 1316x1316 2024-11-07 00:18:16 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 emitting matrix : 0% | | emitting matrix : 1% | | emitting matrix : 2% | | emitting matrix : 3% |# | emitting matrix : 4% |# | emitting matrix : 5% |## | emitting matrix : 6% |## | emitting matrix : 7% |### | emitting matrix : 8% |### | emitting matrix : 9% |### | emitting matrix : 10% |#### | emitting matrix : 11% |#### | emitting matrix : 12% |##### | emitting matrix : 13% |##### | emitting matrix : 14% |###### | emitting matrix : 15% |###### | emitting matrix : 16% |###### | emitting matrix : 17% |####### | emitting matrix : 18% |####### | emitting matrix : 19% |######## | emitting matrix : 20% |######## | emitting matrix : 21% |######### | emitting matrix : 22% |######### | emitting matrix : 23% |######### | emitting matrix : 24% |########## | emitting matrix : 25% |########## | emitting matrix : 26% |########### | emitting matrix : 27% |########### | emitting matrix : 28% |############ | emitting matrix : 29% |############ | emitting matrix : 30% |############ | emitting matrix : 31% |############# | emitting matrix : 32% |############# | emitting matrix : 33% |############## | emitting matrix : 34% |############## | emitting matrix : 35% |############### | emitting matrix : 36% |############### | emitting matrix : 37% |############### | emitting matrix : 38% |################ | emitting matrix : 39% |################ | emitting matrix : 40% |################# | emitting matrix : 41% |################# | emitting matrix : 42% |################## | emitting matrix : 43% |################## | emitting matrix : 44% |################## | emitting matrix : 45% |################### | emitting matrix : 46% |################### | emitting matrix : 47% |#################### | emitting matrix : 48% |#################### | emitting matrix : 49% |##################### | emitting matrix : 50% |##################### | emitting matrix : 51% |##################### | emitting matrix : 52% |###################### | emitting matrix : 53% |###################### | emitting matrix : 54% |################# 2024-11-07 00:18:16 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 ###### | emitting matrix : 55% |####################### | emitting matrix : 56% |######################## | emitting matrix : 57% |######################## | emitting matrix : 58% |######################## | emitting matrix : 59% |######################### | emitting matrix : 60% |######################### | emitting matrix : 61% |########################## | emitting matrix : 62% |########################## | emitting matrix : 63% |########################### | emitting matrix : 64% |########################### | emitting matrix : 65% |########################### | emitting matrix : 66% |############################ | emitting matrix : 67% |############################ | emitting matrix : 68% |############################# | emitting matrix : 69% |############################# | emitting matrix : 70% |############################## | emitting matrix : 71% |############################## | emitting matrix : 72% |############################## | emitting matrix : 73% |############################### | emitting matrix : 74% |############################### | emitting matrix : 75% |################################ | emitting matrix : 76% |################################ | emitting matrix : 77% |################################# | emitting matrix : 78% |################################# | emitting matrix : 79% |################################# | emitting matrix : 80% |################################## | emitting matrix : 81% |################################## | emitting matrix : 82% |################################### | emitting matrix : 83% |################################### | emitting matrix : 84% |#################################### | emitting matrix : 85% |#################################### | emitting matrix : 86% |#################################### | emitting matrix : 87% |##################################### | emitting matrix : 88% |##################################### | emitting matrix : 89% |###################################### | emitting matrix : 90% |###################################### | emitting matrix : 91% |####################################### | emitting matrix : 92% |####################################### | emitting matrix : 93% |####################################### | emitting matrix : 94% |######################################## | emitting matrix : 95% |######################################## | emitting matrix : 96% |######################################### | emitting matrix : 97% |######################################### | emitting matrix : 98% |########################################## | emitting matrix : 99% |########################################## | emitting matrix : 100% |###########################################| 2024-11-07 00:18:16 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 2024-11-07 00:18:16 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 done! 2024-11-07 00:18:16 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 update-alternatives: using /var/lib/mecab/dic/ipadic-utf8 to provide /var/lib/mecab/dic/debian (mecab-dictionary) in auto mode 2024-11-07 00:18:16 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up libhtml-parser-perl:amd64 (3.76-1build2) ... 2024-11-07 00:18:16 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up mysql-router (8.0.36-0ubuntu0.22.04.1) ... 2024-11-07 00:18:16 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up libhttp-message-perl (6.36-1) ... 2024-11-07 00:18:16 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up mysql-server-8.0 (8.0.36-0ubuntu0.22.04.1) ... 2024-11-07 00:18:17 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 update-alternatives: using /etc/mysql/mysql.cnf to provide /etc/mysql/my.cnf (my.cnf) in auto mode 2024-11-07 00:18:17 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Renaming removed key_buffer and myisam-recover options (if present) 2024-11-07 00:18:47 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 mysqld will log errors to /var/log/mysql/error.log 2024-11-07 00:18:48 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 mysqld is running as pid 7660 2024-11-07 00:18:51 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Created symlink /etc/systemd/system/multi-user.target.wants/mysql.service → /lib/systemd/system/mysql.service. 2024-11-07 00:18:53 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up libpython2.7:amd64 (2.7.18-13ubuntu1.2) ... 2024-11-07 00:18:53 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up libcgi-pm-perl (4.54-1) ... 2024-11-07 00:18:53 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up libhtml-template-perl (2.97-1.1) ... 2024-11-07 00:18:53 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Setting up libcgi-fast-perl (1:2.15-1) ... 2024-11-07 00:18:53 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Processing triggers for man-db (2.10.2-1) ... 2024-11-07 00:18:53 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 Processing triggers for libc-bin (2.35-0ubuntu3.7) ... 2024-11-07 00:18:54 DEBUG unit.mysql-innodb-cluster/1.install logger.go:60 NEEDRESTART-VER: 3.5 2024-11-07 00:18:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag mysql-innodb-cluster-installed 2024-11-07 00:18:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Configuring TLS with certificates interface=None 2024-11-07 00:18:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Writing file /etc/mysql/mysql.conf.d/mysqld.cnf root:mysql 640 2024-11-07 00:19:00 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: set flag charm.installed tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:70:create_local_cluster_user tracer: -- dequeue handler reactive/mysql_innodb_cluster_handlers.py:40:leader_install 2024-11-07 00:19:00 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 00:19:00 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:70:create_local_cluster_user 2024-11-07 00:19:00 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Creating local cluster user. 2024-11-07 00:19:00 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for mysql-innodb-cluster/1: ok=true 2024-11-07 00:19:00 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 This instance is not yet clustered: cannot determine the cluster status. 2024-11-07 00:19:00 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 Cannot determine the cluster primary RW node for writes. 2024-11-07 00:19:00 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Opening db connection for root@None 2024-11-07 00:19:00 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Revoke all privileges for use 'clusteruser'@'252.49.102.64' 2024-11-07 00:19:00 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Grant ALL PRIVILEGES for use 'clusteruser'@'252.49.102.64' 2024-11-07 00:19:00 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Revoke all privileges for use 'clusteruser'@'localhost' 2024-11-07 00:19:00 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Grant ALL PRIVILEGES for use 'clusteruser'@'localhost' 2024-11-07 00:19:00 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: set flag local.cluster.user-created tracer: -- dequeue handler reactive/mysql_innodb_cluster_handlers.py:70:create_local_cluster_user 2024-11-07 00:19:00 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Running _assess_status() 2024-11-07 00:19:01 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:19:01 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Publishing state 2024-11-07 00:19:01 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator No peer relation. Saving local state 2024-11-07 00:19:02 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for mysql-innodb-cluster/1: ok=true 2024-11-07 00:19:02 INFO juju.worker.uniter.operation runhook.go:159 ran "install" hook (via explicit, bespoke hook script) 2024-11-07 00:19:02 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run install hook" for mysql-innodb-cluster/1 2024-11-07 00:19:02 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-07 00:19:02 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/1 uniter (run install hook) 2024-11-07 00:19:02 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/1 2024-11-07 00:19:02 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "mysql-innodb-cluster/1" (leader=true) entered scope for relation "heat-mysql-router:db-router mysql-innodb-cluster:db-router" 2024-11-07 00:19:02 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "mysql-innodb-cluster/1" (leader=true) entered scope for relation "mysql-innodb-cluster:cluster" 2024-11-07 00:19:03 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "mysql-innodb-cluster/1" (leader=true) entered scope for relation "neutron-mysql-router:db-router mysql-innodb-cluster:db-router" 2024-11-07 00:19:03 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "mysql-innodb-cluster/1" (leader=true) entered scope for relation "nova-mysql-router:db-router mysql-innodb-cluster:db-router" 2024-11-07 00:19:03 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "mysql-innodb-cluster/1" (leader=true) entered scope for relation "glance-mysql-router:db-router mysql-innodb-cluster:db-router" 2024-11-07 00:19:03 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "mysql-innodb-cluster/1" (leader=true) entered scope for relation "dashboard-mysql-router:db-router mysql-innodb-cluster:db-router" 2024-11-07 00:19:04 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "mysql-innodb-cluster/1" (leader=true) entered scope for relation "placement-mysql-router:db-router mysql-innodb-cluster:db-router" 2024-11-07 00:19:05 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "mysql-innodb-cluster/1" (leader=true) entered scope for relation "keystone-mysql-router:db-router mysql-innodb-cluster:db-router" 2024-11-07 00:19:05 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "mysql-innodb-cluster/1" (leader=true) entered scope for relation "mysql-innodb-cluster:coordinator" 2024-11-07 00:19:05 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-created (41; app: neutron-mysql-router) hook for mysql-innodb-cluster/1 2024-11-07 00:19:05 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/1 uniter (run relation-created (41; app: neutron-mysql-router) hook) 2024-11-07 00:19:05 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/1 uniter (run relation-created (41; app: neutron-mysql-router) hook) 2024-11-07 00:19:05 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-created (41; app: neutron-mysql-router) hook" for mysql-innodb-cluster/1 2024-11-07 00:19:05 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-created (41; app: neutron-mysql-router) hook" for mysql-innodb-cluster/1 2024-11-07 00:19:05 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running db-router-relation-created hook 2024-11-07 00:19:05 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-1/agent.socket } 2024-11-07 00:19:06 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Reactive main running for hook db-router-relation-created 2024-11-07 00:19:07 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 00:19:07 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.ssl_cert 2024-11-07 00:19:07 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.ssl_key 2024-11-07 00:19:07 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.ssl_ca 2024-11-07 00:19:07 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.set.source 2024-11-07 00:19:07 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.source 2024-11-07 00:19:07 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.set.cluster-name 2024-11-07 00:19:07 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.cluster-name 2024-11-07 00:19:07 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.set.auto-rejoin-tries 2024-11-07 00:19:07 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.auto-rejoin-tries 2024-11-07 00:19:07 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.set.expel-timeout 2024-11-07 00:19:07 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.expel-timeout 2024-11-07 00:19:07 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.set.innodb-buffer-pool-size 2024-11-07 00:19:07 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.set.innodb-change-buffering 2024-11-07 00:19:07 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.innodb-change-buffering 2024-11-07 00:19:07 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.set.innodb-io-capacity 2024-11-07 00:19:07 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.innodb-io-capacity 2024-11-07 00:19:07 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.set.innodb-file-per-table 2024-11-07 00:19:07 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.innodb-file-per-table 2024-11-07 00:19:07 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.set.tuning-level 2024-11-07 00:19:07 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.tuning-level 2024-11-07 00:19:07 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.set.table-open-cache 2024-11-07 00:19:07 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.table-open-cache 2024-11-07 00:19:07 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.set.max-connections 2024-11-07 00:19:07 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.enable-binlogs 2024-11-07 00:19:07 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.set.binlogs-path 2024-11-07 00:19:07 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.binlogs-path 2024-11-07 00:19:07 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.set.binlogs-max-size 2024-11-07 00:19:07 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.binlogs-max-size 2024-11-07 00:19:07 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.set.binlogs-expire-days 2024-11-07 00:19:08 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.binlogs-expire-days 2024-11-07 00:19:08 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.prefer-ipv6 2024-11-07 00:19:08 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.set.wait-timeout 2024-11-07 00:19:08 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.wait-timeout 2024-11-07 00:19:08 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.os-db-router-hostname 2024-11-07 00:19:08 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Initializing Snap Layer 2024-11-07 00:19:08 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: coordinator.DelayedActionCoordinator Loading state 2024-11-07 00:19:08 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: coordinator.DelayedActionCoordinator New peer relation. Merging local state 2024-11-07 00:19:08 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:19:08 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Coordinator: Initializing coordinator layer 2024-11-07 00:19:08 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Initializing Leadership Layer (is leader) 2024-11-07 00:19:08 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag leadership.changed.cluster-password 2024-11-07 00:19:08 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag leadership.set.cluster-password 2024-11-07 00:19:08 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag leadership.changed.coordinator 2024-11-07 00:19:08 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag leadership.set.coordinator 2024-11-07 00:19:08 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag leadership.changed.coordinator-released-locks-counts 2024-11-07 00:19:08 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag leadership.set.coordinator-released-locks-counts 2024-11-07 00:19:08 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag leadership.changed.mysql.passwd 2024-11-07 00:19:08 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag leadership.set.mysql.passwd 2024-11-07 00:19:09 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag leadership.changed 2024-11-07 00:19:09 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer> tracer: starting handler dispatch, 52 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag leadership.changed tracer: set flag leadership.changed.cluster-password tracer: set flag leadership.changed.coordinator tracer: set flag leadership.changed.coordinator-released-locks-counts tracer: set flag leadership.changed.mysql.passwd tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-11-07 00:19:09 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: hooks phase, 0 handlers queued 2024-11-07 00:19:09 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer> tracer: main dispatch loop, 1 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 00:19:09 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 00:19:09 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:19:09 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: coordinator.DelayedActionCoordinator Publishing state 2024-11-07 00:19:09 INFO juju.worker.uniter.operation runhook.go:159 ran "db-router-relation-created" hook (via explicit, bespoke hook script) 2024-11-07 00:19:09 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-created (41; app: neutron-mysql-router) hook" for mysql-innodb-cluster/1 2024-11-07 00:19:09 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-07 00:19:09 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/1 uniter (run relation-created (41; app: neutron-mysql-router) hook) 2024-11-07 00:19:09 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/1 2024-11-07 00:19:09 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-created (37; app: glance-mysql-router) hook for mysql-innodb-cluster/1 2024-11-07 00:19:09 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/1 uniter (run relation-created (37; app: glance-mysql-router) hook) 2024-11-07 00:19:09 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/1 uniter (run relation-created (37; app: glance-mysql-router) hook) 2024-11-07 00:19:09 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-created (37; app: glance-mysql-router) hook" for mysql-innodb-cluster/1 2024-11-07 00:19:09 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-created (37; app: glance-mysql-router) hook" for mysql-innodb-cluster/1 2024-11-07 00:19:09 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-1/agent.socket } 2024-11-07 00:19:10 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Reactive main running for hook db-router-relation-created 2024-11-07 00:19:11 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 00:19:11 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.ssl_cert 2024-11-07 00:19:11 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.ssl_key 2024-11-07 00:19:11 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.ssl_ca 2024-11-07 00:19:11 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.set.source 2024-11-07 00:19:11 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.source 2024-11-07 00:19:11 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.set.cluster-name 2024-11-07 00:19:11 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.cluster-name 2024-11-07 00:19:11 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.set.auto-rejoin-tries 2024-11-07 00:19:11 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.auto-rejoin-tries 2024-11-07 00:19:11 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.set.expel-timeout 2024-11-07 00:19:11 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.expel-timeout 2024-11-07 00:19:11 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.set.innodb-buffer-pool-size 2024-11-07 00:19:11 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.set.innodb-change-buffering 2024-11-07 00:19:11 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.innodb-change-buffering 2024-11-07 00:19:11 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.set.innodb-io-capacity 2024-11-07 00:19:11 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.innodb-io-capacity 2024-11-07 00:19:11 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.set.innodb-file-per-table 2024-11-07 00:19:11 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.innodb-file-per-table 2024-11-07 00:19:11 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.set.tuning-level 2024-11-07 00:19:11 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.tuning-level 2024-11-07 00:19:11 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.set.table-open-cache 2024-11-07 00:19:11 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.table-open-cache 2024-11-07 00:19:11 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.set.max-connections 2024-11-07 00:19:12 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.enable-binlogs 2024-11-07 00:19:12 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.set.binlogs-path 2024-11-07 00:19:12 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.binlogs-path 2024-11-07 00:19:12 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.set.binlogs-max-size 2024-11-07 00:19:12 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.binlogs-max-size 2024-11-07 00:19:12 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.set.binlogs-expire-days 2024-11-07 00:19:12 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.binlogs-expire-days 2024-11-07 00:19:12 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.prefer-ipv6 2024-11-07 00:19:12 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.set.wait-timeout 2024-11-07 00:19:12 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.wait-timeout 2024-11-07 00:19:12 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.os-db-router-hostname 2024-11-07 00:19:12 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Initializing Snap Layer 2024-11-07 00:19:12 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: coordinator.DelayedActionCoordinator Loading state 2024-11-07 00:19:12 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:19:12 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Coordinator: Initializing coordinator layer 2024-11-07 00:19:12 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Initializing Leadership Layer (is leader) 2024-11-07 00:19:12 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: cleared flag leadership.changed.cluster-password 2024-11-07 00:19:12 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: cleared flag leadership.changed.coordinator 2024-11-07 00:19:12 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: cleared flag leadership.changed.coordinator-released-locks-counts 2024-11-07 00:19:12 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: cleared flag leadership.changed.mysql.passwd 2024-11-07 00:19:12 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: cleared flag leadership.changed 2024-11-07 00:19:12 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer> tracer: starting handler dispatch, 47 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-11-07 00:19:12 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: hooks phase, 0 handlers queued 2024-11-07 00:19:12 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer> tracer: main dispatch loop, 1 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 00:19:12 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 00:19:13 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:19:13 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: coordinator.DelayedActionCoordinator Publishing state 2024-11-07 00:19:13 INFO juju.worker.uniter.operation runhook.go:159 ran "db-router-relation-created" hook (via explicit, bespoke hook script) 2024-11-07 00:19:13 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-created (37; app: glance-mysql-router) hook" for mysql-innodb-cluster/1 2024-11-07 00:19:13 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-07 00:19:13 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/1 uniter (run relation-created (37; app: glance-mysql-router) hook) 2024-11-07 00:19:13 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/1 2024-11-07 00:19:13 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-created (39; app: nova-mysql-router) hook for mysql-innodb-cluster/1 2024-11-07 00:19:13 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/1 uniter (run relation-created (39; app: nova-mysql-router) hook) 2024-11-07 00:19:13 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/1 uniter (run relation-created (39; app: nova-mysql-router) hook) 2024-11-07 00:19:13 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-created (39; app: nova-mysql-router) hook" for mysql-innodb-cluster/1 2024-11-07 00:19:13 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-created (39; app: nova-mysql-router) hook" for mysql-innodb-cluster/1 2024-11-07 00:19:13 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-1/agent.socket } 2024-11-07 00:19:14 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Reactive main running for hook db-router-relation-created 2024-11-07 00:19:14 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 00:19:14 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.ssl_cert 2024-11-07 00:19:14 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.ssl_key 2024-11-07 00:19:14 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.ssl_ca 2024-11-07 00:19:14 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.set.source 2024-11-07 00:19:14 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.source 2024-11-07 00:19:14 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.set.cluster-name 2024-11-07 00:19:14 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.cluster-name 2024-11-07 00:19:15 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.set.auto-rejoin-tries 2024-11-07 00:19:15 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.auto-rejoin-tries 2024-11-07 00:19:15 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.set.expel-timeout 2024-11-07 00:19:15 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.expel-timeout 2024-11-07 00:19:15 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.set.innodb-buffer-pool-size 2024-11-07 00:19:15 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.set.innodb-change-buffering 2024-11-07 00:19:15 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.innodb-change-buffering 2024-11-07 00:19:15 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.set.innodb-io-capacity 2024-11-07 00:19:15 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.innodb-io-capacity 2024-11-07 00:19:15 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.set.innodb-file-per-table 2024-11-07 00:19:15 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.innodb-file-per-table 2024-11-07 00:19:15 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.set.tuning-level 2024-11-07 00:19:15 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.tuning-level 2024-11-07 00:19:15 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.set.table-open-cache 2024-11-07 00:19:15 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.table-open-cache 2024-11-07 00:19:15 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.set.max-connections 2024-11-07 00:19:15 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.enable-binlogs 2024-11-07 00:19:15 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.set.binlogs-path 2024-11-07 00:19:15 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.binlogs-path 2024-11-07 00:19:15 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.set.binlogs-max-size 2024-11-07 00:19:15 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.binlogs-max-size 2024-11-07 00:19:15 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.set.binlogs-expire-days 2024-11-07 00:19:15 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.binlogs-expire-days 2024-11-07 00:19:15 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.prefer-ipv6 2024-11-07 00:19:15 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.set.wait-timeout 2024-11-07 00:19:15 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.wait-timeout 2024-11-07 00:19:15 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.os-db-router-hostname 2024-11-07 00:19:15 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Initializing Snap Layer 2024-11-07 00:19:15 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: coordinator.DelayedActionCoordinator Loading state 2024-11-07 00:19:16 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:19:16 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Coordinator: Initializing coordinator layer 2024-11-07 00:19:16 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Initializing Leadership Layer (is leader) 2024-11-07 00:19:16 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer> tracer: starting handler dispatch, 47 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-11-07 00:19:16 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: hooks phase, 0 handlers queued 2024-11-07 00:19:16 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer> tracer: main dispatch loop, 1 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 00:19:16 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 00:19:16 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:19:16 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: coordinator.DelayedActionCoordinator Publishing state 2024-11-07 00:19:17 INFO juju.worker.uniter.operation runhook.go:159 ran "db-router-relation-created" hook (via explicit, bespoke hook script) 2024-11-07 00:19:17 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-created (39; app: nova-mysql-router) hook" for mysql-innodb-cluster/1 2024-11-07 00:19:17 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-07 00:19:17 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/1 uniter (run relation-created (39; app: nova-mysql-router) hook) 2024-11-07 00:19:17 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/1 2024-11-07 00:19:17 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-created (4; app: mysql-innodb-cluster) hook for mysql-innodb-cluster/1 2024-11-07 00:19:17 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/1 uniter (run relation-created (4; app: mysql-innodb-cluster) hook) 2024-11-07 00:19:17 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/1 uniter (run relation-created (4; app: mysql-innodb-cluster) hook) 2024-11-07 00:19:17 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-created (4; app: mysql-innodb-cluster) hook" for mysql-innodb-cluster/1 2024-11-07 00:19:17 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-created (4; app: mysql-innodb-cluster) hook" for mysql-innodb-cluster/1 2024-11-07 00:19:17 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running coordinator-relation-created hook 2024-11-07 00:19:17 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-1/agent.socket } 2024-11-07 00:19:18 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: Reactive main running for hook coordinator-relation-created 2024-11-07 00:19:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 00:19:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.default.ssl_cert 2024-11-07 00:19:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.default.ssl_key 2024-11-07 00:19:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.default.ssl_ca 2024-11-07 00:19:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.set.source 2024-11-07 00:19:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.default.source 2024-11-07 00:19:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.set.cluster-name 2024-11-07 00:19:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.default.cluster-name 2024-11-07 00:19:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.set.auto-rejoin-tries 2024-11-07 00:19:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.default.auto-rejoin-tries 2024-11-07 00:19:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.set.expel-timeout 2024-11-07 00:19:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.default.expel-timeout 2024-11-07 00:19:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.set.innodb-buffer-pool-size 2024-11-07 00:19:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.set.innodb-change-buffering 2024-11-07 00:19:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.default.innodb-change-buffering 2024-11-07 00:19:19 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.set.innodb-io-capacity 2024-11-07 00:19:19 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.default.innodb-io-capacity 2024-11-07 00:19:19 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.set.innodb-file-per-table 2024-11-07 00:19:19 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.default.innodb-file-per-table 2024-11-07 00:19:19 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.set.tuning-level 2024-11-07 00:19:19 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.default.tuning-level 2024-11-07 00:19:19 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.set.table-open-cache 2024-11-07 00:19:19 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.default.table-open-cache 2024-11-07 00:19:19 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.set.max-connections 2024-11-07 00:19:19 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.default.enable-binlogs 2024-11-07 00:19:19 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.set.binlogs-path 2024-11-07 00:19:19 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.default.binlogs-path 2024-11-07 00:19:19 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.set.binlogs-max-size 2024-11-07 00:19:19 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.default.binlogs-max-size 2024-11-07 00:19:19 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.set.binlogs-expire-days 2024-11-07 00:19:19 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.default.binlogs-expire-days 2024-11-07 00:19:19 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.default.prefer-ipv6 2024-11-07 00:19:19 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.set.wait-timeout 2024-11-07 00:19:19 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.default.wait-timeout 2024-11-07 00:19:19 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.default.os-db-router-hostname 2024-11-07 00:19:19 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: Initializing Snap Layer 2024-11-07 00:19:19 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: coordinator.DelayedActionCoordinator Loading state 2024-11-07 00:19:19 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:19:19 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: Coordinator: Initializing coordinator layer 2024-11-07 00:19:19 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: Initializing Leadership Layer (is leader) 2024-11-07 00:19:20 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer> tracer: starting handler dispatch, 47 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-11-07 00:19:20 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: hooks phase, 0 handlers queued 2024-11-07 00:19:20 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer> tracer: main dispatch loop, 1 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 00:19:20 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 00:19:20 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:19:20 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: coordinator.DelayedActionCoordinator Publishing state 2024-11-07 00:19:20 INFO juju.worker.uniter.operation runhook.go:159 ran "coordinator-relation-created" hook (via explicit, bespoke hook script) 2024-11-07 00:19:20 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-created (4; app: mysql-innodb-cluster) hook" for mysql-innodb-cluster/1 2024-11-07 00:19:20 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-07 00:19:20 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/1 uniter (run relation-created (4; app: mysql-innodb-cluster) hook) 2024-11-07 00:19:20 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/1 2024-11-07 00:19:20 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-created (43; app: dashboard-mysql-router) hook for mysql-innodb-cluster/1 2024-11-07 00:19:20 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/1 uniter (run relation-created (43; app: dashboard-mysql-router) hook) 2024-11-07 00:19:20 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/1 uniter (run relation-created (43; app: dashboard-mysql-router) hook) 2024-11-07 00:19:20 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-created (43; app: dashboard-mysql-router) hook" for mysql-innodb-cluster/1 2024-11-07 00:19:20 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-created (43; app: dashboard-mysql-router) hook" for mysql-innodb-cluster/1 2024-11-07 00:19:20 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running db-router-relation-created hook 2024-11-07 00:19:20 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-1/agent.socket } 2024-11-07 00:19:21 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Reactive main running for hook db-router-relation-created 2024-11-07 00:19:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 00:19:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.ssl_cert 2024-11-07 00:19:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.ssl_key 2024-11-07 00:19:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.ssl_ca 2024-11-07 00:19:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.set.source 2024-11-07 00:19:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.source 2024-11-07 00:19:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.set.cluster-name 2024-11-07 00:19:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.cluster-name 2024-11-07 00:19:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.set.auto-rejoin-tries 2024-11-07 00:19:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.auto-rejoin-tries 2024-11-07 00:19:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.set.expel-timeout 2024-11-07 00:19:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.expel-timeout 2024-11-07 00:19:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.set.innodb-buffer-pool-size 2024-11-07 00:19:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.set.innodb-change-buffering 2024-11-07 00:19:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.innodb-change-buffering 2024-11-07 00:19:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.set.innodb-io-capacity 2024-11-07 00:19:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.innodb-io-capacity 2024-11-07 00:19:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.set.innodb-file-per-table 2024-11-07 00:19:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.innodb-file-per-table 2024-11-07 00:19:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.set.tuning-level 2024-11-07 00:19:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.tuning-level 2024-11-07 00:19:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.set.table-open-cache 2024-11-07 00:19:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.table-open-cache 2024-11-07 00:19:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.set.max-connections 2024-11-07 00:19:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.enable-binlogs 2024-11-07 00:19:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.set.binlogs-path 2024-11-07 00:19:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.binlogs-path 2024-11-07 00:19:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.set.binlogs-max-size 2024-11-07 00:19:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.binlogs-max-size 2024-11-07 00:19:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.set.binlogs-expire-days 2024-11-07 00:19:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.binlogs-expire-days 2024-11-07 00:19:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.prefer-ipv6 2024-11-07 00:19:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.set.wait-timeout 2024-11-07 00:19:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.wait-timeout 2024-11-07 00:19:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.os-db-router-hostname 2024-11-07 00:19:22 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Initializing Snap Layer 2024-11-07 00:19:22 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: coordinator.DelayedActionCoordinator Loading state 2024-11-07 00:19:23 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:19:23 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Coordinator: Initializing coordinator layer 2024-11-07 00:19:23 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Initializing Leadership Layer (is leader) 2024-11-07 00:19:23 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer> tracer: starting handler dispatch, 47 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-11-07 00:19:23 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: hooks phase, 0 handlers queued 2024-11-07 00:19:23 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer> tracer: main dispatch loop, 1 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 00:19:23 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 00:19:23 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:19:23 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: coordinator.DelayedActionCoordinator Publishing state 2024-11-07 00:19:23 INFO juju.worker.uniter.operation runhook.go:159 ran "db-router-relation-created" hook (via explicit, bespoke hook script) 2024-11-07 00:19:23 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-created (43; app: dashboard-mysql-router) hook" for mysql-innodb-cluster/1 2024-11-07 00:19:23 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-07 00:19:23 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/1 uniter (run relation-created (43; app: dashboard-mysql-router) hook) 2024-11-07 00:19:23 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/1 2024-11-07 00:19:23 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-created (47; app: placement-mysql-router) hook for mysql-innodb-cluster/1 2024-11-07 00:19:23 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/1 uniter (run relation-created (47; app: placement-mysql-router) hook) 2024-11-07 00:19:23 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/1 uniter (run relation-created (47; app: placement-mysql-router) hook) 2024-11-07 00:19:23 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-created (47; app: placement-mysql-router) hook" for mysql-innodb-cluster/1 2024-11-07 00:19:23 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-created (47; app: placement-mysql-router) hook" for mysql-innodb-cluster/1 2024-11-07 00:19:23 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-1/agent.socket } 2024-11-07 00:19:24 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Reactive main running for hook db-router-relation-created 2024-11-07 00:19:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 00:19:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.ssl_cert 2024-11-07 00:19:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.ssl_key 2024-11-07 00:19:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.ssl_ca 2024-11-07 00:19:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.set.source 2024-11-07 00:19:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.source 2024-11-07 00:19:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.set.cluster-name 2024-11-07 00:19:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.cluster-name 2024-11-07 00:19:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.set.auto-rejoin-tries 2024-11-07 00:19:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.auto-rejoin-tries 2024-11-07 00:19:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.set.expel-timeout 2024-11-07 00:19:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.expel-timeout 2024-11-07 00:19:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.set.innodb-buffer-pool-size 2024-11-07 00:19:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.set.innodb-change-buffering 2024-11-07 00:19:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.innodb-change-buffering 2024-11-07 00:19:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.set.innodb-io-capacity 2024-11-07 00:19:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.innodb-io-capacity 2024-11-07 00:19:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.set.innodb-file-per-table 2024-11-07 00:19:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.innodb-file-per-table 2024-11-07 00:19:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.set.tuning-level 2024-11-07 00:19:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.tuning-level 2024-11-07 00:19:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.set.table-open-cache 2024-11-07 00:19:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.table-open-cache 2024-11-07 00:19:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.set.max-connections 2024-11-07 00:19:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.enable-binlogs 2024-11-07 00:19:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.set.binlogs-path 2024-11-07 00:19:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.binlogs-path 2024-11-07 00:19:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.set.binlogs-max-size 2024-11-07 00:19:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.binlogs-max-size 2024-11-07 00:19:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.set.binlogs-expire-days 2024-11-07 00:19:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.binlogs-expire-days 2024-11-07 00:19:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.prefer-ipv6 2024-11-07 00:19:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.set.wait-timeout 2024-11-07 00:19:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.wait-timeout 2024-11-07 00:19:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.os-db-router-hostname 2024-11-07 00:19:26 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Initializing Snap Layer 2024-11-07 00:19:26 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: coordinator.DelayedActionCoordinator Loading state 2024-11-07 00:19:26 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:19:26 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Coordinator: Initializing coordinator layer 2024-11-07 00:19:26 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Initializing Leadership Layer (is leader) 2024-11-07 00:19:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer> tracer: starting handler dispatch, 47 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-11-07 00:19:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: hooks phase, 0 handlers queued 2024-11-07 00:19:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer> tracer: main dispatch loop, 1 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 00:19:26 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 00:19:26 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:19:26 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: coordinator.DelayedActionCoordinator Publishing state 2024-11-07 00:19:27 INFO juju.worker.uniter.operation runhook.go:159 ran "db-router-relation-created" hook (via explicit, bespoke hook script) 2024-11-07 00:19:27 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-created (47; app: placement-mysql-router) hook" for mysql-innodb-cluster/1 2024-11-07 00:19:27 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-07 00:19:27 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/1 uniter (run relation-created (47; app: placement-mysql-router) hook) 2024-11-07 00:19:27 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/1 2024-11-07 00:19:27 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-created (45; app: heat-mysql-router) hook for mysql-innodb-cluster/1 2024-11-07 00:19:27 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/1 uniter (run relation-created (45; app: heat-mysql-router) hook) 2024-11-07 00:19:27 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/1 uniter (run relation-created (45; app: heat-mysql-router) hook) 2024-11-07 00:19:27 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-created (45; app: heat-mysql-router) hook" for mysql-innodb-cluster/1 2024-11-07 00:19:27 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-created (45; app: heat-mysql-router) hook" for mysql-innodb-cluster/1 2024-11-07 00:19:27 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-1/agent.socket } 2024-11-07 00:19:27 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: Reactive main running for hook db-router-relation-created 2024-11-07 00:19:28 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 00:19:28 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.ssl_cert 2024-11-07 00:19:28 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.ssl_key 2024-11-07 00:19:28 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.ssl_ca 2024-11-07 00:19:28 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.set.source 2024-11-07 00:19:28 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.source 2024-11-07 00:19:28 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.set.cluster-name 2024-11-07 00:19:28 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.cluster-name 2024-11-07 00:19:28 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.set.auto-rejoin-tries 2024-11-07 00:19:28 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.auto-rejoin-tries 2024-11-07 00:19:28 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.set.expel-timeout 2024-11-07 00:19:28 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.expel-timeout 2024-11-07 00:19:28 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.set.innodb-buffer-pool-size 2024-11-07 00:19:28 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.set.innodb-change-buffering 2024-11-07 00:19:28 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.innodb-change-buffering 2024-11-07 00:19:28 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.set.innodb-io-capacity 2024-11-07 00:19:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.innodb-io-capacity 2024-11-07 00:19:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.set.innodb-file-per-table 2024-11-07 00:19:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.innodb-file-per-table 2024-11-07 00:19:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.set.tuning-level 2024-11-07 00:19:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.tuning-level 2024-11-07 00:19:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.set.table-open-cache 2024-11-07 00:19:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.table-open-cache 2024-11-07 00:19:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.set.max-connections 2024-11-07 00:19:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.enable-binlogs 2024-11-07 00:19:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.set.binlogs-path 2024-11-07 00:19:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.binlogs-path 2024-11-07 00:19:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.set.binlogs-max-size 2024-11-07 00:19:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.binlogs-max-size 2024-11-07 00:19:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.set.binlogs-expire-days 2024-11-07 00:19:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.binlogs-expire-days 2024-11-07 00:19:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.prefer-ipv6 2024-11-07 00:19:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.set.wait-timeout 2024-11-07 00:19:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.wait-timeout 2024-11-07 00:19:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.os-db-router-hostname 2024-11-07 00:19:29 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: Initializing Snap Layer 2024-11-07 00:19:29 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: coordinator.DelayedActionCoordinator Loading state 2024-11-07 00:19:30 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:19:30 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: Coordinator: Initializing coordinator layer 2024-11-07 00:19:30 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: Initializing Leadership Layer (is leader) 2024-11-07 00:19:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer> tracer: starting handler dispatch, 47 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-11-07 00:19:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: hooks phase, 0 handlers queued 2024-11-07 00:19:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer> tracer: main dispatch loop, 1 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 00:19:30 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 00:19:30 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:19:30 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: coordinator.DelayedActionCoordinator Publishing state 2024-11-07 00:19:30 INFO juju.worker.uniter.operation runhook.go:159 ran "db-router-relation-created" hook (via explicit, bespoke hook script) 2024-11-07 00:19:31 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-created (45; app: heat-mysql-router) hook" for mysql-innodb-cluster/1 2024-11-07 00:19:31 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-07 00:19:31 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/1 uniter (run relation-created (45; app: heat-mysql-router) hook) 2024-11-07 00:19:31 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/1 2024-11-07 00:19:31 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-created (35; app: keystone-mysql-router) hook for mysql-innodb-cluster/1 2024-11-07 00:19:31 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/1 uniter (run relation-created (35; app: keystone-mysql-router) hook) 2024-11-07 00:19:31 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/1 uniter (run relation-created (35; app: keystone-mysql-router) hook) 2024-11-07 00:19:31 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-created (35; app: keystone-mysql-router) hook" for mysql-innodb-cluster/1 2024-11-07 00:19:31 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-created (35; app: keystone-mysql-router) hook" for mysql-innodb-cluster/1 2024-11-07 00:19:31 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-1/agent.socket } 2024-11-07 00:19:32 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: Reactive main running for hook db-router-relation-created 2024-11-07 00:19:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 00:19:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.ssl_cert 2024-11-07 00:19:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.ssl_key 2024-11-07 00:19:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.ssl_ca 2024-11-07 00:19:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.set.source 2024-11-07 00:19:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.source 2024-11-07 00:19:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.set.cluster-name 2024-11-07 00:19:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.cluster-name 2024-11-07 00:19:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.set.auto-rejoin-tries 2024-11-07 00:19:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.auto-rejoin-tries 2024-11-07 00:19:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.set.expel-timeout 2024-11-07 00:19:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.expel-timeout 2024-11-07 00:19:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.set.innodb-buffer-pool-size 2024-11-07 00:19:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.set.innodb-change-buffering 2024-11-07 00:19:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.innodb-change-buffering 2024-11-07 00:19:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.set.innodb-io-capacity 2024-11-07 00:19:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.innodb-io-capacity 2024-11-07 00:19:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.set.innodb-file-per-table 2024-11-07 00:19:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.innodb-file-per-table 2024-11-07 00:19:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.set.tuning-level 2024-11-07 00:19:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.tuning-level 2024-11-07 00:19:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.set.table-open-cache 2024-11-07 00:19:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.table-open-cache 2024-11-07 00:19:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.set.max-connections 2024-11-07 00:19:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.enable-binlogs 2024-11-07 00:19:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.set.binlogs-path 2024-11-07 00:19:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.binlogs-path 2024-11-07 00:19:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.set.binlogs-max-size 2024-11-07 00:19:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.binlogs-max-size 2024-11-07 00:19:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.set.binlogs-expire-days 2024-11-07 00:19:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.binlogs-expire-days 2024-11-07 00:19:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.prefer-ipv6 2024-11-07 00:19:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.set.wait-timeout 2024-11-07 00:19:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.wait-timeout 2024-11-07 00:19:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.os-db-router-hostname 2024-11-07 00:19:33 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: Initializing Snap Layer 2024-11-07 00:19:34 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: coordinator.DelayedActionCoordinator Loading state 2024-11-07 00:19:34 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:19:34 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: Coordinator: Initializing coordinator layer 2024-11-07 00:19:34 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: Initializing Leadership Layer (is leader) 2024-11-07 00:19:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer> tracer: starting handler dispatch, 47 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-11-07 00:19:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: hooks phase, 0 handlers queued 2024-11-07 00:19:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer> tracer: main dispatch loop, 1 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 00:19:34 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 00:19:34 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:19:34 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: coordinator.DelayedActionCoordinator Publishing state 2024-11-07 00:19:34 INFO juju.worker.uniter.operation runhook.go:159 ran "db-router-relation-created" hook (via explicit, bespoke hook script) 2024-11-07 00:19:34 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-created (35; app: keystone-mysql-router) hook" for mysql-innodb-cluster/1 2024-11-07 00:19:35 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-07 00:19:35 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/1 uniter (run relation-created (35; app: keystone-mysql-router) hook) 2024-11-07 00:19:35 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/1 2024-11-07 00:19:35 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-created (3; app: mysql-innodb-cluster) hook for mysql-innodb-cluster/1 2024-11-07 00:19:35 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/1 uniter (run relation-created (3; app: mysql-innodb-cluster) hook) 2024-11-07 00:19:35 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/1 uniter (run relation-created (3; app: mysql-innodb-cluster) hook) 2024-11-07 00:19:35 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-created (3; app: mysql-innodb-cluster) hook" for mysql-innodb-cluster/1 2024-11-07 00:19:35 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-created (3; app: mysql-innodb-cluster) hook" for mysql-innodb-cluster/1 2024-11-07 00:19:35 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running cluster-relation-created hook 2024-11-07 00:19:35 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-1/agent.socket } 2024-11-07 00:19:35 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Reactive main running for hook cluster-relation-created 2024-11-07 00:19:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 00:19:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.ssl_cert 2024-11-07 00:19:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.ssl_key 2024-11-07 00:19:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.ssl_ca 2024-11-07 00:19:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.source 2024-11-07 00:19:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.source 2024-11-07 00:19:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.cluster-name 2024-11-07 00:19:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.cluster-name 2024-11-07 00:19:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.auto-rejoin-tries 2024-11-07 00:19:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.auto-rejoin-tries 2024-11-07 00:19:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.expel-timeout 2024-11-07 00:19:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.expel-timeout 2024-11-07 00:19:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.innodb-buffer-pool-size 2024-11-07 00:19:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.innodb-change-buffering 2024-11-07 00:19:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.innodb-change-buffering 2024-11-07 00:19:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.innodb-io-capacity 2024-11-07 00:19:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.innodb-io-capacity 2024-11-07 00:19:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.innodb-file-per-table 2024-11-07 00:19:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.innodb-file-per-table 2024-11-07 00:19:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.tuning-level 2024-11-07 00:19:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.tuning-level 2024-11-07 00:19:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.table-open-cache 2024-11-07 00:19:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.table-open-cache 2024-11-07 00:19:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.max-connections 2024-11-07 00:19:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.enable-binlogs 2024-11-07 00:19:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.binlogs-path 2024-11-07 00:19:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.binlogs-path 2024-11-07 00:19:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.binlogs-max-size 2024-11-07 00:19:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.binlogs-max-size 2024-11-07 00:19:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.binlogs-expire-days 2024-11-07 00:19:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.binlogs-expire-days 2024-11-07 00:19:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.prefer-ipv6 2024-11-07 00:19:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.wait-timeout 2024-11-07 00:19:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.wait-timeout 2024-11-07 00:19:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.os-db-router-hostname 2024-11-07 00:19:37 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Initializing Snap Layer 2024-11-07 00:19:37 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: coordinator.DelayedActionCoordinator Loading state 2024-11-07 00:19:37 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:19:37 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Coordinator: Initializing coordinator layer 2024-11-07 00:19:37 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Initializing Leadership Layer (is leader) 2024-11-07 00:19:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer> tracer: starting handler dispatch, 47 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-11-07 00:19:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: hooks phase, 0 handlers queued 2024-11-07 00:19:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer> tracer: main dispatch loop, 1 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 00:19:38 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 00:19:38 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:19:38 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: coordinator.DelayedActionCoordinator Publishing state 2024-11-07 00:19:38 INFO juju.worker.uniter.operation runhook.go:159 ran "cluster-relation-created" hook (via explicit, bespoke hook script) 2024-11-07 00:19:38 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-created (3; app: mysql-innodb-cluster) hook" for mysql-innodb-cluster/1 2024-11-07 00:19:38 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-07 00:19:38 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/1 uniter (run relation-created (3; app: mysql-innodb-cluster) hook) 2024-11-07 00:19:38 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/1 2024-11-07 00:19:38 DEBUG juju.worker.uniter.operation executor.go:85 running operation accept leadership for mysql-innodb-cluster/1 2024-11-07 00:19:38 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "accept leadership" for mysql-innodb-cluster/1 2024-11-07 00:19:38 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "accept leadership" for mysql-innodb-cluster/1 2024-11-07 00:19:38 INFO juju.worker.uniter resolver.go:159 found queued "leader-elected" hook 2024-11-07 00:19:38 DEBUG juju.worker.uniter.operation executor.go:85 running operation run leader-elected hook for mysql-innodb-cluster/1 2024-11-07 00:19:38 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/1 uniter (run leader-elected hook) 2024-11-07 00:19:38 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/1 uniter (run leader-elected hook) 2024-11-07 00:19:38 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run leader-elected hook" for mysql-innodb-cluster/1 2024-11-07 00:19:38 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run leader-elected hook" for mysql-innodb-cluster/1 2024-11-07 00:19:38 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running leader-elected hook 2024-11-07 00:19:38 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-1/agent.socket } 2024-11-07 00:19:39 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Reactive main running for hook leader-elected 2024-11-07 00:19:39 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Initializing Snap Layer 2024-11-07 00:19:39 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Loading state 2024-11-07 00:19:39 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:19:39 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Coordinator: Initializing coordinator layer 2024-11-07 00:19:39 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Initializing Leadership Layer (is leader) 2024-11-07 00:19:39 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: starting handler dispatch, 12 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-11-07 00:19:40 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-11-07 00:19:40 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: main dispatch loop, 1 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 00:19:40 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 00:19:40 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:19:40 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Publishing state 2024-11-07 00:19:40 INFO juju.worker.uniter.operation runhook.go:159 ran "leader-elected" hook (via explicit, bespoke hook script) 2024-11-07 00:19:40 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run leader-elected hook" for mysql-innodb-cluster/1 2024-11-07 00:19:40 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-07 00:19:40 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/1 uniter (run leader-elected hook) 2024-11-07 00:19:40 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/1 2024-11-07 00:19:40 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:19:40 DEBUG juju.worker.uniter.operation executor.go:85 running operation run config-changed hook for mysql-innodb-cluster/1 2024-11-07 00:19:40 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/1 uniter (run config-changed hook) 2024-11-07 00:19:40 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/1 uniter (run config-changed hook) 2024-11-07 00:19:40 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run config-changed hook" for mysql-innodb-cluster/1 2024-11-07 00:19:40 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run config-changed hook" for mysql-innodb-cluster/1 2024-11-07 00:19:40 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running config-changed hook 2024-11-07 00:19:40 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-1/agent.socket } 2024-11-07 00:19:41 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Reactive main running for hook config-changed 2024-11-07 00:19:41 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 00:19:41 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_cert 2024-11-07 00:19:41 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_key 2024-11-07 00:19:42 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_ca 2024-11-07 00:19:42 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.source 2024-11-07 00:19:42 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.source 2024-11-07 00:19:42 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.cluster-name 2024-11-07 00:19:42 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.cluster-name 2024-11-07 00:19:42 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.auto-rejoin-tries 2024-11-07 00:19:42 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.auto-rejoin-tries 2024-11-07 00:19:42 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.expel-timeout 2024-11-07 00:19:42 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.expel-timeout 2024-11-07 00:19:42 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-buffer-pool-size 2024-11-07 00:19:42 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-change-buffering 2024-11-07 00:19:42 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-change-buffering 2024-11-07 00:19:42 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-io-capacity 2024-11-07 00:19:42 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-io-capacity 2024-11-07 00:19:42 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-file-per-table 2024-11-07 00:19:42 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-file-per-table 2024-11-07 00:19:42 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.tuning-level 2024-11-07 00:19:42 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.tuning-level 2024-11-07 00:19:42 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.table-open-cache 2024-11-07 00:19:42 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.table-open-cache 2024-11-07 00:19:42 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.max-connections 2024-11-07 00:19:42 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.enable-binlogs 2024-11-07 00:19:42 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-path 2024-11-07 00:19:42 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-path 2024-11-07 00:19:42 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-max-size 2024-11-07 00:19:42 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-max-size 2024-11-07 00:19:42 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-expire-days 2024-11-07 00:19:42 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-expire-days 2024-11-07 00:19:42 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.prefer-ipv6 2024-11-07 00:19:43 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.wait-timeout 2024-11-07 00:19:43 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.wait-timeout 2024-11-07 00:19:43 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.os-db-router-hostname 2024-11-07 00:19:43 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Initializing Snap Layer 2024-11-07 00:19:43 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Loading state 2024-11-07 00:19:43 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:19:43 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Coordinator: Initializing coordinator layer 2024-11-07 00:19:43 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Initializing Leadership Layer (is leader) 2024-11-07 00:19:43 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: starting handler dispatch, 47 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-11-07 00:19:43 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-11-07 00:19:43 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: main dispatch loop, 1 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 00:19:43 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 00:19:43 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:19:43 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Publishing state 2024-11-07 00:19:44 INFO juju.worker.uniter.operation runhook.go:159 ran "config-changed" hook (via explicit, bespoke hook script) 2024-11-07 00:19:44 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run config-changed hook" for mysql-innodb-cluster/1 2024-11-07 00:19:44 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-07 00:19:44 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/1 uniter (run config-changed hook) 2024-11-07 00:19:44 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/1 2024-11-07 00:19:44 INFO juju.worker.uniter resolver.go:159 found queued "start" hook 2024-11-07 00:19:44 DEBUG juju.worker.uniter.operation executor.go:85 running operation run start hook for mysql-innodb-cluster/1 2024-11-07 00:19:44 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/1 uniter (run start hook) 2024-11-07 00:19:44 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/1 uniter (run start hook) 2024-11-07 00:19:44 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run start hook" for mysql-innodb-cluster/1 2024-11-07 00:19:44 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run start hook" for mysql-innodb-cluster/1 2024-11-07 00:19:44 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running start hook 2024-11-07 00:19:44 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-1/agent.socket } 2024-11-07 00:19:44 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Reactive main running for hook start 2024-11-07 00:19:45 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 00:19:45 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_cert 2024-11-07 00:19:45 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_key 2024-11-07 00:19:45 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_ca 2024-11-07 00:19:45 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.source 2024-11-07 00:19:45 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.source 2024-11-07 00:19:45 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.cluster-name 2024-11-07 00:19:45 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.cluster-name 2024-11-07 00:19:45 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.auto-rejoin-tries 2024-11-07 00:19:45 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.auto-rejoin-tries 2024-11-07 00:19:45 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.expel-timeout 2024-11-07 00:19:45 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.expel-timeout 2024-11-07 00:19:45 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-buffer-pool-size 2024-11-07 00:19:45 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-change-buffering 2024-11-07 00:19:45 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-change-buffering 2024-11-07 00:19:45 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-io-capacity 2024-11-07 00:19:46 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-io-capacity 2024-11-07 00:19:46 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-file-per-table 2024-11-07 00:19:46 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-file-per-table 2024-11-07 00:19:46 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.tuning-level 2024-11-07 00:19:46 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.tuning-level 2024-11-07 00:19:46 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.table-open-cache 2024-11-07 00:19:46 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.table-open-cache 2024-11-07 00:19:46 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.max-connections 2024-11-07 00:19:46 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.enable-binlogs 2024-11-07 00:19:46 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-path 2024-11-07 00:19:46 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-path 2024-11-07 00:19:46 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-max-size 2024-11-07 00:19:46 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-max-size 2024-11-07 00:19:46 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-expire-days 2024-11-07 00:19:46 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-expire-days 2024-11-07 00:19:46 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.prefer-ipv6 2024-11-07 00:19:46 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.wait-timeout 2024-11-07 00:19:46 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.wait-timeout 2024-11-07 00:19:46 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.os-db-router-hostname 2024-11-07 00:19:46 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Initializing Snap Layer 2024-11-07 00:19:46 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for mysql-innodb-cluster/1 : {3 {map[mysql-innodb-cluster/0:{1}] map[] []}} 2024-11-07 00:19:46 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Loading state 2024-11-07 00:19:46 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:19:46 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Coordinator: Initializing coordinator layer 2024-11-07 00:19:47 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Initializing Leadership Layer (is leader) 2024-11-07 00:19:47 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: starting handler dispatch, 47 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-11-07 00:19:47 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2024-11-07 00:19:47 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: main dispatch loop, 1 handlers queued tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 00:19:47 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 00:19:47 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:19:47 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Publishing state 2024-11-07 00:19:47 INFO juju.worker.uniter.operation runhook.go:159 ran "start" hook (via explicit, bespoke hook script) 2024-11-07 00:19:47 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run start hook" for mysql-innodb-cluster/1 2024-11-07 00:19:47 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-07 00:19:47 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/1 uniter (run start hook) 2024-11-07 00:19:47 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/1 2024-11-07 00:19:47 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:19:47 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-joined (3; unit: mysql-innodb-cluster/0) hook for mysql-innodb-cluster/1 2024-11-07 00:19:47 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/1 uniter (run relation-joined (3; unit: mysql-innodb-cluster/0) hook) 2024-11-07 00:19:47 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/1 uniter (run relation-joined (3; unit: mysql-innodb-cluster/0) hook) 2024-11-07 00:19:47 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-joined (3; unit: mysql-innodb-cluster/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:19:47 DEBUG juju.worker.dependency engine.go:580 "metric-collect" manifold worker started at 2024-11-07 00:19:47.861375014 +0000 UTC 2024-11-07 00:19:47 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-joined (3; unit: mysql-innodb-cluster/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:19:47 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running cluster-relation-joined hook for mysql-innodb-cluster/0 2024-11-07 00:19:48 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-1/agent.socket } 2024-11-07 00:19:48 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Reactive main running for hook cluster-relation-joined 2024-11-07 00:19:48 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer> tracer: set flag endpoint.cluster.joined tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 00:19:48 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer> tracer: set flag endpoint.cluster.changed tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-11-07 00:19:49 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag endpoint.cluster.changed.cluster-address 2024-11-07 00:19:49 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag endpoint.cluster.changed.cluster-password 2024-11-07 00:19:49 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag endpoint.cluster.changed.cluster-user 2024-11-07 00:19:49 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag endpoint.cluster.changed.egress-subnets 2024-11-07 00:19:49 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag endpoint.cluster.changed.ingress-address 2024-11-07 00:19:49 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag endpoint.cluster.changed.private-address 2024-11-07 00:19:49 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.snapd_refresh 2024-11-07 00:19:49 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.ssl_cert 2024-11-07 00:19:49 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.ssl_key 2024-11-07 00:19:49 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.ssl_ca 2024-11-07 00:19:49 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.source 2024-11-07 00:19:49 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.source 2024-11-07 00:19:49 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.cluster-name 2024-11-07 00:19:49 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.cluster-name 2024-11-07 00:19:49 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.auto-rejoin-tries 2024-11-07 00:19:49 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.auto-rejoin-tries 2024-11-07 00:19:49 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.expel-timeout 2024-11-07 00:19:50 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.expel-timeout 2024-11-07 00:19:50 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.innodb-buffer-pool-size 2024-11-07 00:19:50 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.innodb-change-buffering 2024-11-07 00:19:50 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.innodb-change-buffering 2024-11-07 00:19:50 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.innodb-io-capacity 2024-11-07 00:19:50 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.innodb-io-capacity 2024-11-07 00:19:50 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.innodb-file-per-table 2024-11-07 00:19:50 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.innodb-file-per-table 2024-11-07 00:19:50 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.tuning-level 2024-11-07 00:19:50 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.tuning-level 2024-11-07 00:19:50 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.table-open-cache 2024-11-07 00:19:50 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.table-open-cache 2024-11-07 00:19:50 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.max-connections 2024-11-07 00:19:50 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.enable-binlogs 2024-11-07 00:19:50 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.binlogs-path 2024-11-07 00:19:50 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.binlogs-path 2024-11-07 00:19:50 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.binlogs-max-size 2024-11-07 00:19:50 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.binlogs-max-size 2024-11-07 00:19:50 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.binlogs-expire-days 2024-11-07 00:19:50 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.binlogs-expire-days 2024-11-07 00:19:50 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.prefer-ipv6 2024-11-07 00:19:51 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.wait-timeout 2024-11-07 00:19:51 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.wait-timeout 2024-11-07 00:19:51 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.os-db-router-hostname 2024-11-07 00:19:51 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Initializing Snap Layer 2024-11-07 00:19:51 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: coordinator.DelayedActionCoordinator Loading state 2024-11-07 00:19:51 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:19:51 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Coordinator: Initializing coordinator layer 2024-11-07 00:19:51 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Initializing Leadership Layer (is leader) 2024-11-07 00:19:51 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer> tracer: starting handler dispatch, 55 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.cluster-address tracer: set flag endpoint.cluster.changed.cluster-password tracer: set flag endpoint.cluster.changed.cluster-user tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-11-07 00:19:51 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: hooks phase, 0 handlers queued 2024-11-07 00:19:51 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer> tracer: main dispatch loop, 3 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 00:19:51 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-11-07 00:19:51 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer> tracer: set flag cluster.connected tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:88:send_cluster_connection_info 2024-11-07 00:19:51 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-11-07 00:19:51 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 00:19:51 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:88:send_cluster_connection_info 2024-11-07 00:19:51 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Send cluster connection information. 2024-11-07 00:19:51 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Running _assess_status() 2024-11-07 00:19:52 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:19:52 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: coordinator.DelayedActionCoordinator Publishing state 2024-11-07 00:19:53 INFO juju.worker.uniter.operation runhook.go:159 ran "cluster-relation-joined" hook (via explicit, bespoke hook script) 2024-11-07 00:19:53 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-joined (3; unit: mysql-innodb-cluster/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:19:53 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-07 00:19:53 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/1 uniter (run relation-joined (3; unit: mysql-innodb-cluster/0) hook) 2024-11-07 00:19:53 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/1 2024-11-07 00:19:53 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:19:53 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-joined (4; unit: mysql-innodb-cluster/0) hook for mysql-innodb-cluster/1 2024-11-07 00:19:53 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/1 uniter (run relation-joined (4; unit: mysql-innodb-cluster/0) hook) 2024-11-07 00:19:53 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/1 uniter (run relation-joined (4; unit: mysql-innodb-cluster/0) hook) 2024-11-07 00:19:53 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-joined (4; unit: mysql-innodb-cluster/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:19:53 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-joined (4; unit: mysql-innodb-cluster/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:19:53 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running coordinator-relation-joined hook for mysql-innodb-cluster/0 2024-11-07 00:19:53 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-1/agent.socket } 2024-11-07 00:19:54 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: Reactive main running for hook coordinator-relation-joined 2024-11-07 00:19:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer> tracer: set flag endpoint.coordinator.joined tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:88:send_cluster_connection_info 2024-11-07 00:19:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag endpoint.coordinator.changed 2024-11-07 00:19:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag endpoint.coordinator.changed.coordinator 2024-11-07 00:19:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag endpoint.coordinator.changed.egress-subnets 2024-11-07 00:19:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag endpoint.coordinator.changed.ingress-address 2024-11-07 00:19:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag endpoint.coordinator.changed.private-address 2024-11-07 00:19:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.default.snapd_refresh 2024-11-07 00:19:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.default.ssl_cert 2024-11-07 00:19:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.default.ssl_key 2024-11-07 00:19:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.default.ssl_ca 2024-11-07 00:19:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.set.source 2024-11-07 00:19:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.default.source 2024-11-07 00:19:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.set.cluster-name 2024-11-07 00:19:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.default.cluster-name 2024-11-07 00:19:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.set.auto-rejoin-tries 2024-11-07 00:19:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.default.auto-rejoin-tries 2024-11-07 00:19:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.set.expel-timeout 2024-11-07 00:19:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.default.expel-timeout 2024-11-07 00:19:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.set.innodb-buffer-pool-size 2024-11-07 00:19:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.set.innodb-change-buffering 2024-11-07 00:19:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.default.innodb-change-buffering 2024-11-07 00:19:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.set.innodb-io-capacity 2024-11-07 00:19:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.default.innodb-io-capacity 2024-11-07 00:19:56 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.set.innodb-file-per-table 2024-11-07 00:19:56 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.default.innodb-file-per-table 2024-11-07 00:19:56 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.set.tuning-level 2024-11-07 00:19:56 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.default.tuning-level 2024-11-07 00:19:56 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.set.table-open-cache 2024-11-07 00:19:56 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.default.table-open-cache 2024-11-07 00:19:56 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.set.max-connections 2024-11-07 00:19:56 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.default.enable-binlogs 2024-11-07 00:19:56 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.set.binlogs-path 2024-11-07 00:19:56 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.default.binlogs-path 2024-11-07 00:19:56 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.set.binlogs-max-size 2024-11-07 00:19:56 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.default.binlogs-max-size 2024-11-07 00:19:56 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.set.binlogs-expire-days 2024-11-07 00:19:56 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.default.binlogs-expire-days 2024-11-07 00:19:56 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.default.prefer-ipv6 2024-11-07 00:19:56 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.set.wait-timeout 2024-11-07 00:19:56 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.default.wait-timeout 2024-11-07 00:19:56 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.default.os-db-router-hostname 2024-11-07 00:19:56 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: Initializing Snap Layer 2024-11-07 00:19:56 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: coordinator.DelayedActionCoordinator Loading state 2024-11-07 00:19:57 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:19:57 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: Coordinator: Initializing coordinator layer 2024-11-07 00:19:57 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: Initializing Leadership Layer (is leader) 2024-11-07 00:19:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer> tracer: starting handler dispatch, 62 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.cluster-address tracer: set flag endpoint.cluster.changed.cluster-password tracer: set flag endpoint.cluster.changed.cluster-user tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-11-07 00:19:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: hooks phase, 0 handlers queued 2024-11-07 00:19:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer> tracer: main dispatch loop, 4 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:88:send_cluster_connection_info 2024-11-07 00:19:57 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:88:send_cluster_connection_info 2024-11-07 00:19:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: Send cluster connection information. 2024-11-07 00:19:57 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-11-07 00:19:57 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-11-07 00:19:57 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 00:19:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: Running _assess_status() 2024-11-07 00:19:58 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:19:58 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: coordinator.DelayedActionCoordinator Publishing state 2024-11-07 00:19:58 INFO juju.worker.uniter.operation runhook.go:159 ran "coordinator-relation-joined" hook (via explicit, bespoke hook script) 2024-11-07 00:19:58 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-joined (4; unit: mysql-innodb-cluster/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:19:58 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-07 00:19:58 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/1 uniter (run relation-joined (4; unit: mysql-innodb-cluster/0) hook) 2024-11-07 00:19:58 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/1 2024-11-07 00:19:58 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:19:58 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (3; unit: mysql-innodb-cluster/0) hook for mysql-innodb-cluster/1 2024-11-07 00:19:58 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/1 uniter (run relation-changed (3; unit: mysql-innodb-cluster/0) hook) 2024-11-07 00:19:58 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/1 uniter (run relation-changed (3; unit: mysql-innodb-cluster/0) hook) 2024-11-07 00:19:58 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (3; unit: mysql-innodb-cluster/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:19:59 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (3; unit: mysql-innodb-cluster/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:19:59 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running cluster-relation-changed hook for mysql-innodb-cluster/0 2024-11-07 00:19:59 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-1/agent.socket } 2024-11-07 00:19:59 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Reactive main running for hook cluster-relation-changed 2024-11-07 00:20:00 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:88:send_cluster_connection_info 2024-11-07 00:20:00 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.ssl_cert 2024-11-07 00:20:00 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.ssl_key 2024-11-07 00:20:00 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.ssl_ca 2024-11-07 00:20:00 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.source 2024-11-07 00:20:00 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.source 2024-11-07 00:20:00 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.cluster-name 2024-11-07 00:20:00 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.cluster-name 2024-11-07 00:20:00 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.auto-rejoin-tries 2024-11-07 00:20:00 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.auto-rejoin-tries 2024-11-07 00:20:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.expel-timeout 2024-11-07 00:20:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.expel-timeout 2024-11-07 00:20:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.innodb-buffer-pool-size 2024-11-07 00:20:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.innodb-change-buffering 2024-11-07 00:20:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.innodb-change-buffering 2024-11-07 00:20:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.innodb-io-capacity 2024-11-07 00:20:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.innodb-io-capacity 2024-11-07 00:20:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.innodb-file-per-table 2024-11-07 00:20:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.innodb-file-per-table 2024-11-07 00:20:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.tuning-level 2024-11-07 00:20:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.tuning-level 2024-11-07 00:20:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.table-open-cache 2024-11-07 00:20:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.table-open-cache 2024-11-07 00:20:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.max-connections 2024-11-07 00:20:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.enable-binlogs 2024-11-07 00:20:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.binlogs-path 2024-11-07 00:20:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.binlogs-path 2024-11-07 00:20:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.binlogs-max-size 2024-11-07 00:20:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.binlogs-max-size 2024-11-07 00:20:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.binlogs-expire-days 2024-11-07 00:20:02 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.binlogs-expire-days 2024-11-07 00:20:02 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.prefer-ipv6 2024-11-07 00:20:02 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.wait-timeout 2024-11-07 00:20:02 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.wait-timeout 2024-11-07 00:20:02 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.os-db-router-hostname 2024-11-07 00:20:02 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Initializing Snap Layer 2024-11-07 00:20:02 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: coordinator.DelayedActionCoordinator Loading state 2024-11-07 00:20:02 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:20:02 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Coordinator: Initializing coordinator layer 2024-11-07 00:20:02 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Initializing Leadership Layer (is leader) 2024-11-07 00:20:02 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer> tracer: starting handler dispatch, 62 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.cluster-address tracer: set flag endpoint.cluster.changed.cluster-password tracer: set flag endpoint.cluster.changed.cluster-user tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-11-07 00:20:02 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: hooks phase, 0 handlers queued 2024-11-07 00:20:02 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer> tracer: main dispatch loop, 4 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:88:send_cluster_connection_info 2024-11-07 00:20:02 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:88:send_cluster_connection_info 2024-11-07 00:20:02 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Send cluster connection information. 2024-11-07 00:20:02 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-11-07 00:20:02 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-11-07 00:20:02 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 00:20:02 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Running _assess_status() 2024-11-07 00:20:03 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:20:04 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: coordinator.DelayedActionCoordinator Publishing state 2024-11-07 00:20:04 INFO juju.worker.uniter.operation runhook.go:159 ran "cluster-relation-changed" hook (via explicit, bespoke hook script) 2024-11-07 00:20:04 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (3; unit: mysql-innodb-cluster/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:20:04 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-07 00:20:04 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/1 uniter (run relation-changed (3; unit: mysql-innodb-cluster/0) hook) 2024-11-07 00:20:04 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/1 2024-11-07 00:20:04 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:20:04 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (4; unit: mysql-innodb-cluster/0) hook for mysql-innodb-cluster/1 2024-11-07 00:20:04 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/1 uniter (run relation-changed (4; unit: mysql-innodb-cluster/0) hook) 2024-11-07 00:20:04 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/1 uniter (run relation-changed (4; unit: mysql-innodb-cluster/0) hook) 2024-11-07 00:20:04 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (4; unit: mysql-innodb-cluster/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:20:04 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (4; unit: mysql-innodb-cluster/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:20:04 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running coordinator-relation-changed hook for mysql-innodb-cluster/0 2024-11-07 00:20:04 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-1/agent.socket } 2024-11-07 00:20:05 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: Reactive main running for hook coordinator-relation-changed 2024-11-07 00:20:06 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: Initializing Snap Layer 2024-11-07 00:20:06 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: coordinator.DelayedActionCoordinator Loading state 2024-11-07 00:20:06 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:20:06 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: Coordinator: Initializing coordinator layer 2024-11-07 00:20:06 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: Initializing Leadership Layer (is leader) 2024-11-07 00:20:06 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer> tracer: starting handler dispatch, 27 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.cluster-address tracer: set flag endpoint.cluster.changed.cluster-password tracer: set flag endpoint.cluster.changed.cluster-user tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-11-07 00:20:06 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: hooks phase, 0 handlers queued 2024-11-07 00:20:07 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer> tracer: main dispatch loop, 4 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:88:send_cluster_connection_info 2024-11-07 00:20:07 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:88:send_cluster_connection_info 2024-11-07 00:20:07 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: Send cluster connection information. 2024-11-07 00:20:07 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-11-07 00:20:07 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-11-07 00:20:07 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 00:20:07 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: Running _assess_status() 2024-11-07 00:20:08 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:20:08 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: coordinator.DelayedActionCoordinator Publishing state 2024-11-07 00:20:08 INFO juju.worker.uniter.operation runhook.go:159 ran "coordinator-relation-changed" hook (via explicit, bespoke hook script) 2024-11-07 00:20:08 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (4; unit: mysql-innodb-cluster/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:20:08 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-07 00:20:08 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/1 uniter (run relation-changed (4; unit: mysql-innodb-cluster/0) hook) 2024-11-07 00:20:08 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/1 2024-11-07 00:20:08 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:20:08 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 00:20:08 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 00:20:08 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 2024-11-07 00:20:08 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:20:08 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 00:20:08 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 00:20:28 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for mysql-innodb-cluster/1 : {35 {map[keystone-mysql-router/0:{0}] map[] []}} 2024-11-07 00:20:28 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:20:28 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 00:20:28 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 00:20:28 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-joined (35; unit: keystone-mysql-router/0) hook for mysql-innodb-cluster/1 2024-11-07 00:20:28 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/1 uniter (run relation-joined (35; unit: keystone-mysql-router/0) hook) 2024-11-07 00:20:28 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/1 uniter (run relation-joined (35; unit: keystone-mysql-router/0) hook) 2024-11-07 00:20:28 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-joined (35; unit: keystone-mysql-router/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:20:29 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-joined (35; unit: keystone-mysql-router/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:20:29 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running db-router-relation-joined hook for keystone-mysql-router/0 2024-11-07 00:20:29 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-1/agent.socket } 2024-11-07 00:20:29 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: Reactive main running for hook db-router-relation-joined 2024-11-07 00:20:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer> tracer: set flag endpoint.db-router.joined tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:88:send_cluster_connection_info 2024-11-07 00:20:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer> tracer: set flag endpoint.db-router.changed tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router 2024-11-07 00:20:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag endpoint.db-router.changed.egress-subnets 2024-11-07 00:20:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag endpoint.db-router.changed.ingress-address 2024-11-07 00:20:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag endpoint.db-router.changed.private-address 2024-11-07 00:20:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.snapd_refresh 2024-11-07 00:20:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.ssl_cert 2024-11-07 00:20:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.ssl_key 2024-11-07 00:20:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.ssl_ca 2024-11-07 00:20:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.set.source 2024-11-07 00:20:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.source 2024-11-07 00:20:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.set.cluster-name 2024-11-07 00:20:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.cluster-name 2024-11-07 00:20:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.set.auto-rejoin-tries 2024-11-07 00:20:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.auto-rejoin-tries 2024-11-07 00:20:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.set.expel-timeout 2024-11-07 00:20:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.expel-timeout 2024-11-07 00:20:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.set.innodb-buffer-pool-size 2024-11-07 00:20:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.set.innodb-change-buffering 2024-11-07 00:20:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.innodb-change-buffering 2024-11-07 00:20:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.set.innodb-io-capacity 2024-11-07 00:20:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.innodb-io-capacity 2024-11-07 00:20:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.set.innodb-file-per-table 2024-11-07 00:20:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.innodb-file-per-table 2024-11-07 00:20:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.set.tuning-level 2024-11-07 00:20:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.tuning-level 2024-11-07 00:20:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.set.table-open-cache 2024-11-07 00:20:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.table-open-cache 2024-11-07 00:20:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.set.max-connections 2024-11-07 00:20:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.enable-binlogs 2024-11-07 00:20:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.set.binlogs-path 2024-11-07 00:20:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.binlogs-path 2024-11-07 00:20:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.set.binlogs-max-size 2024-11-07 00:20:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.binlogs-max-size 2024-11-07 00:20:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.set.binlogs-expire-days 2024-11-07 00:20:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.binlogs-expire-days 2024-11-07 00:20:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.prefer-ipv6 2024-11-07 00:20:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.set.wait-timeout 2024-11-07 00:20:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.wait-timeout 2024-11-07 00:20:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.os-db-router-hostname 2024-11-07 00:20:32 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: Initializing Snap Layer 2024-11-07 00:20:32 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: coordinator.DelayedActionCoordinator Loading state 2024-11-07 00:20:32 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:20:32 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: Coordinator: Initializing coordinator layer 2024-11-07 00:20:32 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: Initializing Leadership Layer (is leader) 2024-11-07 00:20:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer> tracer: starting handler dispatch, 67 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.cluster-address tracer: set flag endpoint.cluster.changed.cluster-password tracer: set flag endpoint.cluster.changed.cluster-user tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-11-07 00:20:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: hooks phase, 0 handlers queued 2024-11-07 00:20:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer> tracer: main dispatch loop, 6 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:88:send_cluster_connection_info 2024-11-07 00:20:32 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:88:send_cluster_connection_info 2024-11-07 00:20:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: Send cluster connection information. 2024-11-07 00:20:32 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-11-07 00:20:32 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-11-07 00:20:32 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-11-07 00:20:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag db-router.connected 2024-11-07 00:20:33 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router 2024-11-07 00:20:33 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 00:20:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: Running _assess_status() 2024-11-07 00:20:33 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:20:33 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: coordinator.DelayedActionCoordinator Publishing state 2024-11-07 00:20:34 INFO juju.worker.uniter.operation runhook.go:159 ran "db-router-relation-joined" hook (via explicit, bespoke hook script) 2024-11-07 00:20:34 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-joined (35; unit: keystone-mysql-router/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:20:34 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-07 00:20:34 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/1 uniter (run relation-joined (35; unit: keystone-mysql-router/0) hook) 2024-11-07 00:20:34 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/1 2024-11-07 00:20:34 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:20:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 00:20:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 00:20:34 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (35; unit: keystone-mysql-router/0) hook for mysql-innodb-cluster/1 2024-11-07 00:20:34 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/1 uniter (run relation-changed (35; unit: keystone-mysql-router/0) hook) 2024-11-07 00:20:34 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/1 uniter (run relation-changed (35; unit: keystone-mysql-router/0) hook) 2024-11-07 00:20:34 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (35; unit: keystone-mysql-router/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:20:34 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (35; unit: keystone-mysql-router/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:20:34 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running db-router-relation-changed hook for keystone-mysql-router/0 2024-11-07 00:20:34 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-1/agent.socket } 2024-11-07 00:20:35 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: Reactive main running for hook db-router-relation-changed 2024-11-07 00:20:35 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:88:send_cluster_connection_info 2024-11-07 00:20:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.ssl_cert 2024-11-07 00:20:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.ssl_key 2024-11-07 00:20:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.ssl_ca 2024-11-07 00:20:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.set.source 2024-11-07 00:20:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.source 2024-11-07 00:20:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.set.cluster-name 2024-11-07 00:20:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.cluster-name 2024-11-07 00:20:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.set.auto-rejoin-tries 2024-11-07 00:20:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.auto-rejoin-tries 2024-11-07 00:20:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.set.expel-timeout 2024-11-07 00:20:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.expel-timeout 2024-11-07 00:20:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.set.innodb-buffer-pool-size 2024-11-07 00:20:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.set.innodb-change-buffering 2024-11-07 00:20:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.innodb-change-buffering 2024-11-07 00:20:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.set.innodb-io-capacity 2024-11-07 00:20:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.innodb-io-capacity 2024-11-07 00:20:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.set.innodb-file-per-table 2024-11-07 00:20:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.innodb-file-per-table 2024-11-07 00:20:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.set.tuning-level 2024-11-07 00:20:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.tuning-level 2024-11-07 00:20:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.set.table-open-cache 2024-11-07 00:20:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.table-open-cache 2024-11-07 00:20:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.set.max-connections 2024-11-07 00:20:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.enable-binlogs 2024-11-07 00:20:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.set.binlogs-path 2024-11-07 00:20:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.binlogs-path 2024-11-07 00:20:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.set.binlogs-max-size 2024-11-07 00:20:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.binlogs-max-size 2024-11-07 00:20:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.set.binlogs-expire-days 2024-11-07 00:20:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.binlogs-expire-days 2024-11-07 00:20:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.prefer-ipv6 2024-11-07 00:20:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.set.wait-timeout 2024-11-07 00:20:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.wait-timeout 2024-11-07 00:20:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.os-db-router-hostname 2024-11-07 00:20:37 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: Initializing Snap Layer 2024-11-07 00:20:37 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: coordinator.DelayedActionCoordinator Loading state 2024-11-07 00:20:37 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:20:37 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: Coordinator: Initializing coordinator layer 2024-11-07 00:20:37 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: Initializing Leadership Layer (is leader) 2024-11-07 00:20:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer> tracer: starting handler dispatch, 68 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.cluster-address tracer: set flag endpoint.cluster.changed.cluster-password tracer: set flag endpoint.cluster.changed.cluster-user tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-11-07 00:20:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: hooks phase, 0 handlers queued 2024-11-07 00:20:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer> tracer: main dispatch loop, 6 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:88:send_cluster_connection_info 2024-11-07 00:20:38 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:88:send_cluster_connection_info 2024-11-07 00:20:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: Send cluster connection information. 2024-11-07 00:20:38 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-11-07 00:20:38 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-11-07 00:20:38 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-11-07 00:20:38 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router 2024-11-07 00:20:38 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 00:20:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: Running _assess_status() 2024-11-07 00:20:39 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:20:39 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: coordinator.DelayedActionCoordinator Publishing state 2024-11-07 00:20:39 INFO juju.worker.uniter.operation runhook.go:159 ran "db-router-relation-changed" hook (via explicit, bespoke hook script) 2024-11-07 00:20:39 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (35; unit: keystone-mysql-router/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:20:39 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-07 00:20:39 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/1 uniter (run relation-changed (35; unit: keystone-mysql-router/0) hook) 2024-11-07 00:20:39 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/1 2024-11-07 00:20:39 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:20:39 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 00:20:39 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 00:20:39 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 00:20:39 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 2024-11-07 00:20:51 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for mysql-innodb-cluster/1 2024-11-07 00:20:51 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:20:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 00:20:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 00:20:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 00:20:51 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for mysql-innodb-cluster/1 2024-11-07 00:20:51 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 00:20:51 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 00:20:51 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 00:20:52 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 00:20:52 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-1/agent.socket } 2024-11-07 00:20:52 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Reactive main running for hook update-status 2024-11-07 00:20:53 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:88:send_cluster_connection_info 2024-11-07 00:20:53 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_cert 2024-11-07 00:20:53 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_key 2024-11-07 00:20:53 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_ca 2024-11-07 00:20:53 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.source 2024-11-07 00:20:53 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.source 2024-11-07 00:20:53 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.cluster-name 2024-11-07 00:20:53 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.cluster-name 2024-11-07 00:20:53 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.auto-rejoin-tries 2024-11-07 00:20:53 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.auto-rejoin-tries 2024-11-07 00:20:53 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.expel-timeout 2024-11-07 00:20:53 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.expel-timeout 2024-11-07 00:20:53 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-buffer-pool-size 2024-11-07 00:20:53 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-change-buffering 2024-11-07 00:20:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-change-buffering 2024-11-07 00:20:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-io-capacity 2024-11-07 00:20:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-io-capacity 2024-11-07 00:20:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-file-per-table 2024-11-07 00:20:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-file-per-table 2024-11-07 00:20:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.tuning-level 2024-11-07 00:20:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.tuning-level 2024-11-07 00:20:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.table-open-cache 2024-11-07 00:20:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.table-open-cache 2024-11-07 00:20:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.max-connections 2024-11-07 00:20:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.enable-binlogs 2024-11-07 00:20:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-path 2024-11-07 00:20:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-path 2024-11-07 00:20:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-max-size 2024-11-07 00:20:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-max-size 2024-11-07 00:20:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-expire-days 2024-11-07 00:20:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-expire-days 2024-11-07 00:20:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.prefer-ipv6 2024-11-07 00:20:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.wait-timeout 2024-11-07 00:20:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.wait-timeout 2024-11-07 00:20:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.os-db-router-hostname 2024-11-07 00:20:55 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Initializing Snap Layer 2024-11-07 00:20:55 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Loading state 2024-11-07 00:20:55 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:20:55 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Coordinator: Initializing coordinator layer 2024-11-07 00:20:55 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Initializing Leadership Layer (is leader) 2024-11-07 00:20:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: starting handler dispatch, 68 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.cluster-address tracer: set flag endpoint.cluster.changed.cluster-password tracer: set flag endpoint.cluster.changed.cluster-user tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-11-07 00:20:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:64:default_update_status 2024-11-07 00:20:55 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:64:default_update_status 2024-11-07 00:20:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag run-default-update-status 2024-11-07 00:20:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag is-update-status-hook 2024-11-07 00:20:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: main dispatch loop, 8 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:82:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:93:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:88:send_cluster_connection_info 2024-11-07 00:20:55 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:82:check_really_is_update_status 2024-11-07 00:20:55 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:93:run_default_update_status 2024-11-07 00:20:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:93:run_default_update_status 2024-11-07 00:20:55 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:88:send_cluster_connection_info 2024-11-07 00:20:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Send cluster connection information. 2024-11-07 00:20:55 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-11-07 00:20:56 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-11-07 00:20:56 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-11-07 00:20:56 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router 2024-11-07 00:20:56 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 00:20:56 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Running _assess_status() 2024-11-07 00:20:56 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:88:send_cluster_connection_info 2024-11-07 00:20:56 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:20:57 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Publishing state 2024-11-07 00:20:57 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-11-07 00:20:57 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 00:20:57 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-07 00:20:57 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 00:20:57 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/1 2024-11-07 00:20:57 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:20:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 00:20:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 00:20:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 00:21:20 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for mysql-innodb-cluster/1 : {45 {map[heat-mysql-router/0:{0}] map[] []}} 2024-11-07 00:21:20 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:21:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 00:21:20 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-joined (45; unit: heat-mysql-router/0) hook for mysql-innodb-cluster/1 2024-11-07 00:21:20 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/1 uniter (run relation-joined (45; unit: heat-mysql-router/0) hook) 2024-11-07 00:21:20 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/1 uniter (run relation-joined (45; unit: heat-mysql-router/0) hook) 2024-11-07 00:21:20 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-joined (45; unit: heat-mysql-router/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:21:20 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-joined (45; unit: heat-mysql-router/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:21:20 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running db-router-relation-joined hook for heat-mysql-router/0 2024-11-07 00:21:20 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-1/agent.socket } 2024-11-07 00:21:20 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: Reactive main running for hook db-router-relation-joined 2024-11-07 00:21:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:88:send_cluster_connection_info 2024-11-07 00:21:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.ssl_cert 2024-11-07 00:21:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.ssl_key 2024-11-07 00:21:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.ssl_ca 2024-11-07 00:21:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.set.source 2024-11-07 00:21:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.source 2024-11-07 00:21:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.set.cluster-name 2024-11-07 00:21:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.cluster-name 2024-11-07 00:21:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.set.auto-rejoin-tries 2024-11-07 00:21:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.auto-rejoin-tries 2024-11-07 00:21:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.set.expel-timeout 2024-11-07 00:21:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.expel-timeout 2024-11-07 00:21:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.set.innodb-buffer-pool-size 2024-11-07 00:21:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.set.innodb-change-buffering 2024-11-07 00:21:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.innodb-change-buffering 2024-11-07 00:21:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.set.innodb-io-capacity 2024-11-07 00:21:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.innodb-io-capacity 2024-11-07 00:21:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.set.innodb-file-per-table 2024-11-07 00:21:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.innodb-file-per-table 2024-11-07 00:21:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.set.tuning-level 2024-11-07 00:21:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.tuning-level 2024-11-07 00:21:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.set.table-open-cache 2024-11-07 00:21:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.table-open-cache 2024-11-07 00:21:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.set.max-connections 2024-11-07 00:21:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.enable-binlogs 2024-11-07 00:21:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.set.binlogs-path 2024-11-07 00:21:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.binlogs-path 2024-11-07 00:21:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.set.binlogs-max-size 2024-11-07 00:21:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.binlogs-max-size 2024-11-07 00:21:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.set.binlogs-expire-days 2024-11-07 00:21:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.binlogs-expire-days 2024-11-07 00:21:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.prefer-ipv6 2024-11-07 00:21:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.set.wait-timeout 2024-11-07 00:21:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.wait-timeout 2024-11-07 00:21:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.os-db-router-hostname 2024-11-07 00:21:22 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: Initializing Snap Layer 2024-11-07 00:21:23 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: coordinator.DelayedActionCoordinator Loading state 2024-11-07 00:21:23 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:21:23 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: Coordinator: Initializing coordinator layer 2024-11-07 00:21:23 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: Initializing Leadership Layer (is leader) 2024-11-07 00:21:23 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer> tracer: starting handler dispatch, 68 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.cluster-address tracer: set flag endpoint.cluster.changed.cluster-password tracer: set flag endpoint.cluster.changed.cluster-user tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-11-07 00:21:23 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: hooks phase, 0 handlers queued 2024-11-07 00:21:23 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer> tracer: main dispatch loop, 6 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:88:send_cluster_connection_info 2024-11-07 00:21:23 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:88:send_cluster_connection_info 2024-11-07 00:21:23 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: Send cluster connection information. 2024-11-07 00:21:23 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-11-07 00:21:23 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-11-07 00:21:23 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-11-07 00:21:23 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router 2024-11-07 00:21:23 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 00:21:23 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: Running _assess_status() 2024-11-07 00:21:24 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:21:24 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: coordinator.DelayedActionCoordinator Publishing state 2024-11-07 00:21:24 INFO juju.worker.uniter.operation runhook.go:159 ran "db-router-relation-joined" hook (via explicit, bespoke hook script) 2024-11-07 00:21:24 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-joined (45; unit: heat-mysql-router/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:21:25 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-07 00:21:25 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/1 uniter (run relation-joined (45; unit: heat-mysql-router/0) hook) 2024-11-07 00:21:25 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/1 2024-11-07 00:21:25 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:21:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 00:21:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 00:21:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 00:21:25 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (45; unit: heat-mysql-router/0) hook for mysql-innodb-cluster/1 2024-11-07 00:21:25 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/1 uniter (run relation-changed (45; unit: heat-mysql-router/0) hook) 2024-11-07 00:21:25 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/1 uniter (run relation-changed (45; unit: heat-mysql-router/0) hook) 2024-11-07 00:21:25 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (45; unit: heat-mysql-router/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:21:25 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (45; unit: heat-mysql-router/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:21:25 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running db-router-relation-changed hook for heat-mysql-router/0 2024-11-07 00:21:25 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-1/agent.socket } 2024-11-07 00:21:25 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: Reactive main running for hook db-router-relation-changed 2024-11-07 00:21:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:88:send_cluster_connection_info 2024-11-07 00:21:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.ssl_cert 2024-11-07 00:21:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.ssl_key 2024-11-07 00:21:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.ssl_ca 2024-11-07 00:21:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.set.source 2024-11-07 00:21:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.source 2024-11-07 00:21:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.set.cluster-name 2024-11-07 00:21:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.cluster-name 2024-11-07 00:21:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.set.auto-rejoin-tries 2024-11-07 00:21:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.auto-rejoin-tries 2024-11-07 00:21:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.set.expel-timeout 2024-11-07 00:21:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.expel-timeout 2024-11-07 00:21:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.set.innodb-buffer-pool-size 2024-11-07 00:21:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.set.innodb-change-buffering 2024-11-07 00:21:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.innodb-change-buffering 2024-11-07 00:21:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.set.innodb-io-capacity 2024-11-07 00:21:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.innodb-io-capacity 2024-11-07 00:21:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.set.innodb-file-per-table 2024-11-07 00:21:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.innodb-file-per-table 2024-11-07 00:21:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.set.tuning-level 2024-11-07 00:21:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.tuning-level 2024-11-07 00:21:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.set.table-open-cache 2024-11-07 00:21:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.table-open-cache 2024-11-07 00:21:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.set.max-connections 2024-11-07 00:21:27 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.enable-binlogs 2024-11-07 00:21:27 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.set.binlogs-path 2024-11-07 00:21:27 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.binlogs-path 2024-11-07 00:21:27 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.set.binlogs-max-size 2024-11-07 00:21:27 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.binlogs-max-size 2024-11-07 00:21:27 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.set.binlogs-expire-days 2024-11-07 00:21:27 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.binlogs-expire-days 2024-11-07 00:21:27 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.prefer-ipv6 2024-11-07 00:21:27 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.set.wait-timeout 2024-11-07 00:21:27 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.wait-timeout 2024-11-07 00:21:27 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.os-db-router-hostname 2024-11-07 00:21:27 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: Initializing Snap Layer 2024-11-07 00:21:27 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: coordinator.DelayedActionCoordinator Loading state 2024-11-07 00:21:27 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:21:27 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: Coordinator: Initializing coordinator layer 2024-11-07 00:21:27 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: Initializing Leadership Layer (is leader) 2024-11-07 00:21:27 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer> tracer: starting handler dispatch, 68 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.cluster-address tracer: set flag endpoint.cluster.changed.cluster-password tracer: set flag endpoint.cluster.changed.cluster-user tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-11-07 00:21:27 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: hooks phase, 0 handlers queued 2024-11-07 00:21:27 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer> tracer: main dispatch loop, 6 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:88:send_cluster_connection_info 2024-11-07 00:21:27 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:88:send_cluster_connection_info 2024-11-07 00:21:27 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: Send cluster connection information. 2024-11-07 00:21:27 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-11-07 00:21:27 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-11-07 00:21:27 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-11-07 00:21:28 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router 2024-11-07 00:21:28 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 00:21:28 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: Running _assess_status() 2024-11-07 00:21:28 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:21:28 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: coordinator.DelayedActionCoordinator Publishing state 2024-11-07 00:21:29 INFO juju.worker.uniter.operation runhook.go:159 ran "db-router-relation-changed" hook (via explicit, bespoke hook script) 2024-11-07 00:21:29 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (45; unit: heat-mysql-router/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:21:30 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-07 00:21:30 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/1 uniter (run relation-changed (45; unit: heat-mysql-router/0) hook) 2024-11-07 00:21:30 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/1 2024-11-07 00:21:30 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:21:30 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 00:21:30 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 00:21:30 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 00:21:30 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 00:21:30 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 2024-11-07 00:22:13 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for mysql-innodb-cluster/1 : {4 {map[mysql-innodb-cluster/2:{0}] map[] []}} 2024-11-07 00:22:13 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:22:13 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 00:22:13 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-joined (4; unit: mysql-innodb-cluster/2) hook for mysql-innodb-cluster/1 2024-11-07 00:22:13 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/1 uniter (run relation-joined (4; unit: mysql-innodb-cluster/2) hook) 2024-11-07 00:22:13 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/1 uniter (run relation-joined (4; unit: mysql-innodb-cluster/2) hook) 2024-11-07 00:22:13 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-joined (4; unit: mysql-innodb-cluster/2) hook" for mysql-innodb-cluster/1 2024-11-07 00:22:13 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-joined (4; unit: mysql-innodb-cluster/2) hook" for mysql-innodb-cluster/1 2024-11-07 00:22:13 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running coordinator-relation-joined hook for mysql-innodb-cluster/2 2024-11-07 00:22:13 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-1/agent.socket } 2024-11-07 00:22:14 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: Reactive main running for hook coordinator-relation-joined 2024-11-07 00:22:14 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for mysql-innodb-cluster/1 : {3 {map[mysql-innodb-cluster/2:{0}] map[] []}} 2024-11-07 00:22:14 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:88:send_cluster_connection_info 2024-11-07 00:22:14 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.default.ssl_cert 2024-11-07 00:22:14 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.default.ssl_key 2024-11-07 00:22:14 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.default.ssl_ca 2024-11-07 00:22:14 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.set.source 2024-11-07 00:22:15 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.default.source 2024-11-07 00:22:15 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.set.cluster-name 2024-11-07 00:22:15 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.default.cluster-name 2024-11-07 00:22:15 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.set.auto-rejoin-tries 2024-11-07 00:22:15 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.default.auto-rejoin-tries 2024-11-07 00:22:15 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.set.expel-timeout 2024-11-07 00:22:15 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.default.expel-timeout 2024-11-07 00:22:15 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.set.innodb-buffer-pool-size 2024-11-07 00:22:15 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.set.innodb-change-buffering 2024-11-07 00:22:15 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.default.innodb-change-buffering 2024-11-07 00:22:15 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.set.innodb-io-capacity 2024-11-07 00:22:15 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.default.innodb-io-capacity 2024-11-07 00:22:15 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.set.innodb-file-per-table 2024-11-07 00:22:15 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.default.innodb-file-per-table 2024-11-07 00:22:15 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.set.tuning-level 2024-11-07 00:22:15 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.default.tuning-level 2024-11-07 00:22:15 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.set.table-open-cache 2024-11-07 00:22:15 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.default.table-open-cache 2024-11-07 00:22:15 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.set.max-connections 2024-11-07 00:22:15 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.default.enable-binlogs 2024-11-07 00:22:15 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.set.binlogs-path 2024-11-07 00:22:15 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.default.binlogs-path 2024-11-07 00:22:16 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.set.binlogs-max-size 2024-11-07 00:22:16 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.default.binlogs-max-size 2024-11-07 00:22:16 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.set.binlogs-expire-days 2024-11-07 00:22:16 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.default.binlogs-expire-days 2024-11-07 00:22:16 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.default.prefer-ipv6 2024-11-07 00:22:16 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.set.wait-timeout 2024-11-07 00:22:16 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.default.wait-timeout 2024-11-07 00:22:16 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: set flag config.default.os-db-router-hostname 2024-11-07 00:22:16 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: Initializing Snap Layer 2024-11-07 00:22:16 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: coordinator.DelayedActionCoordinator Loading state 2024-11-07 00:22:16 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:22:16 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: Coordinator: Initializing coordinator layer 2024-11-07 00:22:16 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: Initializing Leadership Layer (is leader) 2024-11-07 00:22:16 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer> tracer: starting handler dispatch, 68 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.cluster-address tracer: set flag endpoint.cluster.changed.cluster-password tracer: set flag endpoint.cluster.changed.cluster-user tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-11-07 00:22:16 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: hooks phase, 0 handlers queued 2024-11-07 00:22:16 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer> tracer: main dispatch loop, 6 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:88:send_cluster_connection_info 2024-11-07 00:22:16 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:88:send_cluster_connection_info 2024-11-07 00:22:16 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: Send cluster connection information. 2024-11-07 00:22:16 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-11-07 00:22:16 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-11-07 00:22:16 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-11-07 00:22:17 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router 2024-11-07 00:22:17 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 00:22:17 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: Running _assess_status() 2024-11-07 00:22:18 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:22:18 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: coordinator.DelayedActionCoordinator Publishing state 2024-11-07 00:22:18 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for mysql-innodb-cluster/1 : {4 {map[mysql-innodb-cluster/2:{1}] map[] []}} 2024-11-07 00:22:18 INFO juju.worker.uniter.operation runhook.go:159 ran "coordinator-relation-joined" hook (via explicit, bespoke hook script) 2024-11-07 00:22:19 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-joined (4; unit: mysql-innodb-cluster/2) hook" for mysql-innodb-cluster/1 2024-11-07 00:22:19 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-07 00:22:19 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/1 uniter (run relation-joined (4; unit: mysql-innodb-cluster/2) hook) 2024-11-07 00:22:19 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/1 2024-11-07 00:22:19 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:22:19 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 00:22:19 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 00:22:19 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 00:22:19 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-joined (3; unit: mysql-innodb-cluster/2) hook for mysql-innodb-cluster/1 2024-11-07 00:22:19 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/1 uniter (run relation-joined (3; unit: mysql-innodb-cluster/2) hook) 2024-11-07 00:22:19 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/1 uniter (run relation-joined (3; unit: mysql-innodb-cluster/2) hook) 2024-11-07 00:22:19 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-joined (3; unit: mysql-innodb-cluster/2) hook" for mysql-innodb-cluster/1 2024-11-07 00:22:19 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-joined (3; unit: mysql-innodb-cluster/2) hook" for mysql-innodb-cluster/1 2024-11-07 00:22:19 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running cluster-relation-joined hook for mysql-innodb-cluster/2 2024-11-07 00:22:19 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-1/agent.socket } 2024-11-07 00:22:20 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Reactive main running for hook cluster-relation-joined 2024-11-07 00:22:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:88:send_cluster_connection_info 2024-11-07 00:22:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.ssl_cert 2024-11-07 00:22:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.ssl_key 2024-11-07 00:22:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.ssl_ca 2024-11-07 00:22:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.source 2024-11-07 00:22:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.source 2024-11-07 00:22:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.cluster-name 2024-11-07 00:22:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.cluster-name 2024-11-07 00:22:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.auto-rejoin-tries 2024-11-07 00:22:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.auto-rejoin-tries 2024-11-07 00:22:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.expel-timeout 2024-11-07 00:22:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.expel-timeout 2024-11-07 00:22:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.innodb-buffer-pool-size 2024-11-07 00:22:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.innodb-change-buffering 2024-11-07 00:22:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.innodb-change-buffering 2024-11-07 00:22:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.innodb-io-capacity 2024-11-07 00:22:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.innodb-io-capacity 2024-11-07 00:22:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.innodb-file-per-table 2024-11-07 00:22:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.innodb-file-per-table 2024-11-07 00:22:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.tuning-level 2024-11-07 00:22:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.tuning-level 2024-11-07 00:22:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.table-open-cache 2024-11-07 00:22:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.table-open-cache 2024-11-07 00:22:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.max-connections 2024-11-07 00:22:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.enable-binlogs 2024-11-07 00:22:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.binlogs-path 2024-11-07 00:22:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.binlogs-path 2024-11-07 00:22:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.binlogs-max-size 2024-11-07 00:22:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.binlogs-max-size 2024-11-07 00:22:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.binlogs-expire-days 2024-11-07 00:22:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.binlogs-expire-days 2024-11-07 00:22:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.prefer-ipv6 2024-11-07 00:22:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.wait-timeout 2024-11-07 00:22:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.wait-timeout 2024-11-07 00:22:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.os-db-router-hostname 2024-11-07 00:22:22 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Initializing Snap Layer 2024-11-07 00:22:22 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: coordinator.DelayedActionCoordinator Loading state 2024-11-07 00:22:22 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:22:22 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Coordinator: Initializing coordinator layer 2024-11-07 00:22:22 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Initializing Leadership Layer (is leader) 2024-11-07 00:22:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer> tracer: starting handler dispatch, 68 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.cluster-address tracer: set flag endpoint.cluster.changed.cluster-password tracer: set flag endpoint.cluster.changed.cluster-user tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-11-07 00:22:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: hooks phase, 0 handlers queued 2024-11-07 00:22:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer> tracer: main dispatch loop, 6 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:88:send_cluster_connection_info 2024-11-07 00:22:22 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:88:send_cluster_connection_info 2024-11-07 00:22:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Send cluster connection information. 2024-11-07 00:22:23 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-11-07 00:22:23 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-11-07 00:22:23 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-11-07 00:22:24 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router 2024-11-07 00:22:24 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 00:22:24 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Running _assess_status() 2024-11-07 00:22:25 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:22:25 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: coordinator.DelayedActionCoordinator Publishing state 2024-11-07 00:22:25 INFO juju.worker.uniter.operation runhook.go:159 ran "cluster-relation-joined" hook (via explicit, bespoke hook script) 2024-11-07 00:22:25 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-joined (3; unit: mysql-innodb-cluster/2) hook" for mysql-innodb-cluster/1 2024-11-07 00:22:25 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-07 00:22:25 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/1 uniter (run relation-joined (3; unit: mysql-innodb-cluster/2) hook) 2024-11-07 00:22:25 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/1 2024-11-07 00:22:25 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:22:25 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (4; unit: mysql-innodb-cluster/2) hook for mysql-innodb-cluster/1 2024-11-07 00:22:25 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/1 uniter (run relation-changed (4; unit: mysql-innodb-cluster/2) hook) 2024-11-07 00:22:25 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/1 uniter (run relation-changed (4; unit: mysql-innodb-cluster/2) hook) 2024-11-07 00:22:25 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (4; unit: mysql-innodb-cluster/2) hook" for mysql-innodb-cluster/1 2024-11-07 00:22:27 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (4; unit: mysql-innodb-cluster/2) hook" for mysql-innodb-cluster/1 2024-11-07 00:22:27 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running coordinator-relation-changed hook for mysql-innodb-cluster/2 2024-11-07 00:22:27 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-1/agent.socket } 2024-11-07 00:22:27 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: Reactive main running for hook coordinator-relation-changed 2024-11-07 00:22:28 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: Initializing Snap Layer 2024-11-07 00:22:28 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: coordinator.DelayedActionCoordinator Loading state 2024-11-07 00:22:28 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:22:28 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: Coordinator: Initializing coordinator layer 2024-11-07 00:22:28 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: Initializing Leadership Layer (is leader) 2024-11-07 00:22:28 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer> tracer: starting handler dispatch, 33 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.connected tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.cluster-address tracer: set flag endpoint.cluster.changed.cluster-password tracer: set flag endpoint.cluster.changed.cluster-user tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-11-07 00:22:28 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer: hooks phase, 0 handlers queued 2024-11-07 00:22:28 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: tracer> tracer: main dispatch loop, 6 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:88:send_cluster_connection_info 2024-11-07 00:22:28 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:88:send_cluster_connection_info 2024-11-07 00:22:28 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: Send cluster connection information. 2024-11-07 00:22:28 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-11-07 00:22:29 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-11-07 00:22:29 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-11-07 00:22:29 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router 2024-11-07 00:22:29 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 00:22:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: Running _assess_status() 2024-11-07 00:22:29 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:22:30 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator:4: coordinator.DelayedActionCoordinator Publishing state 2024-11-07 00:22:30 INFO juju.worker.uniter.operation runhook.go:159 ran "coordinator-relation-changed" hook (via explicit, bespoke hook script) 2024-11-07 00:22:30 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (4; unit: mysql-innodb-cluster/2) hook" for mysql-innodb-cluster/1 2024-11-07 00:22:30 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-07 00:22:30 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/1 uniter (run relation-changed (4; unit: mysql-innodb-cluster/2) hook) 2024-11-07 00:22:30 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/1 2024-11-07 00:22:30 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:22:30 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 00:22:30 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 00:22:30 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 00:22:30 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (3; unit: mysql-innodb-cluster/2) hook for mysql-innodb-cluster/1 2024-11-07 00:22:30 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/1 uniter (run relation-changed (3; unit: mysql-innodb-cluster/2) hook) 2024-11-07 00:22:30 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/1 uniter (run relation-changed (3; unit: mysql-innodb-cluster/2) hook) 2024-11-07 00:22:30 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (3; unit: mysql-innodb-cluster/2) hook" for mysql-innodb-cluster/1 2024-11-07 00:22:30 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (3; unit: mysql-innodb-cluster/2) hook" for mysql-innodb-cluster/1 2024-11-07 00:22:30 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running cluster-relation-changed hook for mysql-innodb-cluster/2 2024-11-07 00:22:30 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-1/agent.socket } 2024-11-07 00:22:31 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Reactive main running for hook cluster-relation-changed 2024-11-07 00:22:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:88:send_cluster_connection_info 2024-11-07 00:22:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.ssl_cert 2024-11-07 00:22:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.ssl_key 2024-11-07 00:22:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.ssl_ca 2024-11-07 00:22:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.source 2024-11-07 00:22:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.source 2024-11-07 00:22:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.cluster-name 2024-11-07 00:22:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.cluster-name 2024-11-07 00:22:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.auto-rejoin-tries 2024-11-07 00:22:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.auto-rejoin-tries 2024-11-07 00:22:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.expel-timeout 2024-11-07 00:22:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.expel-timeout 2024-11-07 00:22:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.innodb-buffer-pool-size 2024-11-07 00:22:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.innodb-change-buffering 2024-11-07 00:22:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.innodb-change-buffering 2024-11-07 00:22:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.innodb-io-capacity 2024-11-07 00:22:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.innodb-io-capacity 2024-11-07 00:22:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.innodb-file-per-table 2024-11-07 00:22:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.innodb-file-per-table 2024-11-07 00:22:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.tuning-level 2024-11-07 00:22:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.tuning-level 2024-11-07 00:22:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.table-open-cache 2024-11-07 00:22:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.table-open-cache 2024-11-07 00:22:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.max-connections 2024-11-07 00:22:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.enable-binlogs 2024-11-07 00:22:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.binlogs-path 2024-11-07 00:22:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.binlogs-path 2024-11-07 00:22:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.binlogs-max-size 2024-11-07 00:22:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.binlogs-max-size 2024-11-07 00:22:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.binlogs-expire-days 2024-11-07 00:22:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.binlogs-expire-days 2024-11-07 00:22:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.prefer-ipv6 2024-11-07 00:22:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.wait-timeout 2024-11-07 00:22:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.wait-timeout 2024-11-07 00:22:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.os-db-router-hostname 2024-11-07 00:22:33 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Initializing Snap Layer 2024-11-07 00:22:33 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: coordinator.DelayedActionCoordinator Loading state 2024-11-07 00:22:33 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:22:33 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Coordinator: Initializing coordinator layer 2024-11-07 00:22:33 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Initializing Leadership Layer (is leader) 2024-11-07 00:22:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer> tracer: starting handler dispatch, 68 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.cluster-address tracer: set flag endpoint.cluster.changed.cluster-password tracer: set flag endpoint.cluster.changed.cluster-user tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-11-07 00:22:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: hooks phase, 0 handlers queued 2024-11-07 00:22:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer> tracer: main dispatch loop, 6 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:88:send_cluster_connection_info 2024-11-07 00:22:33 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:88:send_cluster_connection_info 2024-11-07 00:22:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Send cluster connection information. 2024-11-07 00:22:33 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-11-07 00:22:33 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-11-07 00:22:33 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-11-07 00:22:33 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router 2024-11-07 00:22:33 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 00:22:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Running _assess_status() 2024-11-07 00:22:34 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:22:34 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: coordinator.DelayedActionCoordinator Publishing state 2024-11-07 00:22:34 INFO juju.worker.uniter.operation runhook.go:159 ran "cluster-relation-changed" hook (via explicit, bespoke hook script) 2024-11-07 00:22:35 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (3; unit: mysql-innodb-cluster/2) hook" for mysql-innodb-cluster/1 2024-11-07 00:22:35 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-07 00:22:35 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/1 uniter (run relation-changed (3; unit: mysql-innodb-cluster/2) hook) 2024-11-07 00:22:35 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/1 2024-11-07 00:22:35 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:22:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 00:22:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 00:22:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 00:22:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 00:22:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 00:22:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 00:22:35 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 2024-11-07 00:22:35 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:22:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 00:22:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 00:22:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 00:22:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 00:22:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 00:22:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 00:23:02 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for mysql-innodb-cluster/1 : {3 {map[mysql-innodb-cluster/2:{1}] map[] []}} 2024-11-07 00:23:02 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:23:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 00:23:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 00:23:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 00:23:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 00:23:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 00:23:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 00:23:02 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (3; unit: mysql-innodb-cluster/2) hook for mysql-innodb-cluster/1 2024-11-07 00:23:02 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/1 uniter (run relation-changed (3; unit: mysql-innodb-cluster/2) hook) 2024-11-07 00:23:02 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/1 uniter (run relation-changed (3; unit: mysql-innodb-cluster/2) hook) 2024-11-07 00:23:02 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (3; unit: mysql-innodb-cluster/2) hook" for mysql-innodb-cluster/1 2024-11-07 00:23:02 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (3; unit: mysql-innodb-cluster/2) hook" for mysql-innodb-cluster/1 2024-11-07 00:23:02 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running cluster-relation-changed hook for mysql-innodb-cluster/2 2024-11-07 00:23:02 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-1/agent.socket } 2024-11-07 00:23:02 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Reactive main running for hook cluster-relation-changed 2024-11-07 00:23:03 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:88:send_cluster_connection_info 2024-11-07 00:23:03 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.ssl_cert 2024-11-07 00:23:03 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.ssl_key 2024-11-07 00:23:03 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.ssl_ca 2024-11-07 00:23:03 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.source 2024-11-07 00:23:03 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.source 2024-11-07 00:23:03 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.cluster-name 2024-11-07 00:23:03 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.cluster-name 2024-11-07 00:23:03 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.auto-rejoin-tries 2024-11-07 00:23:03 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.auto-rejoin-tries 2024-11-07 00:23:03 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.expel-timeout 2024-11-07 00:23:03 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.expel-timeout 2024-11-07 00:23:03 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.innodb-buffer-pool-size 2024-11-07 00:23:03 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.innodb-change-buffering 2024-11-07 00:23:04 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.innodb-change-buffering 2024-11-07 00:23:04 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.innodb-io-capacity 2024-11-07 00:23:04 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.innodb-io-capacity 2024-11-07 00:23:04 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.innodb-file-per-table 2024-11-07 00:23:04 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.innodb-file-per-table 2024-11-07 00:23:04 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.tuning-level 2024-11-07 00:23:04 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.tuning-level 2024-11-07 00:23:04 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.table-open-cache 2024-11-07 00:23:04 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.table-open-cache 2024-11-07 00:23:04 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.max-connections 2024-11-07 00:23:04 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.enable-binlogs 2024-11-07 00:23:04 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.binlogs-path 2024-11-07 00:23:04 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.binlogs-path 2024-11-07 00:23:04 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.binlogs-max-size 2024-11-07 00:23:04 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.binlogs-max-size 2024-11-07 00:23:04 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.binlogs-expire-days 2024-11-07 00:23:04 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.binlogs-expire-days 2024-11-07 00:23:04 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.prefer-ipv6 2024-11-07 00:23:04 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.wait-timeout 2024-11-07 00:23:04 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.wait-timeout 2024-11-07 00:23:04 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.os-db-router-hostname 2024-11-07 00:23:04 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Initializing Snap Layer 2024-11-07 00:23:05 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: coordinator.DelayedActionCoordinator Loading state 2024-11-07 00:23:05 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:23:05 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Coordinator: Initializing coordinator layer 2024-11-07 00:23:05 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Initializing Leadership Layer (is leader) 2024-11-07 00:23:05 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer> tracer: starting handler dispatch, 68 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.cluster-address tracer: set flag endpoint.cluster.changed.cluster-password tracer: set flag endpoint.cluster.changed.cluster-user tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-11-07 00:23:05 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: hooks phase, 0 handlers queued 2024-11-07 00:23:05 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer> tracer: main dispatch loop, 6 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:88:send_cluster_connection_info 2024-11-07 00:23:05 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:88:send_cluster_connection_info 2024-11-07 00:23:05 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Send cluster connection information. 2024-11-07 00:23:05 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-11-07 00:23:05 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer> tracer: set flag cluster.available tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:110:create_remote_cluster_user tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: -- dequeue handler reactive/mysql_innodb_cluster_handlers.py:88:send_cluster_connection_info 2024-11-07 00:23:05 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-11-07 00:23:05 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-11-07 00:23:05 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router 2024-11-07 00:23:05 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 00:23:05 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:110:create_remote_cluster_user 2024-11-07 00:23:05 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Creating remote users. 2024-11-07 00:23:05 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: This instance is not yet clustered: cannot determine the cluster status. 2024-11-07 00:23:05 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Cannot determine the cluster primary RW node for writes. 2024-11-07 00:23:05 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Opening db connection for root@None 2024-11-07 00:23:05 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Revoke all privileges for use 'clusteruser'@'252.49.107.157' 2024-11-07 00:23:05 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Grant ALL PRIVILEGES for use 'clusteruser'@'252.49.107.157' 2024-11-07 00:23:05 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: This instance is not yet clustered: cannot determine the cluster status. 2024-11-07 00:23:05 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Cannot determine the cluster primary RW node for writes. 2024-11-07 00:23:05 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Opening db connection for root@None 2024-11-07 00:23:06 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Revoke all privileges for use 'clusteruser'@'252.49.94.42' 2024-11-07 00:23:06 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Grant ALL PRIVILEGES for use 'clusteruser'@'252.49.94.42' 2024-11-07 00:23:07 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer> tracer: set flag local.cluster.all-users-created tracer: -- dequeue handler reactive/mysql_innodb_cluster_handlers.py:110:create_remote_cluster_user 2024-11-07 00:23:07 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 00:23:07 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Found peers: 252.49.107.157,252.49.94.42 2024-11-07 00:23:07 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Expect 2 peers 2024-11-07 00:23:07 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Reached quorum 2024-11-07 00:23:07 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag local.cluster.quorum-reached 2024-11-07 00:23:07 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:156:initialize_cluster 2024-11-07 00:23:07 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Initializing InnoDB cluster. 2024-11-07 00:23:07 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Configuring instance for clustering: 252.49.102.64. 2024-11-07 00:23:07 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for mysql-innodb-cluster/1 : {3 {map[mysql-innodb-cluster/0:{2}] map[] []}} 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 MySQL Shell 8.0.23 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 Copyright (c) 2016, 2021, Oracle and/or its affiliates. 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 Oracle is a registered trademark of Oracle Corporation and/or its affiliates. 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 Other names may be trademarks of their respective owners. 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 Usage: mysqlsh [OPTIONS] [URI] 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 mysqlsh [OPTIONS] [URI] -f [...] 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 mysqlsh [OPTIONS] [URI] --dba enableXProtocol 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 mysqlsh [OPTIONS] [URI] --cluster 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 mysqlsh [OPTIONS] [URI] -- [...] 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 mysqlsh [OPTIONS] [URI] --import {|-} [|] 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 -?, --help Display this help and exit. 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 -- Triggers API Command Line integration, which 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 allows execution of methods of the Shell 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 global objects from command line using 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 syntax: 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 -- [arguments] 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 For more details execute '\? cmdline' inside 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 of the Shell. 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 -e, --execute= Execute command and quit. 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 -f, --file= Specify a file to process in batch mode. Any 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 options specified after this are used as 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 arguments of the processed file. 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 --uri= Connect to Uniform Resource Identifier. 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 Format: [user[:pass]@]host[:port][/db] 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 -h, --host= Connect to host. 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 -P, --port=<#> Port number to use for connection. 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 --connect-timeout= Connection timeout in milliseconds. 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 -S, --socket[=] Socket name to use. If no value is provided 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 will use default UNIX socket path. 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 -u, --user= User for the connection to the server. 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 --password=[] Password to use when connecting to server. If 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 password is empty, connection will be made 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 without using a password. 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 -p, --password Request password prompt to set the password 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 -C, --compress[=] Use compression in client/server protocol. 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 Valid values: 'REQUIRED', 'PREFFERED', 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 'DISABLED', 'True', 'False', '1', and '0'. 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 Boolean values map to REQUIRED and DISABLED 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 respectively. By default compression is set 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 to DISABLED in classic protocol and PREFERRED 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 in X protocol connections. 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 --compression-algorithms= Use compression algorithm in server/client 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 protocol. Expects comma separated list of 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 algorithms. Supported algorithms include 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 'zstd', 'zlib', 'lz4' (X protocol only), and 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 'uncompressed', which if appears in a list, 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 causes connection to succeed even if 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 compression negotiation fails. 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 --compression-level= Use this compression level in the 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 --zstd-compression-level= client/server protocol. Supported by X 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 protocol and zstd compression in classic 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 protocol. 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 --import Import JSON documents from file to collection 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 --import
or table in MySQL Server. Set file to - if 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 you want to read the data from stdin. 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 Requires a default schema on the connection 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 options. 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 -D, --schema= Schema to use. 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 --database= Same as --schema. 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 --recreate-schema Drop and recreate the specified schema. 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 Schema will be deleted if it exists! 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 --mx, --mysqlx Uses connection data to create an X protocol 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 session. 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 --mc, --mysql Uses connection data to create a classic 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 session. 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 --redirect-primary Ensure that the target server is part of an 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 InnoDB cluster or ReplicaSet and if it is not 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 a primary, find the primary and connect to it. 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 --redirect-secondary Ensure that the target server is part of an 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 InnoDB cluster or ReplicaSet and if it is not 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 a secondary, find a secondary and connect to 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 it. 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 --cluster Ensure that the target server is part of an 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 InnoDB cluster and if so, set the cluster 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 global variable. 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 --replicaset Ensure that the target server is part of an 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 InnoDB ReplicaSet and if so, set the rs 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 global variable. 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 --sql Start in SQL mode, auto-detecting the 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 protocol to use if it is not specified as 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 part of the connection information. 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 --sqlc Start in SQL mode using a classic session. 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 --sqlx Start in SQL mode using an X protocol session. 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 --js, --javascript Start in JavaScript mode. 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 --py, --python Start in Python mode. 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 --pym Run Python library module as a script. 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 Remaining args are forwarded to it. 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 --json[=] Produce output in JSON format. Allowed 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 values: raw, pretty, and off. If no format is 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 specified pretty format is produced. 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 --table Produce output in table format (default for 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 interactive mode). This option can be used to 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 force that format when running in batch mode. 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 --tabbed Produce output in tab separated format 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 (default for batch mode). This option can be 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 used to force that format when running in 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 interactive mode. 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 -E, --vertical Print the output of a query (rows) vertically. 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 --result-format= Determines format of results. Allowed values: 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 [table, tabbed, vertical, json, ndjson, 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 json/raw, json/array, json/pretty]. 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 --get-server-public-key Request public key from the server required 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 for RSA key pair-based password exchange. Use 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 when connecting to MySQL 8.0 servers with 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 classic sessions with SSL mode DISABLED. 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 --server-public-key-path=

The path name to a file containing a 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 client-side copy of the public key required 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 by the server for RSA key pair-based password 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 exchange. Use when connecting to MySQL 8.0 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 servers with classic sessions with SSL mode 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 DISABLED. 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 -i, --interactive[=full] To use in batch mode. It forces emulation of 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 interactive mode processing. Each line on the 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 batch is processed as if it were in 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 interactive mode. 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 --force In SQL batch mode, forces processing to 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 continue if an error is found. 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 --log-level= Set logging level. The log level value must 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 be an integer between 1 and 8 or any of 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 [none, internal, error, warning, info, debug, 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 debug2, debug3] respectively. 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 --dba-log-sql[={0|1|2}] Log SQL statements executed by AdminAPI 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 operations: 0 - logging disabled; 1 - log 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 statements other than SELECT and SHOW; 2 - 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 log all statements. 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 --verbose[={0|1|2|3|4}] Enable diagnostic message output to the 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 console: 0 - display no messages; 1 - display 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 error, warning and informational messages; 2, 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 3, 4 - include higher levels of debug 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 messages. If level is not given, 1 is assumed. 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 --passwords-from-stdin Read passwords from stdin instead of the 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 console. 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 --show-warnings={true|false} Automatically display SQL warnings on SQL 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 mode if available. 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 --column-type-info Display column type information in SQL mode. 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 Please be aware that output may depend on the 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 protocol you are using to connect to the 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 server, e.g. DbType field is approximated 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 when using X protocol. 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 --histignore= Shell's history ignore list. 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 --pager= Pager used to display text output of 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 statements executed in SQL mode as well as 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 some other selected commands. Pager can be 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 manually enabled in scripting modes. If you 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 don't supply an option, the default pager is 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 taken from your ENV variable PAGER. This 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 option only works in interactive mode. This 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 option is disabled by default. 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 --name-cache Enable database name caching for 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 autocompletion and DevAPI (default). 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 -A, --no-name-cache Disable automatic database name caching for 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 autocompletion and DevAPI. Use \rehash to 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 load DB names manually. 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 --nw, --no-wizard Disables wizard mode. 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 --no-password Sets empty password and disables prompt for 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 password. 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 -V, --version Prints the version of MySQL Shell. 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 --ssl-key= The path to the SSL private key file in PEM 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 format. 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 --ssl-cert= The path to the SSL public key certificate 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 file in PEM format. 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 --ssl-ca= The path to the certificate authority file in 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 PEM format. 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 --ssl-capath= The path to the directory that contains the 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 certificate authority files in PEM format. 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 --ssl-cipher= The list of permissible encryption ciphers 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 for connections that use TLS protocols up 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 through TLSv1.2. 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 --ssl-crl= The path to the file containing certificate 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 revocation lists in PEM format. 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 --ssl-crlpath= The path to the directory that contains 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 certificate revocation-list files in PEM 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 format. 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 --ssl-mode= SSL mode to use. Allowed values: 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 DISABLED,PREFERRED, REQUIRED, VERIFY_CA, 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 VERIFY_IDENTITY. 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 --tls-version= TLS version to use. Allowed values: TLSv1, 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 TLSv1.1, TLSv1.2, TLSv1.3. 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 --tls-ciphersuites= TLS v1.3 cipher to use. 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 --auth-method= Authentication method to use. In case of 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 classic session, this is the name of the 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 authentication plugin to use, i.e. 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 caching_sha2_password. In case of X protocol 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 session, it should be one of: AUTO, 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 FROM_CAPABILITIES, FALLBACK, MYSQL41, PLAIN, 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 SHA256_MEMORY. 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 --dba=enableXProtocol Enable the X protocol in the target server. 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 Requires a connection using classic session. 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 --quiet-start[={1|2}] Avoids printing information when the shell is 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 started. A value of 1 will prevent printing 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 the shell version information. A value of 2 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 will prevent printing any information unless 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 it is an error. If no value is specified uses 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 1 as default. 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 --oci[=] Starts the shell ready to work with OCI. A 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 wizard to configure the given profile will be 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 launched if the profile is not configured. If 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 no profile is specified the value of shell 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 option oci.profile will be used. 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 --credential-store-helper= Specifies the helper which is going to be 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 used to store/retrieve the passwords. 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 --save-passwords= Controls automatic storage of passwords. 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 Allowed values are: always, prompt, never. 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 Usage examples: 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 $ mysqlsh root@localhost/schema 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 $ mysqlsh mysqlx://root@some.server:3307/world_x 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 $ mysqlsh --uri root@localhost --py -f sample.py sample param 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 $ mysqlsh root@targethost:33070 -s world_x -f sample.js 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 $ mysqlsh -- util check-for-server-upgrade root@localhost --output-format=JSON 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 $ mysqlsh mysqlx://user@host/db --import ~/products.json shop 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.cluster-relation-changed logger.go:60 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Opening db connection for clusteruser@252.49.102.64 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Instance Configured 252.49.102.64: +----------------------------------------+---------------+----------------+----------------------------+ | Variable | Current Value | Required Value | Note | +----------------------------------------+---------------+----------------+----------------------------+ | binlog_transaction_dependency_tracking | COMMIT_ORDER | WRITESET | Update the server variable | +----------------------------------------+---------------+----------------+----------------------------+ 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag leadership.changed.cluster-instance-configured-252-49-102-64 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag leadership.changed 2024-11-07 00:23:11 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag leadership.set.cluster-instance-configured-252-49-102-64 2024-11-07 00:23:12 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for mysql-innodb-cluster/1: ok=true 2024-11-07 00:23:12 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Creating cluster: jujuCluster. 2024-11-07 00:23:14 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Cluster Created: A new InnoDB cluster will be created on instance '252.49.102.64:3306'. 2024-11-07 00:23:15 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag leadership.changed.cluster-instance-clustered-252-49-102-64 2024-11-07 00:23:15 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag leadership.set.cluster-instance-clustered-252-49-102-64 2024-11-07 00:23:15 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag leadership.changed.cluster-created 2024-11-07 00:23:15 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer> tracer: set flag leadership.set.cluster-created tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:172:configure_instances_for_clustering tracer: -- dequeue handler reactive/mysql_innodb_cluster_handlers.py:156:initialize_cluster 2024-11-07 00:23:15 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:172:configure_instances_for_clustering 2024-11-07 00:23:15 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Configuring instances for clustering. 2024-11-07 00:23:15 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Running _assess_status() 2024-11-07 00:23:15 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for mysql-innodb-cluster/1: ok=true 2024-11-07 00:23:15 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:23:15 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: coordinator.DelayedActionCoordinator Publishing state 2024-11-07 00:23:16 INFO juju.worker.uniter.operation runhook.go:159 ran "cluster-relation-changed" hook (via explicit, bespoke hook script) 2024-11-07 00:23:16 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (3; unit: mysql-innodb-cluster/2) hook" for mysql-innodb-cluster/1 2024-11-07 00:23:16 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-07 00:23:16 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/1 uniter (run relation-changed (3; unit: mysql-innodb-cluster/2) hook) 2024-11-07 00:23:16 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/1 2024-11-07 00:23:16 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:23:16 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 00:23:16 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 00:23:16 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 00:23:16 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 00:23:16 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 00:23:16 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (3; unit: mysql-innodb-cluster/0) hook for mysql-innodb-cluster/1 2024-11-07 00:23:16 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/1 uniter (run relation-changed (3; unit: mysql-innodb-cluster/0) hook) 2024-11-07 00:23:16 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/1 uniter (run relation-changed (3; unit: mysql-innodb-cluster/0) hook) 2024-11-07 00:23:16 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (3; unit: mysql-innodb-cluster/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:23:16 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (3; unit: mysql-innodb-cluster/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:23:16 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running cluster-relation-changed hook for mysql-innodb-cluster/0 2024-11-07 00:23:16 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-1/agent.socket } 2024-11-07 00:23:17 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Reactive main running for hook cluster-relation-changed 2024-11-07 00:23:17 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer> tracer: set flag endpoint.cluster.changed.unit-configure-ready tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:172:configure_instances_for_clustering 2024-11-07 00:23:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.snapd_refresh 2024-11-07 00:23:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.ssl_cert 2024-11-07 00:23:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.ssl_key 2024-11-07 00:23:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.ssl_ca 2024-11-07 00:23:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.source 2024-11-07 00:23:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.source 2024-11-07 00:23:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.cluster-name 2024-11-07 00:23:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.cluster-name 2024-11-07 00:23:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.auto-rejoin-tries 2024-11-07 00:23:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.auto-rejoin-tries 2024-11-07 00:23:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.expel-timeout 2024-11-07 00:23:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.expel-timeout 2024-11-07 00:23:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.innodb-buffer-pool-size 2024-11-07 00:23:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.innodb-change-buffering 2024-11-07 00:23:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.innodb-change-buffering 2024-11-07 00:23:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.innodb-io-capacity 2024-11-07 00:23:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.innodb-io-capacity 2024-11-07 00:23:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.innodb-file-per-table 2024-11-07 00:23:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.innodb-file-per-table 2024-11-07 00:23:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.tuning-level 2024-11-07 00:23:19 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.tuning-level 2024-11-07 00:23:19 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.table-open-cache 2024-11-07 00:23:19 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.table-open-cache 2024-11-07 00:23:19 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.max-connections 2024-11-07 00:23:19 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.enable-binlogs 2024-11-07 00:23:19 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.binlogs-path 2024-11-07 00:23:19 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.binlogs-path 2024-11-07 00:23:19 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.binlogs-max-size 2024-11-07 00:23:19 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.binlogs-max-size 2024-11-07 00:23:19 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.binlogs-expire-days 2024-11-07 00:23:19 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.binlogs-expire-days 2024-11-07 00:23:19 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.prefer-ipv6 2024-11-07 00:23:19 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.wait-timeout 2024-11-07 00:23:19 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.wait-timeout 2024-11-07 00:23:19 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.os-db-router-hostname 2024-11-07 00:23:19 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Initializing Snap Layer 2024-11-07 00:23:19 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: coordinator.DelayedActionCoordinator Loading state 2024-11-07 00:23:19 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:23:19 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Coordinator: Initializing coordinator layer 2024-11-07 00:23:19 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Initializing Leadership Layer (is leader) 2024-11-07 00:23:19 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: cleared flag leadership.changed.cluster-created 2024-11-07 00:23:19 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer> tracer: starting handler dispatch, 78 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.cluster-address tracer: set flag endpoint.cluster.changed.cluster-password tracer: set flag endpoint.cluster.changed.cluster-user tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-configure-ready tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.changed tracer: set flag leadership.changed.cluster-instance-clustered-252-49-102-64 tracer: set flag leadership.changed.cluster-instance-configured-252-49-102-64 tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-49-102-64 tracer: set flag leadership.set.cluster-instance-configured-252-49-102-64 tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-11-07 00:23:19 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: hooks phase, 0 handlers queued 2024-11-07 00:23:19 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:172:configure_instances_for_clustering 2024-11-07 00:23:20 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 00:23:20 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Found peers: 252.49.107.157,252.49.94.42 2024-11-07 00:23:20 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Expect 2 peers 2024-11-07 00:23:20 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Reached quorum 2024-11-07 00:23:20 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:172:configure_instances_for_clustering 2024-11-07 00:23:20 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Configuring instances for clustering. 2024-11-07 00:23:20 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Configuring instance for clustering: 252.49.107.157. 2024-11-07 00:23:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Opening db connection for clusteruser@252.49.107.157 2024-11-07 00:23:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Instance Configured 252.49.107.157: +----------------------------------------+---------------+----------------+----------------------------+ | Variable | Current Value | Required Value | Note | +----------------------------------------+---------------+----------------+----------------------------+ | binlog_transaction_dependency_tracking | COMMIT_ORDER | WRITESET | Update the server variable | +----------------------------------------+---------------+----------------+----------------------------+ 2024-11-07 00:23:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag leadership.changed.cluster-instance-configured-252-49-107-157 2024-11-07 00:23:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag leadership.set.cluster-instance-configured-252-49-107-157 2024-11-07 00:23:21 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for mysql-innodb-cluster/1: ok=true 2024-11-07 00:23:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Checking cluster status. 2024-11-07 00:23:22 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Adding instance, 252.49.107.157, to the cluster. 2024-11-07 00:23:28 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for mysql-innodb-cluster/1 : {45 {map[heat-mysql-router/0:{1}] map[] []}} 2024-11-07 00:23:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Instance Clustered 252.49.107.157: * Waiting for server restart... \ * Waiting for server restart... | * Waiting for server restart... / * Waiting for server restart... - * Waiting for server restart... \ * Waiting for server restart... | * Waiting for server restart... ready 2024-11-07 00:23:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag leadership.changed.cluster-instance-clustered-252-49-107-157 2024-11-07 00:23:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag leadership.set.cluster-instance-clustered-252-49-107-157 2024-11-07 00:23:36 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-11-07 00:23:36 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-11-07 00:23:36 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-11-07 00:23:37 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router 2024-11-07 00:23:37 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 00:23:37 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:23:37 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: coordinator.DelayedActionCoordinator Publishing state 2024-11-07 00:23:37 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for mysql-innodb-cluster/1: ok=true 2024-11-07 00:23:37 INFO juju.worker.uniter.operation runhook.go:159 ran "cluster-relation-changed" hook (via explicit, bespoke hook script) 2024-11-07 00:23:37 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (3; unit: mysql-innodb-cluster/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:23:37 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-07 00:23:37 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/1 uniter (run relation-changed (3; unit: mysql-innodb-cluster/0) hook) 2024-11-07 00:23:37 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/1 2024-11-07 00:23:37 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:23:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 00:23:37 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (45; unit: heat-mysql-router/0) hook for mysql-innodb-cluster/1 2024-11-07 00:23:37 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/1 uniter (run relation-changed (45; unit: heat-mysql-router/0) hook) 2024-11-07 00:23:37 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/1 uniter (run relation-changed (45; unit: heat-mysql-router/0) hook) 2024-11-07 00:23:37 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (45; unit: heat-mysql-router/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:23:38 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (45; unit: heat-mysql-router/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:23:38 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running db-router-relation-changed hook for heat-mysql-router/0 2024-11-07 00:23:38 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-1/agent.socket } 2024-11-07 00:23:38 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: Reactive main running for hook db-router-relation-changed 2024-11-07 00:23:39 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer> tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:172:configure_instances_for_clustering 2024-11-07 00:23:39 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag endpoint.db-router.changed.mysqlrouter_username 2024-11-07 00:23:39 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.snapd_refresh 2024-11-07 00:23:39 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.ssl_cert 2024-11-07 00:23:39 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.ssl_key 2024-11-07 00:23:39 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.ssl_ca 2024-11-07 00:23:39 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.set.source 2024-11-07 00:23:39 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.source 2024-11-07 00:23:39 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.set.cluster-name 2024-11-07 00:23:39 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.cluster-name 2024-11-07 00:23:39 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.set.auto-rejoin-tries 2024-11-07 00:23:39 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.auto-rejoin-tries 2024-11-07 00:23:39 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.set.expel-timeout 2024-11-07 00:23:39 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.expel-timeout 2024-11-07 00:23:39 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.set.innodb-buffer-pool-size 2024-11-07 00:23:39 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.set.innodb-change-buffering 2024-11-07 00:23:39 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.innodb-change-buffering 2024-11-07 00:23:40 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.set.innodb-io-capacity 2024-11-07 00:23:40 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.innodb-io-capacity 2024-11-07 00:23:40 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.set.innodb-file-per-table 2024-11-07 00:23:40 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.innodb-file-per-table 2024-11-07 00:23:40 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.set.tuning-level 2024-11-07 00:23:40 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.tuning-level 2024-11-07 00:23:40 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.set.table-open-cache 2024-11-07 00:23:40 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.table-open-cache 2024-11-07 00:23:40 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.set.max-connections 2024-11-07 00:23:40 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.enable-binlogs 2024-11-07 00:23:40 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.set.binlogs-path 2024-11-07 00:23:40 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.binlogs-path 2024-11-07 00:23:40 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.set.binlogs-max-size 2024-11-07 00:23:40 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.binlogs-max-size 2024-11-07 00:23:40 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.set.binlogs-expire-days 2024-11-07 00:23:40 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.binlogs-expire-days 2024-11-07 00:23:40 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.prefer-ipv6 2024-11-07 00:23:40 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.set.wait-timeout 2024-11-07 00:23:40 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.wait-timeout 2024-11-07 00:23:40 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.os-db-router-hostname 2024-11-07 00:23:40 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: Initializing Snap Layer 2024-11-07 00:23:41 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: coordinator.DelayedActionCoordinator Loading state 2024-11-07 00:23:41 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:23:41 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: Coordinator: Initializing coordinator layer 2024-11-07 00:23:41 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: Initializing Leadership Layer (is leader) 2024-11-07 00:23:41 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for mysql-innodb-cluster/1 : {3 {map[mysql-innodb-cluster/0:{3}] map[] []}} 2024-11-07 00:23:41 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: cleared flag leadership.changed.cluster-instance-clustered-252-49-102-64 2024-11-07 00:23:41 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: cleared flag leadership.changed.cluster-instance-configured-252-49-102-64 2024-11-07 00:23:41 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer> tracer: starting handler dispatch, 82 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.cluster-address tracer: set flag endpoint.cluster.changed.cluster-password tracer: set flag endpoint.cluster.changed.cluster-user tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-configure-ready tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.changed tracer: set flag leadership.changed.cluster-instance-clustered-252-49-107-157 tracer: set flag leadership.changed.cluster-instance-configured-252-49-107-157 tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-49-102-64 tracer: set flag leadership.set.cluster-instance-clustered-252-49-107-157 tracer: set flag leadership.set.cluster-instance-configured-252-49-102-64 tracer: set flag leadership.set.cluster-instance-configured-252-49-107-157 tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-11-07 00:23:41 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: hooks phase, 0 handlers queued 2024-11-07 00:23:41 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:172:configure_instances_for_clustering 2024-11-07 00:23:41 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 00:23:41 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: Found peers: 252.49.107.157,252.49.94.42 2024-11-07 00:23:41 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: Expect 2 peers 2024-11-07 00:23:41 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: Reached quorum 2024-11-07 00:23:41 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:172:configure_instances_for_clustering 2024-11-07 00:23:41 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: Configuring instances for clustering. 2024-11-07 00:23:41 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: Instance: 252.49.107.157, already configured. 2024-11-07 00:23:41 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: Instance: 252.49.107.157, already clustered. 2024-11-07 00:23:41 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-11-07 00:23:41 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-11-07 00:23:41 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-11-07 00:23:41 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag db-router.available 2024-11-07 00:23:41 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router 2024-11-07 00:23:41 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 00:23:41 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:23:41 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: coordinator.DelayedActionCoordinator Publishing state 2024-11-07 00:23:42 INFO juju.worker.uniter.operation runhook.go:159 ran "db-router-relation-changed" hook (via explicit, bespoke hook script) 2024-11-07 00:23:42 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (45; unit: heat-mysql-router/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:23:42 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-07 00:23:42 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/1 uniter (run relation-changed (45; unit: heat-mysql-router/0) hook) 2024-11-07 00:23:42 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/1 2024-11-07 00:23:42 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:23:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 00:23:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 00:23:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 00:23:42 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (3; unit: mysql-innodb-cluster/0) hook for mysql-innodb-cluster/1 2024-11-07 00:23:42 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/1 uniter (run relation-changed (3; unit: mysql-innodb-cluster/0) hook) 2024-11-07 00:23:42 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/1 uniter (run relation-changed (3; unit: mysql-innodb-cluster/0) hook) 2024-11-07 00:23:42 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (3; unit: mysql-innodb-cluster/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:23:42 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (3; unit: mysql-innodb-cluster/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:23:42 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running cluster-relation-changed hook for mysql-innodb-cluster/0 2024-11-07 00:23:43 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-1/agent.socket } 2024-11-07 00:23:43 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Reactive main running for hook cluster-relation-changed 2024-11-07 00:23:43 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer> tracer: set flag endpoint.cluster.changed.unit-clustered tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:172:configure_instances_for_clustering 2024-11-07 00:23:44 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.snapd_refresh 2024-11-07 00:23:44 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.ssl_cert 2024-11-07 00:23:44 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.ssl_key 2024-11-07 00:23:44 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.ssl_ca 2024-11-07 00:23:44 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.source 2024-11-07 00:23:44 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.source 2024-11-07 00:23:44 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.cluster-name 2024-11-07 00:23:44 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.cluster-name 2024-11-07 00:23:44 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.auto-rejoin-tries 2024-11-07 00:23:44 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.auto-rejoin-tries 2024-11-07 00:23:44 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.expel-timeout 2024-11-07 00:23:44 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.expel-timeout 2024-11-07 00:23:44 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.innodb-buffer-pool-size 2024-11-07 00:23:44 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.innodb-change-buffering 2024-11-07 00:23:44 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.innodb-change-buffering 2024-11-07 00:23:44 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.innodb-io-capacity 2024-11-07 00:23:44 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.innodb-io-capacity 2024-11-07 00:23:44 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.innodb-file-per-table 2024-11-07 00:23:44 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.innodb-file-per-table 2024-11-07 00:23:44 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.tuning-level 2024-11-07 00:23:44 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.tuning-level 2024-11-07 00:23:44 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.table-open-cache 2024-11-07 00:23:45 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.table-open-cache 2024-11-07 00:23:45 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.max-connections 2024-11-07 00:23:45 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.enable-binlogs 2024-11-07 00:23:45 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.binlogs-path 2024-11-07 00:23:45 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.binlogs-path 2024-11-07 00:23:45 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.binlogs-max-size 2024-11-07 00:23:45 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.binlogs-max-size 2024-11-07 00:23:45 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.binlogs-expire-days 2024-11-07 00:23:45 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.binlogs-expire-days 2024-11-07 00:23:45 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.prefer-ipv6 2024-11-07 00:23:45 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.wait-timeout 2024-11-07 00:23:45 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.wait-timeout 2024-11-07 00:23:45 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.os-db-router-hostname 2024-11-07 00:23:45 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Initializing Snap Layer 2024-11-07 00:23:45 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: coordinator.DelayedActionCoordinator Loading state 2024-11-07 00:23:45 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:23:45 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Coordinator: Initializing coordinator layer 2024-11-07 00:23:45 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Initializing Leadership Layer (is leader) 2024-11-07 00:23:45 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: cleared flag leadership.changed.cluster-instance-clustered-252-49-107-157 2024-11-07 00:23:45 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: cleared flag leadership.changed.cluster-instance-configured-252-49-107-157 2024-11-07 00:23:46 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: cleared flag leadership.changed 2024-11-07 00:23:46 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer> tracer: starting handler dispatch, 81 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.cluster-address tracer: set flag endpoint.cluster.changed.cluster-password tracer: set flag endpoint.cluster.changed.cluster-user tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.changed.unit-configure-ready tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-49-102-64 tracer: set flag leadership.set.cluster-instance-clustered-252-49-107-157 tracer: set flag leadership.set.cluster-instance-configured-252-49-102-64 tracer: set flag leadership.set.cluster-instance-configured-252-49-107-157 tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-11-07 00:23:46 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: hooks phase, 0 handlers queued 2024-11-07 00:23:46 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:172:configure_instances_for_clustering 2024-11-07 00:23:46 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 00:23:46 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Found peers: 252.49.107.157,252.49.94.42 2024-11-07 00:23:46 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Expect 2 peers 2024-11-07 00:23:46 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Reached quorum 2024-11-07 00:23:46 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:172:configure_instances_for_clustering 2024-11-07 00:23:46 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Configuring instances for clustering. 2024-11-07 00:23:46 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Instance: 252.49.107.157, already configured. 2024-11-07 00:23:46 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Instance: 252.49.107.157, already clustered. 2024-11-07 00:23:46 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-11-07 00:23:46 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-11-07 00:23:46 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: cleared flag endpoint.cluster.changed.cluster-address 2024-11-07 00:23:46 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: cleared flag endpoint.cluster.changed.cluster-user 2024-11-07 00:23:46 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: cleared flag endpoint.cluster.changed.cluster-password 2024-11-07 00:23:46 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: cleared flag endpoint.cluster.changed.unit-configure-ready 2024-11-07 00:23:46 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: cleared flag endpoint.cluster.changed.unit-clustered 2024-11-07 00:23:46 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-11-07 00:23:46 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router 2024-11-07 00:23:46 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 00:23:46 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:23:46 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: coordinator.DelayedActionCoordinator Publishing state 2024-11-07 00:23:47 INFO juju.worker.uniter.operation runhook.go:159 ran "cluster-relation-changed" hook (via explicit, bespoke hook script) 2024-11-07 00:23:47 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (3; unit: mysql-innodb-cluster/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:23:47 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-07 00:23:47 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/1 uniter (run relation-changed (3; unit: mysql-innodb-cluster/0) hook) 2024-11-07 00:23:47 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/1 2024-11-07 00:23:47 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:23:47 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 00:23:47 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 00:23:47 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 00:23:47 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 00:23:47 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 00:23:47 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 00:23:47 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 2024-11-07 00:23:47 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:23:47 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 00:23:47 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 00:23:47 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 00:23:47 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 00:23:47 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 00:23:47 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 00:23:48 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for mysql-innodb-cluster/1 : {3 {map[mysql-innodb-cluster/2:{2}] map[] []}} 2024-11-07 00:23:48 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:23:48 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 00:23:48 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 00:23:48 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (3; unit: mysql-innodb-cluster/2) hook for mysql-innodb-cluster/1 2024-11-07 00:23:48 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/1 uniter (run relation-changed (3; unit: mysql-innodb-cluster/2) hook) 2024-11-07 00:23:48 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/1 uniter (run relation-changed (3; unit: mysql-innodb-cluster/2) hook) 2024-11-07 00:23:48 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (3; unit: mysql-innodb-cluster/2) hook" for mysql-innodb-cluster/1 2024-11-07 00:23:48 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (3; unit: mysql-innodb-cluster/2) hook" for mysql-innodb-cluster/1 2024-11-07 00:23:48 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running cluster-relation-changed hook for mysql-innodb-cluster/2 2024-11-07 00:23:48 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-1/agent.socket } 2024-11-07 00:23:49 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Reactive main running for hook cluster-relation-changed 2024-11-07 00:23:49 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for mysql-innodb-cluster/1 : {35 {map[keystone-mysql-router/0:{1}] map[] []}} 2024-11-07 00:23:49 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer> tracer: set flag endpoint.cluster.changed.unit-configure-ready tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:172:configure_instances_for_clustering 2024-11-07 00:23:50 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.snapd_refresh 2024-11-07 00:23:50 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.ssl_cert 2024-11-07 00:23:50 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.ssl_key 2024-11-07 00:23:50 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.ssl_ca 2024-11-07 00:23:50 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.source 2024-11-07 00:23:50 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.source 2024-11-07 00:23:50 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.cluster-name 2024-11-07 00:23:50 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.cluster-name 2024-11-07 00:23:50 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.auto-rejoin-tries 2024-11-07 00:23:50 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.auto-rejoin-tries 2024-11-07 00:23:50 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.expel-timeout 2024-11-07 00:23:50 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.expel-timeout 2024-11-07 00:23:50 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.innodb-buffer-pool-size 2024-11-07 00:23:50 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.innodb-change-buffering 2024-11-07 00:23:50 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.innodb-change-buffering 2024-11-07 00:23:50 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.innodb-io-capacity 2024-11-07 00:23:50 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.innodb-io-capacity 2024-11-07 00:23:50 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.innodb-file-per-table 2024-11-07 00:23:50 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.innodb-file-per-table 2024-11-07 00:23:51 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.tuning-level 2024-11-07 00:23:51 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.tuning-level 2024-11-07 00:23:51 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.table-open-cache 2024-11-07 00:23:51 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.table-open-cache 2024-11-07 00:23:51 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.max-connections 2024-11-07 00:23:51 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.enable-binlogs 2024-11-07 00:23:51 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.binlogs-path 2024-11-07 00:23:51 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.binlogs-path 2024-11-07 00:23:51 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.binlogs-max-size 2024-11-07 00:23:51 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.binlogs-max-size 2024-11-07 00:23:51 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.binlogs-expire-days 2024-11-07 00:23:51 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.binlogs-expire-days 2024-11-07 00:23:51 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.prefer-ipv6 2024-11-07 00:23:51 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.wait-timeout 2024-11-07 00:23:51 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.wait-timeout 2024-11-07 00:23:51 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.os-db-router-hostname 2024-11-07 00:23:51 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Initializing Snap Layer 2024-11-07 00:23:51 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: coordinator.DelayedActionCoordinator Loading state 2024-11-07 00:23:52 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:23:52 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Coordinator: Initializing coordinator layer 2024-11-07 00:23:52 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Initializing Leadership Layer (is leader) 2024-11-07 00:23:52 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer> tracer: starting handler dispatch, 77 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-configure-ready tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-49-102-64 tracer: set flag leadership.set.cluster-instance-clustered-252-49-107-157 tracer: set flag leadership.set.cluster-instance-configured-252-49-102-64 tracer: set flag leadership.set.cluster-instance-configured-252-49-107-157 tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-11-07 00:23:52 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: hooks phase, 0 handlers queued 2024-11-07 00:23:52 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:172:configure_instances_for_clustering 2024-11-07 00:23:52 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 00:23:52 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Found peers: 252.49.107.157,252.49.94.42 2024-11-07 00:23:52 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Expect 2 peers 2024-11-07 00:23:52 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Reached quorum 2024-11-07 00:23:52 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:172:configure_instances_for_clustering 2024-11-07 00:23:52 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Configuring instances for clustering. 2024-11-07 00:23:52 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Instance: 252.49.107.157, already configured. 2024-11-07 00:23:52 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Instance: 252.49.107.157, already clustered. 2024-11-07 00:23:52 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Configuring instance for clustering: 252.49.94.42. 2024-11-07 00:23:53 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Opening db connection for clusteruser@252.49.94.42 2024-11-07 00:23:53 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Instance Configured 252.49.94.42: +----------------------------------------+---------------+----------------+----------------------------+ | Variable | Current Value | Required Value | Note | +----------------------------------------+---------------+----------------+----------------------------+ | binlog_transaction_dependency_tracking | COMMIT_ORDER | WRITESET | Update the server variable | +----------------------------------------+---------------+----------------+----------------------------+ 2024-11-07 00:23:53 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag leadership.changed.cluster-instance-configured-252-49-94-42 2024-11-07 00:23:53 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag leadership.changed 2024-11-07 00:23:53 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag leadership.set.cluster-instance-configured-252-49-94-42 2024-11-07 00:23:53 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Checking cluster status. 2024-11-07 00:23:53 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for mysql-innodb-cluster/1: ok=true 2024-11-07 00:23:54 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Adding instance, 252.49.94.42, to the cluster. 2024-11-07 00:24:01 ERROR unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Failed adding instance 252.49.94.42 to cluster: Cannot set LC_ALL to locale en_US.UTF-8: No such file or directory WARNING: A GTID set check of the MySQL instance at '252.49.94.42:3306' determined that it contains transactions that do not originate from the cluster, which must be discarded before it can join the cluster. 252.49.94.42:3306 has the following errant GTIDs that do not exist in the cluster: 44ec7fed-9c9e-11ef-94c6-00163e9a70ef:1-16 WARNING: Discarding these extra GTID events can either be done manually or by completely overwriting the state of 252.49.94.42:3306 with a physical snapshot from an existing cluster member. To use this method by default, set the 'recoveryMethod' option to 'clone'. Having extra GTID events is not expected, and it is recommended to investigate this further and ensure that the data can be removed prior to choosing the clone recovery method. Clone based recovery selected through the recoveryMethod option Validating instance configuration at 252.49.94.42:3306... This instance reports its own address as 252.49.94.42:3306 Instance configuration is suitable. NOTE: Group Replication will communicate with other members using '252.49.94.42:33061'. Use the localAddress option to override. A new instance will be added to the InnoDB cluster. Depending on the amount of data on the cluster this might take from a few seconds to several hours. Adding instance to the cluster... Monitoring recovery process of the new cluster member. Press ^C to stop monitoring and let it continue in background. WARNING: Error while waiting for recovery of the added instance: MySQL Error 2013: Lost connection to MySQL server at 'reading initial communication packet', system error: 104 Traceback (most recent call last): File "", line 3, in RuntimeError: Cluster.add_instance: Cannot set Group Replication recovery user to 'mysql_innodb_cluster_1002'. Error executing CHANGE MASTER statement: 252.49.94.42:3306: MySQL server has gone away 2024-11-07 00:24:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag leadership.changed.cluster-instances-configured 2024-11-07 00:24:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer> tracer: set flag leadership.set.cluster-instances-configured tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:208:add_instances_to_cluster tracer: -- dequeue handler reactive/mysql_innodb_cluster_handlers.py:172:configure_instances_for_clustering 2024-11-07 00:24:01 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-11-07 00:24:01 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for mysql-innodb-cluster/1: ok=true 2024-11-07 00:24:01 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-11-07 00:24:01 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-11-07 00:24:01 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router 2024-11-07 00:24:01 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 00:24:01 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:208:add_instances_to_cluster 2024-11-07 00:24:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Adding instances to cluster. 2024-11-07 00:24:01 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Instance: 252.49.107.157, already clustered. 2024-11-07 00:24:02 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Checking cluster status. 2024-11-07 00:24:03 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Adding instance, 252.49.94.42, to the cluster. 2024-11-07 00:24:04 ERROR unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Failed adding instance 252.49.94.42 to cluster: Cannot set LC_ALL to locale en_US.UTF-8: No such file or directory ERROR: Unable to connect to the target instance '252.49.94.42:3306'. Please verify the connection settings, make sure the instance is available and try again. Traceback (most recent call last): File "", line 3, in mysqlsh.DBError: MySQL Error (2003): Cluster.add_instance: Could not open connection to '252.49.94.42:3306': Can't connect to MySQL server on '252.49.94.42' (111) 2024-11-07 00:24:04 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Running _assess_status() 2024-11-07 00:24:04 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:24:04 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: coordinator.DelayedActionCoordinator Publishing state 2024-11-07 00:24:05 INFO juju.worker.uniter.operation runhook.go:159 ran "cluster-relation-changed" hook (via explicit, bespoke hook script) 2024-11-07 00:24:05 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (3; unit: mysql-innodb-cluster/2) hook" for mysql-innodb-cluster/1 2024-11-07 00:24:05 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-07 00:24:05 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/1 uniter (run relation-changed (3; unit: mysql-innodb-cluster/2) hook) 2024-11-07 00:24:05 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/1 2024-11-07 00:24:05 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:24:05 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 00:24:05 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 00:24:05 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 00:24:05 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 00:24:05 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (35; unit: keystone-mysql-router/0) hook for mysql-innodb-cluster/1 2024-11-07 00:24:05 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/1 uniter (run relation-changed (35; unit: keystone-mysql-router/0) hook) 2024-11-07 00:24:05 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/1 uniter (run relation-changed (35; unit: keystone-mysql-router/0) hook) 2024-11-07 00:24:05 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (35; unit: keystone-mysql-router/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:24:05 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (35; unit: keystone-mysql-router/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:24:05 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running db-router-relation-changed hook for keystone-mysql-router/0 2024-11-07 00:24:05 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-1/agent.socket } 2024-11-07 00:24:06 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: Reactive main running for hook db-router-relation-changed 2024-11-07 00:24:06 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:208:add_instances_to_cluster 2024-11-07 00:24:06 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.ssl_cert 2024-11-07 00:24:06 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.ssl_key 2024-11-07 00:24:06 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.ssl_ca 2024-11-07 00:24:06 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.set.source 2024-11-07 00:24:06 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.source 2024-11-07 00:24:06 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.set.cluster-name 2024-11-07 00:24:06 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.cluster-name 2024-11-07 00:24:06 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.set.auto-rejoin-tries 2024-11-07 00:24:06 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.auto-rejoin-tries 2024-11-07 00:24:06 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.set.expel-timeout 2024-11-07 00:24:06 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.expel-timeout 2024-11-07 00:24:07 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.set.innodb-buffer-pool-size 2024-11-07 00:24:07 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.set.innodb-change-buffering 2024-11-07 00:24:07 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.innodb-change-buffering 2024-11-07 00:24:07 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.set.innodb-io-capacity 2024-11-07 00:24:07 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.innodb-io-capacity 2024-11-07 00:24:07 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.set.innodb-file-per-table 2024-11-07 00:24:07 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.innodb-file-per-table 2024-11-07 00:24:07 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.set.tuning-level 2024-11-07 00:24:07 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.tuning-level 2024-11-07 00:24:07 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.set.table-open-cache 2024-11-07 00:24:07 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.table-open-cache 2024-11-07 00:24:07 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.set.max-connections 2024-11-07 00:24:07 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.enable-binlogs 2024-11-07 00:24:07 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.set.binlogs-path 2024-11-07 00:24:07 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.binlogs-path 2024-11-07 00:24:07 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.set.binlogs-max-size 2024-11-07 00:24:07 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.binlogs-max-size 2024-11-07 00:24:07 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.set.binlogs-expire-days 2024-11-07 00:24:07 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.binlogs-expire-days 2024-11-07 00:24:07 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.prefer-ipv6 2024-11-07 00:24:07 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.set.wait-timeout 2024-11-07 00:24:07 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.wait-timeout 2024-11-07 00:24:07 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.os-db-router-hostname 2024-11-07 00:24:07 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: Initializing Snap Layer 2024-11-07 00:24:08 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: coordinator.DelayedActionCoordinator Loading state 2024-11-07 00:24:08 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:24:08 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: Coordinator: Initializing coordinator layer 2024-11-07 00:24:08 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: Initializing Leadership Layer (is leader) 2024-11-07 00:24:08 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer> tracer: starting handler dispatch, 82 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-configure-ready tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.changed tracer: set flag leadership.changed.cluster-instance-configured-252-49-94-42 tracer: set flag leadership.changed.cluster-instances-configured tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-49-102-64 tracer: set flag leadership.set.cluster-instance-clustered-252-49-107-157 tracer: set flag leadership.set.cluster-instance-configured-252-49-102-64 tracer: set flag leadership.set.cluster-instance-configured-252-49-107-157 tracer: set flag leadership.set.cluster-instance-configured-252-49-94-42 tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-11-07 00:24:08 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: hooks phase, 0 handlers queued 2024-11-07 00:24:08 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:208:add_instances_to_cluster 2024-11-07 00:24:08 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 00:24:08 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: Found peers: 252.49.107.157,252.49.94.42 2024-11-07 00:24:08 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: Expect 2 peers 2024-11-07 00:24:08 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: Reached quorum 2024-11-07 00:24:08 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:208:add_instances_to_cluster 2024-11-07 00:24:08 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: Adding instances to cluster. 2024-11-07 00:24:08 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: Instance: 252.49.107.157, already clustered. 2024-11-07 00:24:08 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: Checking cluster status. 2024-11-07 00:24:09 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: Adding instance, 252.49.94.42, to the cluster. 2024-11-07 00:24:10 ERROR unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: Failed adding instance 252.49.94.42 to cluster: Cannot set LC_ALL to locale en_US.UTF-8: No such file or directory NOTE: The instance '252.49.94.42:3306' is running auto-rejoin process, which will be cancelled. Clone based recovery selected through the recoveryMethod option Validating instance configuration at 252.49.94.42:3306... This instance reports its own address as 252.49.94.42:3306 Instance configuration is suitable. NOTE: Group Replication will communicate with other members using '252.49.94.42:33061'. Use the localAddress option to override. Traceback (most recent call last): File "", line 3, in RuntimeError: Cluster.add_instance: The port '33061' for localAddress option is already in use. Specify an available port to be used with localAddress option or free port '33061'. 2024-11-07 00:24:10 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-11-07 00:24:10 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-11-07 00:24:10 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-11-07 00:24:10 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router 2024-11-07 00:24:10 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 00:24:10 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:24:10 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: coordinator.DelayedActionCoordinator Publishing state 2024-11-07 00:24:11 INFO juju.worker.uniter.operation runhook.go:159 ran "db-router-relation-changed" hook (via explicit, bespoke hook script) 2024-11-07 00:24:11 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (35; unit: keystone-mysql-router/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:24:11 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-07 00:24:11 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/1 uniter (run relation-changed (35; unit: keystone-mysql-router/0) hook) 2024-11-07 00:24:11 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/1 2024-11-07 00:24:11 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:24:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 00:24:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 00:24:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 00:24:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 00:24:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 00:24:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 00:24:11 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 2024-11-07 00:24:11 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:24:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 00:24:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 00:24:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 00:24:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 00:24:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 00:24:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 00:24:50 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for mysql-innodb-cluster/1 : {37 {map[glance-mysql-router/0:{0}] map[] []}} 2024-11-07 00:24:50 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:24:50 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 00:24:50 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 00:24:50 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 00:24:50 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 00:24:50 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 00:24:50 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 00:24:50 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-joined (37; unit: glance-mysql-router/0) hook for mysql-innodb-cluster/1 2024-11-07 00:24:50 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/1 uniter (run relation-joined (37; unit: glance-mysql-router/0) hook) 2024-11-07 00:24:50 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/1 uniter (run relation-joined (37; unit: glance-mysql-router/0) hook) 2024-11-07 00:24:50 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-joined (37; unit: glance-mysql-router/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:24:50 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-joined (37; unit: glance-mysql-router/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:24:50 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running db-router-relation-joined hook for glance-mysql-router/0 2024-11-07 00:24:50 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-1/agent.socket } 2024-11-07 00:24:51 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Reactive main running for hook db-router-relation-joined 2024-11-07 00:24:51 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:208:add_instances_to_cluster 2024-11-07 00:24:51 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.ssl_cert 2024-11-07 00:24:51 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.ssl_key 2024-11-07 00:24:51 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.ssl_ca 2024-11-07 00:24:51 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.set.source 2024-11-07 00:24:51 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.source 2024-11-07 00:24:51 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.set.cluster-name 2024-11-07 00:24:51 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.cluster-name 2024-11-07 00:24:52 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.set.auto-rejoin-tries 2024-11-07 00:24:52 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.auto-rejoin-tries 2024-11-07 00:24:52 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.set.expel-timeout 2024-11-07 00:24:52 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.expel-timeout 2024-11-07 00:24:52 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.set.innodb-buffer-pool-size 2024-11-07 00:24:52 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.set.innodb-change-buffering 2024-11-07 00:24:52 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.innodb-change-buffering 2024-11-07 00:24:52 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.set.innodb-io-capacity 2024-11-07 00:24:52 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.innodb-io-capacity 2024-11-07 00:24:52 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.set.innodb-file-per-table 2024-11-07 00:24:52 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.innodb-file-per-table 2024-11-07 00:24:52 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.set.tuning-level 2024-11-07 00:24:52 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.tuning-level 2024-11-07 00:24:52 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.set.table-open-cache 2024-11-07 00:24:52 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.table-open-cache 2024-11-07 00:24:52 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.set.max-connections 2024-11-07 00:24:52 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.enable-binlogs 2024-11-07 00:24:52 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.set.binlogs-path 2024-11-07 00:24:52 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.binlogs-path 2024-11-07 00:24:52 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.set.binlogs-max-size 2024-11-07 00:24:52 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.binlogs-max-size 2024-11-07 00:24:52 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.set.binlogs-expire-days 2024-11-07 00:24:52 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.binlogs-expire-days 2024-11-07 00:24:52 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.prefer-ipv6 2024-11-07 00:24:52 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.set.wait-timeout 2024-11-07 00:24:52 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.wait-timeout 2024-11-07 00:24:52 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.os-db-router-hostname 2024-11-07 00:24:52 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Initializing Snap Layer 2024-11-07 00:24:53 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: coordinator.DelayedActionCoordinator Loading state 2024-11-07 00:24:53 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:24:53 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Coordinator: Initializing coordinator layer 2024-11-07 00:24:53 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Initializing Leadership Layer (is leader) 2024-11-07 00:24:53 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: cleared flag leadership.changed.cluster-instance-configured-252-49-94-42 2024-11-07 00:24:53 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: cleared flag leadership.changed.cluster-instances-configured 2024-11-07 00:24:53 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: cleared flag leadership.changed 2024-11-07 00:24:53 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer> tracer: starting handler dispatch, 79 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-configure-ready tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-49-102-64 tracer: set flag leadership.set.cluster-instance-clustered-252-49-107-157 tracer: set flag leadership.set.cluster-instance-configured-252-49-102-64 tracer: set flag leadership.set.cluster-instance-configured-252-49-107-157 tracer: set flag leadership.set.cluster-instance-configured-252-49-94-42 tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-11-07 00:24:53 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: hooks phase, 0 handlers queued 2024-11-07 00:24:53 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:208:add_instances_to_cluster 2024-11-07 00:24:53 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 00:24:53 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Found peers: 252.49.107.157,252.49.94.42 2024-11-07 00:24:53 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Expect 2 peers 2024-11-07 00:24:53 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Reached quorum 2024-11-07 00:24:53 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:208:add_instances_to_cluster 2024-11-07 00:24:53 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Adding instances to cluster. 2024-11-07 00:24:53 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Instance: 252.49.107.157, already clustered. 2024-11-07 00:24:53 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Checking cluster status. 2024-11-07 00:24:54 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Adding instance, 252.49.94.42, to the cluster. 2024-11-07 00:24:55 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Add instance 252.49.94.42 raised CalledProcessError with returncode 1, however, the output contains 'Group Replication is running' an indication of previously successfully adding the instance to the cluster. 2024-11-07 00:24:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Instance Clustered 252.49.94.42: Cannot set LC_ALL to locale en_US.UTF-8: No such file or directory Clone based recovery selected through the recoveryMethod option Validating instance configuration at 252.49.94.42:3306... This instance reports its own address as 252.49.94.42:3306 Instance configuration is suitable. NOTE: Group Replication will communicate with other members using '252.49.94.42:33061'. Use the localAddress option to override. A new instance will be added to the InnoDB cluster. Depending on the amount of data on the cluster this might take from a few seconds to several hours. Adding instance to the cluster... Traceback (most recent call last): File "", line 3, in mysqlsh.DBError: MySQL Error (3190): Cluster.add_instance: RESET SOURCE is not allowed because Group Replication is running. 2024-11-07 00:24:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag leadership.changed.cluster-instance-clustered-252-49-94-42 2024-11-07 00:24:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag leadership.changed 2024-11-07 00:24:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag leadership.set.cluster-instance-clustered-252-49-94-42 2024-11-07 00:24:56 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag leadership.changed.cluster-instances-clustered 2024-11-07 00:24:56 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer> tracer: set flag leadership.set.cluster-instances-clustered tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:334:db_router_respond tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:353:scale_out tracer: -- dequeue handler reactive/mysql_innodb_cluster_handlers.py:208:add_instances_to_cluster 2024-11-07 00:24:56 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for mysql-innodb-cluster/1: ok=true 2024-11-07 00:24:56 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-11-07 00:24:56 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for mysql-innodb-cluster/1: ok=true 2024-11-07 00:24:56 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-11-07 00:24:56 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-11-07 00:24:56 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Invoking reactive handler: hooks/relations/mysql-router/provides.py:53:changed:db-router 2024-11-07 00:24:56 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 00:24:56 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:334:db_router_respond 2024-11-07 00:24:56 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: DB router respond 2024-11-07 00:24:56 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Checking cluster status. 2024-11-07 00:24:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Checking cluster status. 2024-11-07 00:24:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Opening db connection for clusteruser@252.49.102.64 2024-11-07 00:24:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Single hostname provided by relation: 252.49.180.63 2024-11-07 00:24:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Generating new password file '/var/lib/charm/mysql-innodb-cluster/mysql-mysqlrouteruser.passwd' 2024-11-07 00:24:58 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Making dir /var/lib/charm/mysql-innodb-cluster root:root 770 2024-11-07 00:24:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Writing file /var/lib/charm/mysql-innodb-cluster/mysql-mysqlrouteruser.passwd root:root 660 2024-11-07 00:24:59 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: DB user mysqlrouteruser already exists. 2024-11-07 00:24:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Proactively resetting ssl_ca 2024-11-07 00:24:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Single hostname provided by relation: 252.49.118.130 2024-11-07 00:24:59 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: DB user mysqlrouteruser already exists. 2024-11-07 00:24:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Proactively resetting ssl_ca 2024-11-07 00:24:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: DB Router relation created DBs and users. 2024-11-07 00:24:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer> tracer: cleared flag endpoint.db-router.changed tracer: -- dequeue handler reactive/mysql_innodb_cluster_handlers.py:334:db_router_respond 2024-11-07 00:24:59 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:353:scale_out 2024-11-07 00:24:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Scale out: add new nodes. 2024-11-07 00:24:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Creating remote users. 2024-11-07 00:24:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Checking cluster status. 2024-11-07 00:25:00 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for mysql-innodb-cluster/1: ok=true 2024-11-07 00:25:00 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Checking cluster status. 2024-11-07 00:25:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Opening db connection for clusteruser@252.49.102.64 2024-11-07 00:25:01 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: User clusteruser exists. 2024-11-07 00:25:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Revoke all privileges for use 'clusteruser'@'252.49.107.157' 2024-11-07 00:25:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Grant ALL PRIVILEGES for use 'clusteruser'@'252.49.107.157' 2024-11-07 00:25:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Checking cluster status. 2024-11-07 00:25:02 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Checking cluster status. 2024-11-07 00:25:04 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Opening db connection for clusteruser@252.49.102.64 2024-11-07 00:25:04 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: User clusteruser exists. 2024-11-07 00:25:04 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Revoke all privileges for use 'clusteruser'@'252.49.94.42' 2024-11-07 00:25:04 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Grant ALL PRIVILEGES for use 'clusteruser'@'252.49.94.42' 2024-11-07 00:25:04 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Configuring instances for clustering. 2024-11-07 00:25:04 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Instance: 252.49.107.157, already configured. 2024-11-07 00:25:04 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Instance: 252.49.107.157, already clustered. 2024-11-07 00:25:04 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Instance: 252.49.94.42, already configured. 2024-11-07 00:25:04 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Instance: 252.49.94.42, already clustered. 2024-11-07 00:25:04 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag leadership.changed.cluster-instances-configured 2024-11-07 00:25:04 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Adding instances to cluster. 2024-11-07 00:25:04 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Instance: 252.49.107.157, already clustered. 2024-11-07 00:25:04 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Instance: 252.49.94.42, already clustered. 2024-11-07 00:25:04 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer> tracer: cleared flag endpoint.cluster.changed.unit-configure-ready tracer: -- dequeue handler reactive/mysql_innodb_cluster_handlers.py:353:scale_out 2024-11-07 00:25:04 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Running _assess_status() 2024-11-07 00:25:05 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-11-07 00:25:05 DEBUG unit.mysql-innodb-cluster/1.db-router-relation-joined logger.go:60 active 2024-11-07 00:25:05 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Opening db connection for root@localhost 2024-11-07 00:25:05 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Checking cluster status. 2024-11-07 00:25:06 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Opening db connection for root@None 2024-11-07 00:25:06 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:25:06 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: coordinator.DelayedActionCoordinator Publishing state 2024-11-07 00:25:07 INFO juju.worker.uniter.operation runhook.go:159 ran "db-router-relation-joined" hook (via explicit, bespoke hook script) 2024-11-07 00:25:07 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-joined (37; unit: glance-mysql-router/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:25:07 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-07 00:25:07 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/1 uniter (run relation-joined (37; unit: glance-mysql-router/0) hook) 2024-11-07 00:25:07 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/1 2024-11-07 00:25:07 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:25:07 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 00:25:07 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 00:25:07 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 00:25:07 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 00:25:07 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 00:25:07 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (37; unit: glance-mysql-router/0) hook for mysql-innodb-cluster/1 2024-11-07 00:25:07 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/1 uniter (run relation-changed (37; unit: glance-mysql-router/0) hook) 2024-11-07 00:25:07 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/1 uniter (run relation-changed (37; unit: glance-mysql-router/0) hook) 2024-11-07 00:25:07 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (37; unit: glance-mysql-router/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:25:07 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (37; unit: glance-mysql-router/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:25:07 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running db-router-relation-changed hook for glance-mysql-router/0 2024-11-07 00:25:07 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-1/agent.socket } 2024-11-07 00:25:07 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Reactive main running for hook db-router-relation-changed 2024-11-07 00:25:08 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 00:25:08 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.ssl_cert 2024-11-07 00:25:08 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.ssl_key 2024-11-07 00:25:08 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.ssl_ca 2024-11-07 00:25:08 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.set.source 2024-11-07 00:25:08 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.source 2024-11-07 00:25:08 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.set.cluster-name 2024-11-07 00:25:08 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.cluster-name 2024-11-07 00:25:08 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.set.auto-rejoin-tries 2024-11-07 00:25:08 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.auto-rejoin-tries 2024-11-07 00:25:08 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.set.expel-timeout 2024-11-07 00:25:08 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.expel-timeout 2024-11-07 00:25:08 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.set.innodb-buffer-pool-size 2024-11-07 00:25:08 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.set.innodb-change-buffering 2024-11-07 00:25:08 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.innodb-change-buffering 2024-11-07 00:25:08 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.set.innodb-io-capacity 2024-11-07 00:25:09 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.innodb-io-capacity 2024-11-07 00:25:09 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.set.innodb-file-per-table 2024-11-07 00:25:09 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.innodb-file-per-table 2024-11-07 00:25:09 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.set.tuning-level 2024-11-07 00:25:09 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.tuning-level 2024-11-07 00:25:09 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.set.table-open-cache 2024-11-07 00:25:09 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.table-open-cache 2024-11-07 00:25:09 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.set.max-connections 2024-11-07 00:25:09 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.enable-binlogs 2024-11-07 00:25:09 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.set.binlogs-path 2024-11-07 00:25:09 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.binlogs-path 2024-11-07 00:25:09 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.set.binlogs-max-size 2024-11-07 00:25:09 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.binlogs-max-size 2024-11-07 00:25:09 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.set.binlogs-expire-days 2024-11-07 00:25:09 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.binlogs-expire-days 2024-11-07 00:25:09 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.prefer-ipv6 2024-11-07 00:25:09 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.set.wait-timeout 2024-11-07 00:25:09 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.wait-timeout 2024-11-07 00:25:09 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.os-db-router-hostname 2024-11-07 00:25:09 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Initializing Snap Layer 2024-11-07 00:25:09 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: coordinator.DelayedActionCoordinator Loading state 2024-11-07 00:25:10 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:25:10 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Coordinator: Initializing coordinator layer 2024-11-07 00:25:10 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Initializing Leadership Layer (is leader) 2024-11-07 00:25:10 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag leadership.changed.mysql-mysqlrouteruser.passwd 2024-11-07 00:25:10 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd 2024-11-07 00:25:10 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer> tracer: starting handler dispatch, 85 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.changed tracer: set flag leadership.changed.cluster-instance-clustered-252-49-94-42 tracer: set flag leadership.changed.cluster-instances-clustered tracer: set flag leadership.changed.cluster-instances-configured tracer: set flag leadership.changed.mysql-mysqlrouteruser.passwd tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-49-102-64 tracer: set flag leadership.set.cluster-instance-clustered-252-49-107-157 tracer: set flag leadership.set.cluster-instance-clustered-252-49-94-42 tracer: set flag leadership.set.cluster-instance-configured-252-49-102-64 tracer: set flag leadership.set.cluster-instance-configured-252-49-107-157 tracer: set flag leadership.set.cluster-instance-configured-252-49-94-42 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-11-07 00:25:10 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: hooks phase, 0 handlers queued 2024-11-07 00:25:10 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer> tracer: main dispatch loop, 5 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 00:25:10 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 00:25:10 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Found peers: 252.49.107.157,252.49.94.42 2024-11-07 00:25:10 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Expect 2 peers 2024-11-07 00:25:10 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Reached quorum 2024-11-07 00:25:10 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-11-07 00:25:10 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-11-07 00:25:10 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-11-07 00:25:11 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 00:25:11 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:25:11 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: coordinator.DelayedActionCoordinator Publishing state 2024-11-07 00:25:11 INFO juju.worker.uniter.operation runhook.go:159 ran "db-router-relation-changed" hook (via explicit, bespoke hook script) 2024-11-07 00:25:11 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (37; unit: glance-mysql-router/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:25:11 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-07 00:25:11 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/1 uniter (run relation-changed (37; unit: glance-mysql-router/0) hook) 2024-11-07 00:25:11 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/1 2024-11-07 00:25:11 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:25:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 00:25:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 00:25:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 00:25:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 00:25:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 00:25:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 00:25:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 00:25:11 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 2024-11-07 00:25:11 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for mysql-innodb-cluster/1 : {45 {map[heat-mysql-router/0:{2}] map[] []}} 2024-11-07 00:25:11 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:25:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 00:25:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 00:25:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 00:25:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 00:25:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 00:25:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 00:25:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 00:25:11 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (45; unit: heat-mysql-router/0) hook for mysql-innodb-cluster/1 2024-11-07 00:25:11 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/1 uniter (run relation-changed (45; unit: heat-mysql-router/0) hook) 2024-11-07 00:25:11 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/1 uniter (run relation-changed (45; unit: heat-mysql-router/0) hook) 2024-11-07 00:25:11 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (45; unit: heat-mysql-router/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:25:11 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (45; unit: heat-mysql-router/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:25:11 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running db-router-relation-changed hook for heat-mysql-router/0 2024-11-07 00:25:11 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-1/agent.socket } 2024-11-07 00:25:12 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: Reactive main running for hook db-router-relation-changed 2024-11-07 00:25:12 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer> tracer: set flag endpoint.db-router.changed tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:334:db_router_respond 2024-11-07 00:25:12 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag endpoint.db-router.changed.heat_database 2024-11-07 00:25:12 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag endpoint.db-router.changed.heat_hostname 2024-11-07 00:25:12 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag endpoint.db-router.changed.heat_username 2024-11-07 00:25:12 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.snapd_refresh 2024-11-07 00:25:13 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.ssl_cert 2024-11-07 00:25:13 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.ssl_key 2024-11-07 00:25:13 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.ssl_ca 2024-11-07 00:25:13 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.set.source 2024-11-07 00:25:13 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.source 2024-11-07 00:25:13 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.set.cluster-name 2024-11-07 00:25:13 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.cluster-name 2024-11-07 00:25:13 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.set.auto-rejoin-tries 2024-11-07 00:25:13 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.auto-rejoin-tries 2024-11-07 00:25:13 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.set.expel-timeout 2024-11-07 00:25:13 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.expel-timeout 2024-11-07 00:25:13 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.set.innodb-buffer-pool-size 2024-11-07 00:25:13 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.set.innodb-change-buffering 2024-11-07 00:25:13 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.innodb-change-buffering 2024-11-07 00:25:13 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.set.innodb-io-capacity 2024-11-07 00:25:13 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.innodb-io-capacity 2024-11-07 00:25:13 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.set.innodb-file-per-table 2024-11-07 00:25:13 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.innodb-file-per-table 2024-11-07 00:25:13 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.set.tuning-level 2024-11-07 00:25:13 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.tuning-level 2024-11-07 00:25:13 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.set.table-open-cache 2024-11-07 00:25:13 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.table-open-cache 2024-11-07 00:25:13 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.set.max-connections 2024-11-07 00:25:13 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.enable-binlogs 2024-11-07 00:25:13 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.set.binlogs-path 2024-11-07 00:25:13 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.binlogs-path 2024-11-07 00:25:13 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.set.binlogs-max-size 2024-11-07 00:25:13 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.binlogs-max-size 2024-11-07 00:25:13 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.set.binlogs-expire-days 2024-11-07 00:25:14 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.binlogs-expire-days 2024-11-07 00:25:14 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.prefer-ipv6 2024-11-07 00:25:14 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.set.wait-timeout 2024-11-07 00:25:14 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.wait-timeout 2024-11-07 00:25:14 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: set flag config.default.os-db-router-hostname 2024-11-07 00:25:14 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: Initializing Snap Layer 2024-11-07 00:25:14 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: coordinator.DelayedActionCoordinator Loading state 2024-11-07 00:25:14 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:25:14 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: Coordinator: Initializing coordinator layer 2024-11-07 00:25:14 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: Initializing Leadership Layer (is leader) 2024-11-07 00:25:14 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: cleared flag leadership.changed.cluster-instance-clustered-252-49-94-42 2024-11-07 00:25:14 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: cleared flag leadership.changed.cluster-instances-clustered 2024-11-07 00:25:14 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: cleared flag leadership.changed.cluster-instances-configured 2024-11-07 00:25:14 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: cleared flag leadership.changed.mysql-mysqlrouteruser.passwd 2024-11-07 00:25:14 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: cleared flag leadership.changed 2024-11-07 00:25:14 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer> tracer: starting handler dispatch, 84 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-49-102-64 tracer: set flag leadership.set.cluster-instance-clustered-252-49-107-157 tracer: set flag leadership.set.cluster-instance-clustered-252-49-94-42 tracer: set flag leadership.set.cluster-instance-configured-252-49-102-64 tracer: set flag leadership.set.cluster-instance-configured-252-49-107-157 tracer: set flag leadership.set.cluster-instance-configured-252-49-94-42 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-11-07 00:25:14 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer: hooks phase, 0 handlers queued 2024-11-07 00:25:14 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:334:db_router_respond 2024-11-07 00:25:14 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 00:25:14 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: Found peers: 252.49.107.157,252.49.94.42 2024-11-07 00:25:14 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: Expect 2 peers 2024-11-07 00:25:14 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: Reached quorum 2024-11-07 00:25:14 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:334:db_router_respond 2024-11-07 00:25:14 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: DB router respond 2024-11-07 00:25:14 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: Checking cluster status. 2024-11-07 00:25:16 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: Checking cluster status. 2024-11-07 00:25:17 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: Opening db connection for clusteruser@252.49.102.64 2024-11-07 00:25:17 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: Single hostname provided by relation: 252.49.180.63 2024-11-07 00:25:17 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: DB user mysqlrouteruser already exists. 2024-11-07 00:25:17 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: DB user mysqlrouteruser already exists. 2024-11-07 00:25:17 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: Proactively resetting ssl_ca 2024-11-07 00:25:17 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: Single hostname provided by relation: 252.49.118.130 2024-11-07 00:25:17 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: Generating new password file '/var/lib/charm/mysql-innodb-cluster/mysql-heat.passwd' 2024-11-07 00:25:17 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: Writing file /var/lib/charm/mysql-innodb-cluster/mysql-heat.passwd root:root 660 2024-11-07 00:25:17 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: Opening db connection for root@None 2024-11-07 00:25:17 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for mysql-innodb-cluster/1: ok=true 2024-11-07 00:25:17 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for mysql-innodb-cluster/1 : {35 {map[keystone-mysql-router/0:{2}] map[] []}} 2024-11-07 00:25:17 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: Grant exists for host '252.49.118.130' on db 'heat' 2024-11-07 00:25:17 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: Proactively resetting ssl_ca 2024-11-07 00:25:17 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: Single hostname provided by relation: 252.49.118.130 2024-11-07 00:25:17 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: DB user mysqlrouteruser already exists. 2024-11-07 00:25:17 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: DB user mysqlrouteruser already exists. 2024-11-07 00:25:17 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: Proactively resetting ssl_ca 2024-11-07 00:25:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: DB Router relation created DBs and users. 2024-11-07 00:25:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: tracer> tracer: cleared flag endpoint.db-router.changed tracer: -- dequeue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: -- dequeue handler reactive/mysql_innodb_cluster_handlers.py:334:db_router_respond 2024-11-07 00:25:18 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-11-07 00:25:18 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-11-07 00:25:18 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-11-07 00:25:18 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 00:25:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: Running _assess_status() 2024-11-07 00:25:18 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-11-07 00:25:18 DEBUG unit.mysql-innodb-cluster/1.db-router-relation-changed logger.go:60 active 2024-11-07 00:25:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: Opening db connection for root@localhost 2024-11-07 00:25:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: Checking cluster status. 2024-11-07 00:25:20 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: Opening db connection for root@None 2024-11-07 00:25:20 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:25:20 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:45: coordinator.DelayedActionCoordinator Publishing state 2024-11-07 00:25:20 INFO juju.worker.uniter.operation runhook.go:159 ran "db-router-relation-changed" hook (via explicit, bespoke hook script) 2024-11-07 00:25:20 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (45; unit: heat-mysql-router/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:25:20 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-07 00:25:20 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/1 uniter (run relation-changed (45; unit: heat-mysql-router/0) hook) 2024-11-07 00:25:20 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/1 2024-11-07 00:25:20 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:25:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 00:25:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 00:25:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 00:25:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 00:25:20 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (35; unit: keystone-mysql-router/0) hook for mysql-innodb-cluster/1 2024-11-07 00:25:20 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/1 uniter (run relation-changed (35; unit: keystone-mysql-router/0) hook) 2024-11-07 00:25:20 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/1 uniter (run relation-changed (35; unit: keystone-mysql-router/0) hook) 2024-11-07 00:25:20 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (35; unit: keystone-mysql-router/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:25:20 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (35; unit: keystone-mysql-router/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:25:20 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running db-router-relation-changed hook for keystone-mysql-router/0 2024-11-07 00:25:20 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-1/agent.socket } 2024-11-07 00:25:21 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: Reactive main running for hook db-router-relation-changed 2024-11-07 00:25:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer> tracer: set flag endpoint.db-router.changed tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:334:db_router_respond 2024-11-07 00:25:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag endpoint.db-router.changed.MRUP_database 2024-11-07 00:25:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag endpoint.db-router.changed.MRUP_hostname 2024-11-07 00:25:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag endpoint.db-router.changed.MRUP_username 2024-11-07 00:25:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.snapd_refresh 2024-11-07 00:25:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.ssl_cert 2024-11-07 00:25:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.ssl_key 2024-11-07 00:25:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.ssl_ca 2024-11-07 00:25:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.set.source 2024-11-07 00:25:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.source 2024-11-07 00:25:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.set.cluster-name 2024-11-07 00:25:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.cluster-name 2024-11-07 00:25:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.set.auto-rejoin-tries 2024-11-07 00:25:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.auto-rejoin-tries 2024-11-07 00:25:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.set.expel-timeout 2024-11-07 00:25:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.expel-timeout 2024-11-07 00:25:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.set.innodb-buffer-pool-size 2024-11-07 00:25:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.set.innodb-change-buffering 2024-11-07 00:25:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.innodb-change-buffering 2024-11-07 00:25:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.set.innodb-io-capacity 2024-11-07 00:25:23 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.innodb-io-capacity 2024-11-07 00:25:23 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.set.innodb-file-per-table 2024-11-07 00:25:23 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.innodb-file-per-table 2024-11-07 00:25:23 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.set.tuning-level 2024-11-07 00:25:23 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.tuning-level 2024-11-07 00:25:23 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.set.table-open-cache 2024-11-07 00:25:23 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.table-open-cache 2024-11-07 00:25:23 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.set.max-connections 2024-11-07 00:25:23 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.enable-binlogs 2024-11-07 00:25:23 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.set.binlogs-path 2024-11-07 00:25:23 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.binlogs-path 2024-11-07 00:25:23 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.set.binlogs-max-size 2024-11-07 00:25:23 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.binlogs-max-size 2024-11-07 00:25:23 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.set.binlogs-expire-days 2024-11-07 00:25:23 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.binlogs-expire-days 2024-11-07 00:25:23 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.prefer-ipv6 2024-11-07 00:25:23 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.set.wait-timeout 2024-11-07 00:25:23 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.wait-timeout 2024-11-07 00:25:23 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag config.default.os-db-router-hostname 2024-11-07 00:25:23 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: Initializing Snap Layer 2024-11-07 00:25:23 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: coordinator.DelayedActionCoordinator Loading state 2024-11-07 00:25:23 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:25:23 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: Coordinator: Initializing coordinator layer 2024-11-07 00:25:23 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: Initializing Leadership Layer (is leader) 2024-11-07 00:25:23 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag leadership.changed.mysql-heat.passwd 2024-11-07 00:25:24 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag leadership.set.mysql-heat.passwd 2024-11-07 00:25:24 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: set flag leadership.changed 2024-11-07 00:25:24 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer> tracer: starting handler dispatch, 90 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.changed tracer: set flag leadership.changed.mysql-heat.passwd tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-49-102-64 tracer: set flag leadership.set.cluster-instance-clustered-252-49-107-157 tracer: set flag leadership.set.cluster-instance-clustered-252-49-94-42 tracer: set flag leadership.set.cluster-instance-configured-252-49-102-64 tracer: set flag leadership.set.cluster-instance-configured-252-49-107-157 tracer: set flag leadership.set.cluster-instance-configured-252-49-94-42 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-11-07 00:25:24 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer: hooks phase, 0 handlers queued 2024-11-07 00:25:24 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:334:db_router_respond 2024-11-07 00:25:24 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 00:25:24 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: Found peers: 252.49.107.157,252.49.94.42 2024-11-07 00:25:24 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: Expect 2 peers 2024-11-07 00:25:24 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: Reached quorum 2024-11-07 00:25:24 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:334:db_router_respond 2024-11-07 00:25:24 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: DB router respond 2024-11-07 00:25:24 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: Checking cluster status. 2024-11-07 00:25:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: Checking cluster status. 2024-11-07 00:25:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: Opening db connection for clusteruser@252.49.102.64 2024-11-07 00:25:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: Single hostname provided by relation: 252.49.180.63 2024-11-07 00:25:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: Generating new password file '/var/lib/charm/mysql-innodb-cluster/mysql-keystone.passwd' 2024-11-07 00:25:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: Writing file /var/lib/charm/mysql-innodb-cluster/mysql-keystone.passwd root:root 660 2024-11-07 00:25:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: Opening db connection for root@None 2024-11-07 00:25:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: Grant exists for host '252.49.180.63' on db 'keystone' 2024-11-07 00:25:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: Proactively resetting ssl_ca 2024-11-07 00:25:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: Single hostname provided by relation: 252.49.180.63 2024-11-07 00:25:26 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: DB user mysqlrouteruser already exists. 2024-11-07 00:25:26 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: DB user mysqlrouteruser already exists. 2024-11-07 00:25:26 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for mysql-innodb-cluster/1: ok=true 2024-11-07 00:25:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: Proactively resetting ssl_ca 2024-11-07 00:25:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: Single hostname provided by relation: 252.49.118.130 2024-11-07 00:25:27 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: Grant exists for host '252.49.118.130' on db 'heat' 2024-11-07 00:25:27 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: Proactively resetting ssl_ca 2024-11-07 00:25:27 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: Single hostname provided by relation: 252.49.118.130 2024-11-07 00:25:27 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: DB user mysqlrouteruser already exists. 2024-11-07 00:25:27 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: DB user mysqlrouteruser already exists. 2024-11-07 00:25:27 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: Proactively resetting ssl_ca 2024-11-07 00:25:27 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: DB Router relation created DBs and users. 2024-11-07 00:25:27 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: tracer> tracer: cleared flag endpoint.db-router.changed tracer: -- dequeue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: -- dequeue handler reactive/mysql_innodb_cluster_handlers.py:334:db_router_respond 2024-11-07 00:25:27 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-11-07 00:25:27 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-11-07 00:25:27 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-11-07 00:25:27 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 00:25:27 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: Running _assess_status() 2024-11-07 00:25:28 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-11-07 00:25:28 DEBUG unit.mysql-innodb-cluster/1.db-router-relation-changed logger.go:60 active 2024-11-07 00:25:28 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: Opening db connection for root@localhost 2024-11-07 00:25:28 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: Checking cluster status. 2024-11-07 00:25:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: Opening db connection for root@None 2024-11-07 00:25:29 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:25:29 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:35: coordinator.DelayedActionCoordinator Publishing state 2024-11-07 00:25:29 INFO juju.worker.uniter.operation runhook.go:159 ran "db-router-relation-changed" hook (via explicit, bespoke hook script) 2024-11-07 00:25:29 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (35; unit: keystone-mysql-router/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:25:29 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-07 00:25:29 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/1 uniter (run relation-changed (35; unit: keystone-mysql-router/0) hook) 2024-11-07 00:25:29 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/1 2024-11-07 00:25:29 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:25:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 00:25:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 00:25:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 00:25:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 00:25:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 00:25:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 00:25:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 00:25:29 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 2024-11-07 00:25:29 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:25:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 00:25:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 00:25:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 00:25:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 00:25:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 00:25:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 00:25:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 00:25:34 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for mysql-innodb-cluster/1 : {3 {map[mysql-innodb-cluster/2:{3}] map[] []}} 2024-11-07 00:25:34 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:25:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 00:25:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 00:25:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 00:25:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 00:25:34 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (3; unit: mysql-innodb-cluster/2) hook for mysql-innodb-cluster/1 2024-11-07 00:25:34 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/1 uniter (run relation-changed (3; unit: mysql-innodb-cluster/2) hook) 2024-11-07 00:25:34 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/1 uniter (run relation-changed (3; unit: mysql-innodb-cluster/2) hook) 2024-11-07 00:25:34 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (3; unit: mysql-innodb-cluster/2) hook" for mysql-innodb-cluster/1 2024-11-07 00:25:34 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (3; unit: mysql-innodb-cluster/2) hook" for mysql-innodb-cluster/1 2024-11-07 00:25:34 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running cluster-relation-changed hook for mysql-innodb-cluster/2 2024-11-07 00:25:34 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-1/agent.socket } 2024-11-07 00:25:34 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Reactive main running for hook cluster-relation-changed 2024-11-07 00:25:35 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer> tracer: set flag endpoint.cluster.changed.unit-clustered tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 00:25:35 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.snapd_refresh 2024-11-07 00:25:35 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.ssl_cert 2024-11-07 00:25:35 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.ssl_key 2024-11-07 00:25:35 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.ssl_ca 2024-11-07 00:25:35 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.source 2024-11-07 00:25:35 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.source 2024-11-07 00:25:35 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.cluster-name 2024-11-07 00:25:35 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.cluster-name 2024-11-07 00:25:35 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.auto-rejoin-tries 2024-11-07 00:25:35 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.auto-rejoin-tries 2024-11-07 00:25:35 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.expel-timeout 2024-11-07 00:25:35 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.expel-timeout 2024-11-07 00:25:35 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.innodb-buffer-pool-size 2024-11-07 00:25:35 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.innodb-change-buffering 2024-11-07 00:25:35 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.innodb-change-buffering 2024-11-07 00:25:35 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.innodb-io-capacity 2024-11-07 00:25:35 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.innodb-io-capacity 2024-11-07 00:25:35 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.innodb-file-per-table 2024-11-07 00:25:35 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.innodb-file-per-table 2024-11-07 00:25:35 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.tuning-level 2024-11-07 00:25:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.tuning-level 2024-11-07 00:25:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.table-open-cache 2024-11-07 00:25:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.table-open-cache 2024-11-07 00:25:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.max-connections 2024-11-07 00:25:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.enable-binlogs 2024-11-07 00:25:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.binlogs-path 2024-11-07 00:25:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.binlogs-path 2024-11-07 00:25:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.binlogs-max-size 2024-11-07 00:25:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.binlogs-max-size 2024-11-07 00:25:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.binlogs-expire-days 2024-11-07 00:25:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.binlogs-expire-days 2024-11-07 00:25:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.prefer-ipv6 2024-11-07 00:25:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.set.wait-timeout 2024-11-07 00:25:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.wait-timeout 2024-11-07 00:25:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag config.default.os-db-router-hostname 2024-11-07 00:25:36 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Initializing Snap Layer 2024-11-07 00:25:37 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: coordinator.DelayedActionCoordinator Loading state 2024-11-07 00:25:37 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:25:37 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Coordinator: Initializing coordinator layer 2024-11-07 00:25:37 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Initializing Leadership Layer (is leader) 2024-11-07 00:25:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: cleared flag leadership.changed.mysql-heat.passwd 2024-11-07 00:25:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag leadership.changed.mysql-keystone.passwd 2024-11-07 00:25:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag leadership.set.mysql-keystone.passwd 2024-11-07 00:25:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer> tracer: starting handler dispatch, 91 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.changed tracer: set flag leadership.changed.mysql-keystone.passwd tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-49-102-64 tracer: set flag leadership.set.cluster-instance-clustered-252-49-107-157 tracer: set flag leadership.set.cluster-instance-clustered-252-49-94-42 tracer: set flag leadership.set.cluster-instance-configured-252-49-102-64 tracer: set flag leadership.set.cluster-instance-configured-252-49-107-157 tracer: set flag leadership.set.cluster-instance-configured-252-49-94-42 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-11-07 00:25:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: hooks phase, 0 handlers queued 2024-11-07 00:25:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer> tracer: main dispatch loop, 5 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 00:25:37 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 00:25:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Found peers: 252.49.107.157,252.49.94.42 2024-11-07 00:25:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Expect 2 peers 2024-11-07 00:25:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Reached quorum 2024-11-07 00:25:37 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-11-07 00:25:37 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-11-07 00:25:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: tracer: set flag cluster.clustered 2024-11-07 00:25:37 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-11-07 00:25:37 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 00:25:37 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:25:37 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 cluster:3: coordinator.DelayedActionCoordinator Publishing state 2024-11-07 00:25:38 INFO juju.worker.uniter.operation runhook.go:159 ran "cluster-relation-changed" hook (via explicit, bespoke hook script) 2024-11-07 00:25:38 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (3; unit: mysql-innodb-cluster/2) hook" for mysql-innodb-cluster/1 2024-11-07 00:25:38 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-07 00:25:38 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/1 uniter (run relation-changed (3; unit: mysql-innodb-cluster/2) hook) 2024-11-07 00:25:38 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/1 2024-11-07 00:25:38 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:25:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 00:25:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 00:25:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 00:25:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 00:25:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 00:25:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 00:25:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 00:25:38 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 2024-11-07 00:25:44 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for mysql-innodb-cluster/1 : {37 {map[glance-mysql-router/0:{1}] map[] []}} 2024-11-07 00:25:44 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:25:44 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 00:25:44 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 00:25:44 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 00:25:44 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 00:25:44 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 00:25:44 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 00:25:44 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 00:25:44 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (37; unit: glance-mysql-router/0) hook for mysql-innodb-cluster/1 2024-11-07 00:25:44 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/1 uniter (run relation-changed (37; unit: glance-mysql-router/0) hook) 2024-11-07 00:25:44 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/1 uniter (run relation-changed (37; unit: glance-mysql-router/0) hook) 2024-11-07 00:25:44 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (37; unit: glance-mysql-router/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:25:44 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (37; unit: glance-mysql-router/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:25:44 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running db-router-relation-changed hook for glance-mysql-router/0 2024-11-07 00:25:44 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-1/agent.socket } 2024-11-07 00:25:44 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for mysql-innodb-cluster/1 2024-11-07 00:25:44 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Reactive main running for hook db-router-relation-changed 2024-11-07 00:25:45 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer> tracer: set flag endpoint.db-router.changed tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:334:db_router_respond 2024-11-07 00:25:45 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.snapd_refresh 2024-11-07 00:25:45 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.ssl_cert 2024-11-07 00:25:45 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.ssl_key 2024-11-07 00:25:45 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.ssl_ca 2024-11-07 00:25:45 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.set.source 2024-11-07 00:25:45 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.source 2024-11-07 00:25:45 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.set.cluster-name 2024-11-07 00:25:45 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.cluster-name 2024-11-07 00:25:45 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.set.auto-rejoin-tries 2024-11-07 00:25:45 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.auto-rejoin-tries 2024-11-07 00:25:45 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.set.expel-timeout 2024-11-07 00:25:45 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.expel-timeout 2024-11-07 00:25:45 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.set.innodb-buffer-pool-size 2024-11-07 00:25:46 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.set.innodb-change-buffering 2024-11-07 00:25:46 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.innodb-change-buffering 2024-11-07 00:25:46 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.set.innodb-io-capacity 2024-11-07 00:25:46 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.innodb-io-capacity 2024-11-07 00:25:46 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.set.innodb-file-per-table 2024-11-07 00:25:46 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.innodb-file-per-table 2024-11-07 00:25:46 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.set.tuning-level 2024-11-07 00:25:46 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.tuning-level 2024-11-07 00:25:46 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.set.table-open-cache 2024-11-07 00:25:46 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.table-open-cache 2024-11-07 00:25:46 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.set.max-connections 2024-11-07 00:25:46 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.enable-binlogs 2024-11-07 00:25:46 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.set.binlogs-path 2024-11-07 00:25:46 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.binlogs-path 2024-11-07 00:25:46 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.set.binlogs-max-size 2024-11-07 00:25:46 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.binlogs-max-size 2024-11-07 00:25:46 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.set.binlogs-expire-days 2024-11-07 00:25:46 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.binlogs-expire-days 2024-11-07 00:25:47 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.prefer-ipv6 2024-11-07 00:25:47 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.set.wait-timeout 2024-11-07 00:25:47 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.wait-timeout 2024-11-07 00:25:47 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.os-db-router-hostname 2024-11-07 00:25:47 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Initializing Snap Layer 2024-11-07 00:25:47 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: coordinator.DelayedActionCoordinator Loading state 2024-11-07 00:25:47 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:25:47 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Coordinator: Initializing coordinator layer 2024-11-07 00:25:47 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Initializing Leadership Layer (is leader) 2024-11-07 00:25:47 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: cleared flag leadership.changed.mysql-keystone.passwd 2024-11-07 00:25:47 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: cleared flag leadership.changed 2024-11-07 00:25:47 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer> tracer: starting handler dispatch, 91 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-49-102-64 tracer: set flag leadership.set.cluster-instance-clustered-252-49-107-157 tracer: set flag leadership.set.cluster-instance-clustered-252-49-94-42 tracer: set flag leadership.set.cluster-instance-configured-252-49-102-64 tracer: set flag leadership.set.cluster-instance-configured-252-49-107-157 tracer: set flag leadership.set.cluster-instance-configured-252-49-94-42 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-11-07 00:25:47 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: hooks phase, 0 handlers queued 2024-11-07 00:25:47 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:334:db_router_respond 2024-11-07 00:25:47 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 00:25:47 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Found peers: 252.49.107.157,252.49.94.42 2024-11-07 00:25:47 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Expect 2 peers 2024-11-07 00:25:47 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Reached quorum 2024-11-07 00:25:47 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:334:db_router_respond 2024-11-07 00:25:47 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: DB router respond 2024-11-07 00:25:47 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Checking cluster status. 2024-11-07 00:25:49 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Checking cluster status. 2024-11-07 00:25:50 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Opening db connection for clusteruser@252.49.102.64 2024-11-07 00:25:50 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Single hostname provided by relation: 252.49.180.63 2024-11-07 00:25:50 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Opening db connection for root@None 2024-11-07 00:25:50 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Grant exists for host '252.49.180.63' on db 'keystone' 2024-11-07 00:25:51 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Proactively resetting ssl_ca 2024-11-07 00:25:51 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Single hostname provided by relation: 252.49.180.63 2024-11-07 00:25:51 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: DB user mysqlrouteruser already exists. 2024-11-07 00:25:51 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: DB user mysqlrouteruser already exists. 2024-11-07 00:25:51 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Proactively resetting ssl_ca 2024-11-07 00:25:51 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Single hostname provided by relation: 252.49.232.189 2024-11-07 00:25:51 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: DB user mysqlrouteruser already exists. 2024-11-07 00:25:51 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Proactively resetting ssl_ca 2024-11-07 00:25:51 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Single hostname provided by relation: 252.49.118.130 2024-11-07 00:25:51 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Grant exists for host '252.49.118.130' on db 'heat' 2024-11-07 00:25:51 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Proactively resetting ssl_ca 2024-11-07 00:25:51 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Single hostname provided by relation: 252.49.118.130 2024-11-07 00:25:51 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: DB user mysqlrouteruser already exists. 2024-11-07 00:25:51 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: DB user mysqlrouteruser already exists. 2024-11-07 00:25:51 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Proactively resetting ssl_ca 2024-11-07 00:25:51 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: DB Router relation created DBs and users. 2024-11-07 00:25:51 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer> tracer: cleared flag endpoint.db-router.changed tracer: -- dequeue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: -- dequeue handler reactive/mysql_innodb_cluster_handlers.py:334:db_router_respond 2024-11-07 00:25:51 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-11-07 00:25:51 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-11-07 00:25:51 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-11-07 00:25:51 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 00:25:51 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Running _assess_status() 2024-11-07 00:25:52 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-11-07 00:25:52 DEBUG unit.mysql-innodb-cluster/1.db-router-relation-changed logger.go:60 active 2024-11-07 00:25:52 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Opening db connection for root@localhost 2024-11-07 00:25:52 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Checking cluster status. 2024-11-07 00:25:53 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Opening db connection for root@None 2024-11-07 00:25:53 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:25:53 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: coordinator.DelayedActionCoordinator Publishing state 2024-11-07 00:25:54 INFO juju.worker.uniter.operation runhook.go:159 ran "db-router-relation-changed" hook (via explicit, bespoke hook script) 2024-11-07 00:25:54 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (37; unit: glance-mysql-router/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:25:54 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-07 00:25:54 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/1 uniter (run relation-changed (37; unit: glance-mysql-router/0) hook) 2024-11-07 00:25:54 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/1 2024-11-07 00:25:54 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:25:54 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 00:25:54 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 00:25:54 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 00:25:54 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 00:25:54 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 00:25:54 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 00:25:54 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 00:25:54 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for mysql-innodb-cluster/1 2024-11-07 00:25:54 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 00:25:54 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 00:25:54 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 00:25:54 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 00:25:54 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-1/agent.socket } 2024-11-07 00:25:54 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Reactive main running for hook update-status 2024-11-07 00:25:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 00:25:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_cert 2024-11-07 00:25:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_key 2024-11-07 00:25:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_ca 2024-11-07 00:25:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.source 2024-11-07 00:25:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.source 2024-11-07 00:25:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.cluster-name 2024-11-07 00:25:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.cluster-name 2024-11-07 00:25:56 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.auto-rejoin-tries 2024-11-07 00:25:56 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.auto-rejoin-tries 2024-11-07 00:25:56 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.expel-timeout 2024-11-07 00:25:56 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.expel-timeout 2024-11-07 00:25:56 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-buffer-pool-size 2024-11-07 00:25:56 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-change-buffering 2024-11-07 00:25:56 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-change-buffering 2024-11-07 00:25:56 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-io-capacity 2024-11-07 00:25:56 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-io-capacity 2024-11-07 00:25:56 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-file-per-table 2024-11-07 00:25:56 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-file-per-table 2024-11-07 00:25:56 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.tuning-level 2024-11-07 00:25:56 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.tuning-level 2024-11-07 00:25:56 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.table-open-cache 2024-11-07 00:25:56 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.table-open-cache 2024-11-07 00:25:56 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.max-connections 2024-11-07 00:25:56 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.enable-binlogs 2024-11-07 00:25:56 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-path 2024-11-07 00:25:56 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-path 2024-11-07 00:25:56 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-max-size 2024-11-07 00:25:56 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-max-size 2024-11-07 00:25:56 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-expire-days 2024-11-07 00:25:56 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-expire-days 2024-11-07 00:25:56 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.prefer-ipv6 2024-11-07 00:25:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.wait-timeout 2024-11-07 00:25:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.wait-timeout 2024-11-07 00:25:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.os-db-router-hostname 2024-11-07 00:25:57 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Initializing Snap Layer 2024-11-07 00:25:57 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Loading state 2024-11-07 00:25:57 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:25:57 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Coordinator: Initializing coordinator layer 2024-11-07 00:25:57 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Initializing Leadership Layer (is leader) 2024-11-07 00:25:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: starting handler dispatch, 90 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-49-102-64 tracer: set flag leadership.set.cluster-instance-clustered-252-49-107-157 tracer: set flag leadership.set.cluster-instance-clustered-252-49-94-42 tracer: set flag leadership.set.cluster-instance-configured-252-49-102-64 tracer: set flag leadership.set.cluster-instance-configured-252-49-107-157 tracer: set flag leadership.set.cluster-instance-configured-252-49-94-42 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-11-07 00:25:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:64:default_update_status 2024-11-07 00:25:57 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:64:default_update_status 2024-11-07 00:25:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag run-default-update-status 2024-11-07 00:25:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag is-update-status-hook 2024-11-07 00:25:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:82:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:93:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 00:25:57 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:82:check_really_is_update_status 2024-11-07 00:25:57 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:93:run_default_update_status 2024-11-07 00:25:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:93:run_default_update_status 2024-11-07 00:25:57 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 00:25:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Found peers: 252.49.107.157,252.49.94.42 2024-11-07 00:25:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Expect 2 peers 2024-11-07 00:25:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Reached quorum 2024-11-07 00:25:57 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-11-07 00:25:57 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-11-07 00:25:57 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-11-07 00:25:57 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 00:25:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Running _assess_status() 2024-11-07 00:25:59 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-11-07 00:25:59 DEBUG unit.mysql-innodb-cluster/1.update-status logger.go:60 active 2024-11-07 00:25:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Opening db connection for root@localhost 2024-11-07 00:25:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Checking cluster status. 2024-11-07 00:26:00 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Opening db connection for root@None 2024-11-07 00:26:00 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 00:26:00 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:26:00 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Publishing state 2024-11-07 00:26:00 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-11-07 00:26:01 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 00:26:01 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-07 00:26:01 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 00:26:01 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/1 2024-11-07 00:26:01 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:26:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 00:26:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 00:26:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 00:26:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 00:26:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 00:26:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 00:26:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 00:26:01 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 2024-11-07 00:26:01 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:26:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 00:26:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 00:26:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 00:26:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 00:26:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 00:26:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 00:26:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 00:26:29 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for mysql-innodb-cluster/1 : {37 {map[glance-mysql-router/0:{2}] map[] []}} 2024-11-07 00:26:29 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:26:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 00:26:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 00:26:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 00:26:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 00:26:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 00:26:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 00:26:29 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (37; unit: glance-mysql-router/0) hook for mysql-innodb-cluster/1 2024-11-07 00:26:29 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/1 uniter (run relation-changed (37; unit: glance-mysql-router/0) hook) 2024-11-07 00:26:29 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/1 uniter (run relation-changed (37; unit: glance-mysql-router/0) hook) 2024-11-07 00:26:29 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (37; unit: glance-mysql-router/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:26:29 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (37; unit: glance-mysql-router/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:26:29 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running db-router-relation-changed hook for glance-mysql-router/0 2024-11-07 00:26:29 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-1/agent.socket } 2024-11-07 00:26:29 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Reactive main running for hook db-router-relation-changed 2024-11-07 00:26:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer> tracer: set flag endpoint.db-router.changed tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:334:db_router_respond 2024-11-07 00:26:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.snapd_refresh 2024-11-07 00:26:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.ssl_cert 2024-11-07 00:26:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.ssl_key 2024-11-07 00:26:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.ssl_ca 2024-11-07 00:26:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.set.source 2024-11-07 00:26:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.source 2024-11-07 00:26:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.set.cluster-name 2024-11-07 00:26:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.cluster-name 2024-11-07 00:26:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.set.auto-rejoin-tries 2024-11-07 00:26:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.auto-rejoin-tries 2024-11-07 00:26:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.set.expel-timeout 2024-11-07 00:26:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.expel-timeout 2024-11-07 00:26:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.set.innodb-buffer-pool-size 2024-11-07 00:26:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.set.innodb-change-buffering 2024-11-07 00:26:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.innodb-change-buffering 2024-11-07 00:26:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.set.innodb-io-capacity 2024-11-07 00:26:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.innodb-io-capacity 2024-11-07 00:26:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.set.innodb-file-per-table 2024-11-07 00:26:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.innodb-file-per-table 2024-11-07 00:26:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.set.tuning-level 2024-11-07 00:26:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.tuning-level 2024-11-07 00:26:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.set.table-open-cache 2024-11-07 00:26:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.table-open-cache 2024-11-07 00:26:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.set.max-connections 2024-11-07 00:26:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.enable-binlogs 2024-11-07 00:26:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.set.binlogs-path 2024-11-07 00:26:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.binlogs-path 2024-11-07 00:26:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.set.binlogs-max-size 2024-11-07 00:26:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.binlogs-max-size 2024-11-07 00:26:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.set.binlogs-expire-days 2024-11-07 00:26:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.binlogs-expire-days 2024-11-07 00:26:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.prefer-ipv6 2024-11-07 00:26:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.set.wait-timeout 2024-11-07 00:26:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.wait-timeout 2024-11-07 00:26:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: set flag config.default.os-db-router-hostname 2024-11-07 00:26:31 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Initializing Snap Layer 2024-11-07 00:26:31 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: coordinator.DelayedActionCoordinator Loading state 2024-11-07 00:26:31 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:26:31 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Coordinator: Initializing coordinator layer 2024-11-07 00:26:31 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Initializing Leadership Layer (is leader) 2024-11-07 00:26:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer> tracer: starting handler dispatch, 91 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-49-102-64 tracer: set flag leadership.set.cluster-instance-clustered-252-49-107-157 tracer: set flag leadership.set.cluster-instance-clustered-252-49-94-42 tracer: set flag leadership.set.cluster-instance-configured-252-49-102-64 tracer: set flag leadership.set.cluster-instance-configured-252-49-107-157 tracer: set flag leadership.set.cluster-instance-configured-252-49-94-42 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-11-07 00:26:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer: hooks phase, 0 handlers queued 2024-11-07 00:26:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:334:db_router_respond 2024-11-07 00:26:32 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 00:26:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Found peers: 252.49.107.157,252.49.94.42 2024-11-07 00:26:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Expect 2 peers 2024-11-07 00:26:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Reached quorum 2024-11-07 00:26:32 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:334:db_router_respond 2024-11-07 00:26:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: DB router respond 2024-11-07 00:26:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Checking cluster status. 2024-11-07 00:26:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Checking cluster status. 2024-11-07 00:26:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Opening db connection for clusteruser@252.49.102.64 2024-11-07 00:26:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Single hostname provided by relation: 252.49.180.63 2024-11-07 00:26:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Opening db connection for root@None 2024-11-07 00:26:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Grant exists for host '252.49.180.63' on db 'keystone' 2024-11-07 00:26:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Proactively resetting ssl_ca 2024-11-07 00:26:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Single hostname provided by relation: 252.49.180.63 2024-11-07 00:26:34 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: DB user mysqlrouteruser already exists. 2024-11-07 00:26:34 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: DB user mysqlrouteruser already exists. 2024-11-07 00:26:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Proactively resetting ssl_ca 2024-11-07 00:26:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Single hostname provided by relation: 252.49.232.189 2024-11-07 00:26:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Generating new password file '/var/lib/charm/mysql-innodb-cluster/mysql-glance.passwd' 2024-11-07 00:26:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Writing file /var/lib/charm/mysql-innodb-cluster/mysql-glance.passwd root:root 660 2024-11-07 00:26:35 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Grant exists for host '252.49.232.189' on db 'glance' 2024-11-07 00:26:35 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Proactively resetting ssl_ca 2024-11-07 00:26:35 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Single hostname provided by relation: 252.49.232.189 2024-11-07 00:26:35 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: DB user mysqlrouteruser already exists. 2024-11-07 00:26:35 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: DB user mysqlrouteruser already exists. 2024-11-07 00:26:35 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Proactively resetting ssl_ca 2024-11-07 00:26:35 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Single hostname provided by relation: 252.49.118.130 2024-11-07 00:26:35 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Grant exists for host '252.49.118.130' on db 'heat' 2024-11-07 00:26:35 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Proactively resetting ssl_ca 2024-11-07 00:26:35 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Single hostname provided by relation: 252.49.118.130 2024-11-07 00:26:35 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: DB user mysqlrouteruser already exists. 2024-11-07 00:26:35 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: DB user mysqlrouteruser already exists. 2024-11-07 00:26:35 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for mysql-innodb-cluster/1: ok=true 2024-11-07 00:26:35 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Proactively resetting ssl_ca 2024-11-07 00:26:35 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: DB Router relation created DBs and users. 2024-11-07 00:26:35 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: tracer> tracer: cleared flag endpoint.db-router.changed tracer: -- dequeue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: -- dequeue handler reactive/mysql_innodb_cluster_handlers.py:334:db_router_respond 2024-11-07 00:26:35 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-11-07 00:26:35 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-11-07 00:26:35 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-11-07 00:26:35 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 00:26:35 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Running _assess_status() 2024-11-07 00:26:36 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-11-07 00:26:36 DEBUG unit.mysql-innodb-cluster/1.db-router-relation-changed logger.go:60 active 2024-11-07 00:26:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Opening db connection for root@localhost 2024-11-07 00:26:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Checking cluster status. 2024-11-07 00:26:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: Opening db connection for root@None 2024-11-07 00:26:37 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:26:37 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:37: coordinator.DelayedActionCoordinator Publishing state 2024-11-07 00:26:37 INFO juju.worker.uniter.operation runhook.go:159 ran "db-router-relation-changed" hook (via explicit, bespoke hook script) 2024-11-07 00:26:37 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (37; unit: glance-mysql-router/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:26:37 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-07 00:26:37 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/1 uniter (run relation-changed (37; unit: glance-mysql-router/0) hook) 2024-11-07 00:26:37 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/1 2024-11-07 00:26:37 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:26:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 00:26:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 00:26:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 00:26:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 00:26:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 00:26:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 00:26:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 00:26:37 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 2024-11-07 00:26:38 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:26:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 00:26:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 00:26:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 00:26:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 00:26:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 00:26:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 00:26:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 00:27:28 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for mysql-innodb-cluster/1 : {43 {map[dashboard-mysql-router/0:{0}] map[] []}} 2024-11-07 00:27:28 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:27:28 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 00:27:28 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 00:27:28 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-joined (43; unit: dashboard-mysql-router/0) hook for mysql-innodb-cluster/1 2024-11-07 00:27:28 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/1 uniter (run relation-joined (43; unit: dashboard-mysql-router/0) hook) 2024-11-07 00:27:28 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/1 uniter (run relation-joined (43; unit: dashboard-mysql-router/0) hook) 2024-11-07 00:27:28 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-joined (43; unit: dashboard-mysql-router/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:27:28 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-joined (43; unit: dashboard-mysql-router/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:27:28 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running db-router-relation-joined hook for dashboard-mysql-router/0 2024-11-07 00:27:28 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-1/agent.socket } 2024-11-07 00:27:28 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Reactive main running for hook db-router-relation-joined 2024-11-07 00:27:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer> tracer: set flag endpoint.db-router.changed tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:334:db_router_respond 2024-11-07 00:27:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.snapd_refresh 2024-11-07 00:27:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.ssl_cert 2024-11-07 00:27:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.ssl_key 2024-11-07 00:27:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.ssl_ca 2024-11-07 00:27:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.set.source 2024-11-07 00:27:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.source 2024-11-07 00:27:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.set.cluster-name 2024-11-07 00:27:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.cluster-name 2024-11-07 00:27:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.set.auto-rejoin-tries 2024-11-07 00:27:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.auto-rejoin-tries 2024-11-07 00:27:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.set.expel-timeout 2024-11-07 00:27:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.expel-timeout 2024-11-07 00:27:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.set.innodb-buffer-pool-size 2024-11-07 00:27:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.set.innodb-change-buffering 2024-11-07 00:27:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.innodb-change-buffering 2024-11-07 00:27:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.set.innodb-io-capacity 2024-11-07 00:27:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.innodb-io-capacity 2024-11-07 00:27:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.set.innodb-file-per-table 2024-11-07 00:27:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.innodb-file-per-table 2024-11-07 00:27:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.set.tuning-level 2024-11-07 00:27:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.tuning-level 2024-11-07 00:27:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.set.table-open-cache 2024-11-07 00:27:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.table-open-cache 2024-11-07 00:27:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.set.max-connections 2024-11-07 00:27:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.enable-binlogs 2024-11-07 00:27:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.set.binlogs-path 2024-11-07 00:27:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.binlogs-path 2024-11-07 00:27:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.set.binlogs-max-size 2024-11-07 00:27:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.binlogs-max-size 2024-11-07 00:27:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.set.binlogs-expire-days 2024-11-07 00:27:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.binlogs-expire-days 2024-11-07 00:27:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.prefer-ipv6 2024-11-07 00:27:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.set.wait-timeout 2024-11-07 00:27:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.wait-timeout 2024-11-07 00:27:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.os-db-router-hostname 2024-11-07 00:27:30 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Initializing Snap Layer 2024-11-07 00:27:30 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: coordinator.DelayedActionCoordinator Loading state 2024-11-07 00:27:30 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:27:30 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Coordinator: Initializing coordinator layer 2024-11-07 00:27:30 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Initializing Leadership Layer (is leader) 2024-11-07 00:27:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag leadership.changed.mysql-glance.passwd 2024-11-07 00:27:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag leadership.set.mysql-glance.passwd 2024-11-07 00:27:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag leadership.changed 2024-11-07 00:27:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer> tracer: starting handler dispatch, 94 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.changed tracer: set flag leadership.changed.mysql-glance.passwd tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-49-102-64 tracer: set flag leadership.set.cluster-instance-clustered-252-49-107-157 tracer: set flag leadership.set.cluster-instance-clustered-252-49-94-42 tracer: set flag leadership.set.cluster-instance-configured-252-49-102-64 tracer: set flag leadership.set.cluster-instance-configured-252-49-107-157 tracer: set flag leadership.set.cluster-instance-configured-252-49-94-42 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-11-07 00:27:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: hooks phase, 0 handlers queued 2024-11-07 00:27:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:334:db_router_respond 2024-11-07 00:27:30 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 00:27:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Found peers: 252.49.107.157,252.49.94.42 2024-11-07 00:27:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Expect 2 peers 2024-11-07 00:27:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Reached quorum 2024-11-07 00:27:30 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:334:db_router_respond 2024-11-07 00:27:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: DB router respond 2024-11-07 00:27:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Checking cluster status. 2024-11-07 00:27:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Checking cluster status. 2024-11-07 00:27:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Opening db connection for clusteruser@252.49.102.64 2024-11-07 00:27:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Single hostname provided by relation: 252.49.180.63 2024-11-07 00:27:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Opening db connection for root@None 2024-11-07 00:27:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Grant exists for host '252.49.180.63' on db 'keystone' 2024-11-07 00:27:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Proactively resetting ssl_ca 2024-11-07 00:27:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Single hostname provided by relation: 252.49.180.63 2024-11-07 00:27:33 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: DB user mysqlrouteruser already exists. 2024-11-07 00:27:33 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: DB user mysqlrouteruser already exists. 2024-11-07 00:27:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Proactively resetting ssl_ca 2024-11-07 00:27:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Single hostname provided by relation: 252.49.232.189 2024-11-07 00:27:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Grant exists for host '252.49.232.189' on db 'glance' 2024-11-07 00:27:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Proactively resetting ssl_ca 2024-11-07 00:27:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Single hostname provided by relation: 252.49.232.189 2024-11-07 00:27:33 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: DB user mysqlrouteruser already exists. 2024-11-07 00:27:33 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: DB user mysqlrouteruser already exists. 2024-11-07 00:27:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Proactively resetting ssl_ca 2024-11-07 00:27:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Single hostname provided by relation: 252.49.118.130 2024-11-07 00:27:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Grant exists for host '252.49.118.130' on db 'heat' 2024-11-07 00:27:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Proactively resetting ssl_ca 2024-11-07 00:27:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Single hostname provided by relation: 252.49.118.130 2024-11-07 00:27:33 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: DB user mysqlrouteruser already exists. 2024-11-07 00:27:33 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: DB user mysqlrouteruser already exists. 2024-11-07 00:27:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Proactively resetting ssl_ca 2024-11-07 00:27:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: DB Router relation created DBs and users. 2024-11-07 00:27:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer> tracer: cleared flag endpoint.db-router.changed tracer: -- dequeue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: -- dequeue handler reactive/mysql_innodb_cluster_handlers.py:334:db_router_respond 2024-11-07 00:27:34 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-11-07 00:27:34 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-11-07 00:27:34 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-11-07 00:27:34 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 00:27:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Running _assess_status() 2024-11-07 00:27:34 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-11-07 00:27:34 DEBUG unit.mysql-innodb-cluster/1.db-router-relation-joined logger.go:60 active 2024-11-07 00:27:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Opening db connection for root@localhost 2024-11-07 00:27:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Checking cluster status. 2024-11-07 00:27:35 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Opening db connection for root@None 2024-11-07 00:27:35 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:27:35 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: coordinator.DelayedActionCoordinator Publishing state 2024-11-07 00:27:36 INFO juju.worker.uniter.operation runhook.go:159 ran "db-router-relation-joined" hook (via explicit, bespoke hook script) 2024-11-07 00:27:36 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-joined (43; unit: dashboard-mysql-router/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:27:36 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-07 00:27:36 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/1 uniter (run relation-joined (43; unit: dashboard-mysql-router/0) hook) 2024-11-07 00:27:36 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/1 2024-11-07 00:27:36 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:27:36 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (43; unit: dashboard-mysql-router/0) hook for mysql-innodb-cluster/1 2024-11-07 00:27:36 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/1 uniter (run relation-changed (43; unit: dashboard-mysql-router/0) hook) 2024-11-07 00:27:36 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/1 uniter (run relation-changed (43; unit: dashboard-mysql-router/0) hook) 2024-11-07 00:27:36 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (43; unit: dashboard-mysql-router/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:27:36 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (43; unit: dashboard-mysql-router/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:27:36 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running db-router-relation-changed hook for dashboard-mysql-router/0 2024-11-07 00:27:36 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-1/agent.socket } 2024-11-07 00:27:36 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Reactive main running for hook db-router-relation-changed 2024-11-07 00:27:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 00:27:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.ssl_cert 2024-11-07 00:27:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.ssl_key 2024-11-07 00:27:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.ssl_ca 2024-11-07 00:27:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.set.source 2024-11-07 00:27:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.source 2024-11-07 00:27:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.set.cluster-name 2024-11-07 00:27:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.cluster-name 2024-11-07 00:27:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.set.auto-rejoin-tries 2024-11-07 00:27:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.auto-rejoin-tries 2024-11-07 00:27:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.set.expel-timeout 2024-11-07 00:27:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.expel-timeout 2024-11-07 00:27:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.set.innodb-buffer-pool-size 2024-11-07 00:27:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.set.innodb-change-buffering 2024-11-07 00:27:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.innodb-change-buffering 2024-11-07 00:27:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.set.innodb-io-capacity 2024-11-07 00:27:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.innodb-io-capacity 2024-11-07 00:27:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.set.innodb-file-per-table 2024-11-07 00:27:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.innodb-file-per-table 2024-11-07 00:27:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.set.tuning-level 2024-11-07 00:27:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.tuning-level 2024-11-07 00:27:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.set.table-open-cache 2024-11-07 00:27:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.table-open-cache 2024-11-07 00:27:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.set.max-connections 2024-11-07 00:27:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.enable-binlogs 2024-11-07 00:27:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.set.binlogs-path 2024-11-07 00:27:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.binlogs-path 2024-11-07 00:27:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.set.binlogs-max-size 2024-11-07 00:27:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.binlogs-max-size 2024-11-07 00:27:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.set.binlogs-expire-days 2024-11-07 00:27:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.binlogs-expire-days 2024-11-07 00:27:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.prefer-ipv6 2024-11-07 00:27:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.set.wait-timeout 2024-11-07 00:27:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.wait-timeout 2024-11-07 00:27:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.os-db-router-hostname 2024-11-07 00:27:38 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Initializing Snap Layer 2024-11-07 00:27:38 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: coordinator.DelayedActionCoordinator Loading state 2024-11-07 00:27:38 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:27:38 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Coordinator: Initializing coordinator layer 2024-11-07 00:27:38 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Initializing Leadership Layer (is leader) 2024-11-07 00:27:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: cleared flag leadership.changed.mysql-glance.passwd 2024-11-07 00:27:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: cleared flag leadership.changed 2024-11-07 00:27:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer> tracer: starting handler dispatch, 91 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-49-102-64 tracer: set flag leadership.set.cluster-instance-clustered-252-49-107-157 tracer: set flag leadership.set.cluster-instance-clustered-252-49-94-42 tracer: set flag leadership.set.cluster-instance-configured-252-49-102-64 tracer: set flag leadership.set.cluster-instance-configured-252-49-107-157 tracer: set flag leadership.set.cluster-instance-configured-252-49-94-42 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-11-07 00:27:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: hooks phase, 0 handlers queued 2024-11-07 00:27:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer> tracer: main dispatch loop, 5 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 00:27:38 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 00:27:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Found peers: 252.49.107.157,252.49.94.42 2024-11-07 00:27:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Expect 2 peers 2024-11-07 00:27:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Reached quorum 2024-11-07 00:27:38 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-11-07 00:27:38 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-11-07 00:27:38 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-11-07 00:27:38 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 00:27:38 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:27:38 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: coordinator.DelayedActionCoordinator Publishing state 2024-11-07 00:27:39 INFO juju.worker.uniter.operation runhook.go:159 ran "db-router-relation-changed" hook (via explicit, bespoke hook script) 2024-11-07 00:27:39 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (43; unit: dashboard-mysql-router/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:27:39 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-07 00:27:39 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/1 uniter (run relation-changed (43; unit: dashboard-mysql-router/0) hook) 2024-11-07 00:27:39 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/1 2024-11-07 00:27:39 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:27:39 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 00:27:39 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 00:27:39 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 00:27:39 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 00:27:39 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 00:27:39 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 00:27:39 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 00:27:39 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-11-07 00:27:39 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 2024-11-07 00:27:54 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for mysql-innodb-cluster/1 : {41 {map[neutron-mysql-router/0:{0}] map[] []}} 2024-11-07 00:27:54 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:27:54 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 00:27:54 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 00:27:54 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-11-07 00:27:54 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 00:27:54 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 00:27:54 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 00:27:54 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 00:27:54 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-joined (41; unit: neutron-mysql-router/0) hook for mysql-innodb-cluster/1 2024-11-07 00:27:54 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/1 uniter (run relation-joined (41; unit: neutron-mysql-router/0) hook) 2024-11-07 00:27:54 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/1 uniter (run relation-joined (41; unit: neutron-mysql-router/0) hook) 2024-11-07 00:27:54 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-joined (41; unit: neutron-mysql-router/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:27:54 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-joined (41; unit: neutron-mysql-router/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:27:54 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running db-router-relation-joined hook for neutron-mysql-router/0 2024-11-07 00:27:54 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-1/agent.socket } 2024-11-07 00:27:55 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Reactive main running for hook db-router-relation-joined 2024-11-07 00:27:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer> tracer: set flag endpoint.db-router.changed tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:334:db_router_respond 2024-11-07 00:27:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.snapd_refresh 2024-11-07 00:27:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.ssl_cert 2024-11-07 00:27:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.ssl_key 2024-11-07 00:27:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.ssl_ca 2024-11-07 00:27:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.set.source 2024-11-07 00:27:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.source 2024-11-07 00:27:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.set.cluster-name 2024-11-07 00:27:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.cluster-name 2024-11-07 00:27:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.set.auto-rejoin-tries 2024-11-07 00:27:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.auto-rejoin-tries 2024-11-07 00:27:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.set.expel-timeout 2024-11-07 00:27:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.expel-timeout 2024-11-07 00:27:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.set.innodb-buffer-pool-size 2024-11-07 00:27:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.set.innodb-change-buffering 2024-11-07 00:27:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.innodb-change-buffering 2024-11-07 00:27:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.set.innodb-io-capacity 2024-11-07 00:27:56 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.innodb-io-capacity 2024-11-07 00:27:56 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.set.innodb-file-per-table 2024-11-07 00:27:56 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.innodb-file-per-table 2024-11-07 00:27:56 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.set.tuning-level 2024-11-07 00:27:56 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.tuning-level 2024-11-07 00:27:56 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.set.table-open-cache 2024-11-07 00:27:56 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.table-open-cache 2024-11-07 00:27:56 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.set.max-connections 2024-11-07 00:27:56 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.enable-binlogs 2024-11-07 00:27:56 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.set.binlogs-path 2024-11-07 00:27:56 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.binlogs-path 2024-11-07 00:27:56 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.set.binlogs-max-size 2024-11-07 00:27:56 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.binlogs-max-size 2024-11-07 00:27:56 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.set.binlogs-expire-days 2024-11-07 00:27:56 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.binlogs-expire-days 2024-11-07 00:27:56 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.prefer-ipv6 2024-11-07 00:27:56 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.set.wait-timeout 2024-11-07 00:27:56 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.wait-timeout 2024-11-07 00:27:56 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.os-db-router-hostname 2024-11-07 00:27:56 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Initializing Snap Layer 2024-11-07 00:27:56 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: coordinator.DelayedActionCoordinator Loading state 2024-11-07 00:27:56 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:27:56 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Coordinator: Initializing coordinator layer 2024-11-07 00:27:56 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Initializing Leadership Layer (is leader) 2024-11-07 00:27:56 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer> tracer: starting handler dispatch, 92 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-49-102-64 tracer: set flag leadership.set.cluster-instance-clustered-252-49-107-157 tracer: set flag leadership.set.cluster-instance-clustered-252-49-94-42 tracer: set flag leadership.set.cluster-instance-configured-252-49-102-64 tracer: set flag leadership.set.cluster-instance-configured-252-49-107-157 tracer: set flag leadership.set.cluster-instance-configured-252-49-94-42 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-11-07 00:27:56 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: hooks phase, 0 handlers queued 2024-11-07 00:27:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:334:db_router_respond 2024-11-07 00:27:57 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 00:27:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Found peers: 252.49.107.157,252.49.94.42 2024-11-07 00:27:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Expect 2 peers 2024-11-07 00:27:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Reached quorum 2024-11-07 00:27:57 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:334:db_router_respond 2024-11-07 00:27:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: DB router respond 2024-11-07 00:27:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Checking cluster status. 2024-11-07 00:27:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Checking cluster status. 2024-11-07 00:27:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Opening db connection for clusteruser@252.49.102.64 2024-11-07 00:27:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Single hostname provided by relation: 252.49.180.63 2024-11-07 00:27:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Opening db connection for root@None 2024-11-07 00:27:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Grant exists for host '252.49.180.63' on db 'keystone' 2024-11-07 00:27:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Proactively resetting ssl_ca 2024-11-07 00:27:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Single hostname provided by relation: 252.49.180.63 2024-11-07 00:27:59 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: DB user mysqlrouteruser already exists. 2024-11-07 00:27:59 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: DB user mysqlrouteruser already exists. 2024-11-07 00:27:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Proactively resetting ssl_ca 2024-11-07 00:27:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Single hostname provided by relation: 252.49.232.189 2024-11-07 00:27:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Grant exists for host '252.49.232.189' on db 'glance' 2024-11-07 00:27:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Proactively resetting ssl_ca 2024-11-07 00:27:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Single hostname provided by relation: 252.49.232.189 2024-11-07 00:27:59 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: DB user mysqlrouteruser already exists. 2024-11-07 00:27:59 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: DB user mysqlrouteruser already exists. 2024-11-07 00:27:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Proactively resetting ssl_ca 2024-11-07 00:27:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Single hostname provided by relation: 252.49.118.130 2024-11-07 00:27:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Grant exists for host '252.49.118.130' on db 'heat' 2024-11-07 00:27:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Proactively resetting ssl_ca 2024-11-07 00:27:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Single hostname provided by relation: 252.49.118.130 2024-11-07 00:27:59 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: DB user mysqlrouteruser already exists. 2024-11-07 00:27:59 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: DB user mysqlrouteruser already exists. 2024-11-07 00:27:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Proactively resetting ssl_ca 2024-11-07 00:27:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: DB Router relation created DBs and users. 2024-11-07 00:27:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer> tracer: cleared flag endpoint.db-router.changed tracer: -- dequeue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: -- dequeue handler reactive/mysql_innodb_cluster_handlers.py:334:db_router_respond 2024-11-07 00:27:59 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-11-07 00:27:59 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-11-07 00:27:59 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-11-07 00:27:59 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 00:27:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Running _assess_status() 2024-11-07 00:27:59 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-11-07 00:28:00 DEBUG unit.mysql-innodb-cluster/1.db-router-relation-joined logger.go:60 active 2024-11-07 00:28:00 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Opening db connection for root@localhost 2024-11-07 00:28:00 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Checking cluster status. 2024-11-07 00:28:00 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Opening db connection for root@None 2024-11-07 00:28:00 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:28:00 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: coordinator.DelayedActionCoordinator Publishing state 2024-11-07 00:28:01 INFO juju.worker.uniter.operation runhook.go:159 ran "db-router-relation-joined" hook (via explicit, bespoke hook script) 2024-11-07 00:28:01 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-joined (41; unit: neutron-mysql-router/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:28:01 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-07 00:28:01 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/1 uniter (run relation-joined (41; unit: neutron-mysql-router/0) hook) 2024-11-07 00:28:01 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/1 2024-11-07 00:28:01 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:28:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 00:28:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 00:28:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 00:28:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 00:28:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 00:28:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 00:28:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 00:28:01 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (41; unit: neutron-mysql-router/0) hook for mysql-innodb-cluster/1 2024-11-07 00:28:01 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/1 uniter (run relation-changed (41; unit: neutron-mysql-router/0) hook) 2024-11-07 00:28:01 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/1 uniter (run relation-changed (41; unit: neutron-mysql-router/0) hook) 2024-11-07 00:28:01 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (41; unit: neutron-mysql-router/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:28:01 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (41; unit: neutron-mysql-router/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:28:01 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running db-router-relation-changed hook for neutron-mysql-router/0 2024-11-07 00:28:01 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-1/agent.socket } 2024-11-07 00:28:02 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Reactive main running for hook db-router-relation-changed 2024-11-07 00:28:02 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 00:28:02 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.ssl_cert 2024-11-07 00:28:02 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.ssl_key 2024-11-07 00:28:02 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.ssl_ca 2024-11-07 00:28:02 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.set.source 2024-11-07 00:28:02 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.source 2024-11-07 00:28:02 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.set.cluster-name 2024-11-07 00:28:02 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.cluster-name 2024-11-07 00:28:02 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.set.auto-rejoin-tries 2024-11-07 00:28:02 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.auto-rejoin-tries 2024-11-07 00:28:02 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.set.expel-timeout 2024-11-07 00:28:02 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.expel-timeout 2024-11-07 00:28:02 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.set.innodb-buffer-pool-size 2024-11-07 00:28:02 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.set.innodb-change-buffering 2024-11-07 00:28:02 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.innodb-change-buffering 2024-11-07 00:28:02 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.set.innodb-io-capacity 2024-11-07 00:28:02 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.innodb-io-capacity 2024-11-07 00:28:02 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.set.innodb-file-per-table 2024-11-07 00:28:02 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.innodb-file-per-table 2024-11-07 00:28:02 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.set.tuning-level 2024-11-07 00:28:02 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.tuning-level 2024-11-07 00:28:02 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.set.table-open-cache 2024-11-07 00:28:02 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.table-open-cache 2024-11-07 00:28:03 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.set.max-connections 2024-11-07 00:28:03 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.enable-binlogs 2024-11-07 00:28:03 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.set.binlogs-path 2024-11-07 00:28:03 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.binlogs-path 2024-11-07 00:28:03 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.set.binlogs-max-size 2024-11-07 00:28:03 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.binlogs-max-size 2024-11-07 00:28:03 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.set.binlogs-expire-days 2024-11-07 00:28:03 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.binlogs-expire-days 2024-11-07 00:28:03 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.prefer-ipv6 2024-11-07 00:28:03 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.set.wait-timeout 2024-11-07 00:28:03 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.wait-timeout 2024-11-07 00:28:03 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.os-db-router-hostname 2024-11-07 00:28:03 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Initializing Snap Layer 2024-11-07 00:28:03 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: coordinator.DelayedActionCoordinator Loading state 2024-11-07 00:28:03 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for mysql-innodb-cluster/1 : {43 {map[dashboard-mysql-router/0:{1}] map[] []}} 2024-11-07 00:28:03 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:28:03 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Coordinator: Initializing coordinator layer 2024-11-07 00:28:03 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Initializing Leadership Layer (is leader) 2024-11-07 00:28:03 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer> tracer: starting handler dispatch, 91 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-49-102-64 tracer: set flag leadership.set.cluster-instance-clustered-252-49-107-157 tracer: set flag leadership.set.cluster-instance-clustered-252-49-94-42 tracer: set flag leadership.set.cluster-instance-configured-252-49-102-64 tracer: set flag leadership.set.cluster-instance-configured-252-49-107-157 tracer: set flag leadership.set.cluster-instance-configured-252-49-94-42 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-11-07 00:28:03 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: hooks phase, 0 handlers queued 2024-11-07 00:28:03 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer> tracer: main dispatch loop, 5 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 00:28:03 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 00:28:03 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Found peers: 252.49.107.157,252.49.94.42 2024-11-07 00:28:03 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Expect 2 peers 2024-11-07 00:28:03 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Reached quorum 2024-11-07 00:28:03 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-11-07 00:28:03 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-11-07 00:28:03 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-11-07 00:28:03 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 00:28:03 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:28:03 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: coordinator.DelayedActionCoordinator Publishing state 2024-11-07 00:28:04 INFO juju.worker.uniter.operation runhook.go:159 ran "db-router-relation-changed" hook (via explicit, bespoke hook script) 2024-11-07 00:28:04 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (41; unit: neutron-mysql-router/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:28:04 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-07 00:28:04 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/1 uniter (run relation-changed (41; unit: neutron-mysql-router/0) hook) 2024-11-07 00:28:04 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/1 2024-11-07 00:28:04 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:28:04 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 00:28:04 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 00:28:04 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 00:28:04 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 00:28:04 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 00:28:04 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 00:28:04 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-11-07 00:28:04 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 00:28:04 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-11-07 00:28:04 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (43; unit: dashboard-mysql-router/0) hook for mysql-innodb-cluster/1 2024-11-07 00:28:04 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/1 uniter (run relation-changed (43; unit: dashboard-mysql-router/0) hook) 2024-11-07 00:28:04 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/1 uniter (run relation-changed (43; unit: dashboard-mysql-router/0) hook) 2024-11-07 00:28:04 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (43; unit: dashboard-mysql-router/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:28:04 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (43; unit: dashboard-mysql-router/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:28:04 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running db-router-relation-changed hook for dashboard-mysql-router/0 2024-11-07 00:28:04 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-1/agent.socket } 2024-11-07 00:28:05 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Reactive main running for hook db-router-relation-changed 2024-11-07 00:28:05 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer> tracer: set flag endpoint.db-router.changed tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:334:db_router_respond 2024-11-07 00:28:05 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.snapd_refresh 2024-11-07 00:28:05 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.ssl_cert 2024-11-07 00:28:05 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.ssl_key 2024-11-07 00:28:05 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.ssl_ca 2024-11-07 00:28:05 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.set.source 2024-11-07 00:28:05 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.source 2024-11-07 00:28:05 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.set.cluster-name 2024-11-07 00:28:05 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.cluster-name 2024-11-07 00:28:05 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.set.auto-rejoin-tries 2024-11-07 00:28:05 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.auto-rejoin-tries 2024-11-07 00:28:05 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.set.expel-timeout 2024-11-07 00:28:05 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.expel-timeout 2024-11-07 00:28:05 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.set.innodb-buffer-pool-size 2024-11-07 00:28:05 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.set.innodb-change-buffering 2024-11-07 00:28:06 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.innodb-change-buffering 2024-11-07 00:28:06 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.set.innodb-io-capacity 2024-11-07 00:28:06 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.innodb-io-capacity 2024-11-07 00:28:06 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.set.innodb-file-per-table 2024-11-07 00:28:06 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.innodb-file-per-table 2024-11-07 00:28:06 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.set.tuning-level 2024-11-07 00:28:06 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.tuning-level 2024-11-07 00:28:06 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.set.table-open-cache 2024-11-07 00:28:06 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.table-open-cache 2024-11-07 00:28:06 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.set.max-connections 2024-11-07 00:28:06 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.enable-binlogs 2024-11-07 00:28:06 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.set.binlogs-path 2024-11-07 00:28:06 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.binlogs-path 2024-11-07 00:28:06 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.set.binlogs-max-size 2024-11-07 00:28:06 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.binlogs-max-size 2024-11-07 00:28:06 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.set.binlogs-expire-days 2024-11-07 00:28:06 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.binlogs-expire-days 2024-11-07 00:28:06 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.prefer-ipv6 2024-11-07 00:28:06 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.set.wait-timeout 2024-11-07 00:28:06 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.wait-timeout 2024-11-07 00:28:06 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.os-db-router-hostname 2024-11-07 00:28:06 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Initializing Snap Layer 2024-11-07 00:28:06 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: coordinator.DelayedActionCoordinator Loading state 2024-11-07 00:28:06 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:28:06 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Coordinator: Initializing coordinator layer 2024-11-07 00:28:06 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Initializing Leadership Layer (is leader) 2024-11-07 00:28:07 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer> tracer: starting handler dispatch, 92 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-49-102-64 tracer: set flag leadership.set.cluster-instance-clustered-252-49-107-157 tracer: set flag leadership.set.cluster-instance-clustered-252-49-94-42 tracer: set flag leadership.set.cluster-instance-configured-252-49-102-64 tracer: set flag leadership.set.cluster-instance-configured-252-49-107-157 tracer: set flag leadership.set.cluster-instance-configured-252-49-94-42 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-11-07 00:28:07 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: hooks phase, 0 handlers queued 2024-11-07 00:28:07 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:334:db_router_respond 2024-11-07 00:28:07 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 00:28:07 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Found peers: 252.49.107.157,252.49.94.42 2024-11-07 00:28:07 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Expect 2 peers 2024-11-07 00:28:07 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Reached quorum 2024-11-07 00:28:07 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:334:db_router_respond 2024-11-07 00:28:07 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: DB router respond 2024-11-07 00:28:07 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Checking cluster status. 2024-11-07 00:28:08 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Checking cluster status. 2024-11-07 00:28:08 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Opening db connection for clusteruser@252.49.102.64 2024-11-07 00:28:08 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Single hostname provided by relation: 252.49.180.63 2024-11-07 00:28:08 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Opening db connection for root@None 2024-11-07 00:28:08 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Grant exists for host '252.49.180.63' on db 'keystone' 2024-11-07 00:28:08 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Proactively resetting ssl_ca 2024-11-07 00:28:08 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Single hostname provided by relation: 252.49.180.63 2024-11-07 00:28:08 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: DB user mysqlrouteruser already exists. 2024-11-07 00:28:08 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: DB user mysqlrouteruser already exists. 2024-11-07 00:28:08 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Proactively resetting ssl_ca 2024-11-07 00:28:08 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Single hostname provided by relation: 252.49.232.189 2024-11-07 00:28:09 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Grant exists for host '252.49.232.189' on db 'glance' 2024-11-07 00:28:09 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Proactively resetting ssl_ca 2024-11-07 00:28:09 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Single hostname provided by relation: 252.49.232.189 2024-11-07 00:28:09 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: DB user mysqlrouteruser already exists. 2024-11-07 00:28:09 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: DB user mysqlrouteruser already exists. 2024-11-07 00:28:09 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Proactively resetting ssl_ca 2024-11-07 00:28:09 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Single hostname provided by relation: 252.49.40.210 2024-11-07 00:28:09 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: DB user mysqlrouteruser already exists. 2024-11-07 00:28:09 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Proactively resetting ssl_ca 2024-11-07 00:28:09 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Single hostname provided by relation: 252.49.118.130 2024-11-07 00:28:09 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Grant exists for host '252.49.118.130' on db 'heat' 2024-11-07 00:28:09 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Proactively resetting ssl_ca 2024-11-07 00:28:09 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Single hostname provided by relation: 252.49.118.130 2024-11-07 00:28:09 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: DB user mysqlrouteruser already exists. 2024-11-07 00:28:09 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: DB user mysqlrouteruser already exists. 2024-11-07 00:28:09 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Proactively resetting ssl_ca 2024-11-07 00:28:09 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: DB Router relation created DBs and users. 2024-11-07 00:28:09 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer> tracer: cleared flag endpoint.db-router.changed tracer: -- dequeue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: -- dequeue handler reactive/mysql_innodb_cluster_handlers.py:334:db_router_respond 2024-11-07 00:28:09 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-11-07 00:28:09 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-11-07 00:28:09 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-11-07 00:28:09 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 00:28:09 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Running _assess_status() 2024-11-07 00:28:10 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-11-07 00:28:10 DEBUG unit.mysql-innodb-cluster/1.db-router-relation-changed logger.go:60 active 2024-11-07 00:28:10 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Opening db connection for root@localhost 2024-11-07 00:28:10 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Checking cluster status. 2024-11-07 00:28:10 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Opening db connection for root@None 2024-11-07 00:28:10 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:28:10 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: coordinator.DelayedActionCoordinator Publishing state 2024-11-07 00:28:11 INFO juju.worker.uniter.operation runhook.go:159 ran "db-router-relation-changed" hook (via explicit, bespoke hook script) 2024-11-07 00:28:11 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (43; unit: dashboard-mysql-router/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:28:11 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-07 00:28:11 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/1 uniter (run relation-changed (43; unit: dashboard-mysql-router/0) hook) 2024-11-07 00:28:11 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/1 2024-11-07 00:28:11 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:28:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 00:28:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 00:28:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-11-07 00:28:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 00:28:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-11-07 00:28:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 00:28:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 00:28:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 00:28:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 00:28:11 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 2024-11-07 00:28:11 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:28:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 00:28:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 00:28:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-11-07 00:28:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-11-07 00:28:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 00:28:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 00:28:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 00:28:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 00:28:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 00:28:19 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for mysql-innodb-cluster/1 : {43 {map[dashboard-mysql-router/0:{2}] map[] []}} 2024-11-07 00:28:19 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:28:19 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 00:28:19 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 00:28:19 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 00:28:19 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 00:28:19 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 00:28:19 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-11-07 00:28:19 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-11-07 00:28:19 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (43; unit: dashboard-mysql-router/0) hook for mysql-innodb-cluster/1 2024-11-07 00:28:19 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/1 uniter (run relation-changed (43; unit: dashboard-mysql-router/0) hook) 2024-11-07 00:28:19 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/1 uniter (run relation-changed (43; unit: dashboard-mysql-router/0) hook) 2024-11-07 00:28:19 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (43; unit: dashboard-mysql-router/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:28:19 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (43; unit: dashboard-mysql-router/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:28:19 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running db-router-relation-changed hook for dashboard-mysql-router/0 2024-11-07 00:28:19 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-1/agent.socket } 2024-11-07 00:28:19 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Reactive main running for hook db-router-relation-changed 2024-11-07 00:28:19 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer> tracer: set flag endpoint.db-router.changed tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:334:db_router_respond 2024-11-07 00:28:19 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.snapd_refresh 2024-11-07 00:28:19 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.ssl_cert 2024-11-07 00:28:20 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.ssl_key 2024-11-07 00:28:20 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.ssl_ca 2024-11-07 00:28:20 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.set.source 2024-11-07 00:28:20 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.source 2024-11-07 00:28:20 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.set.cluster-name 2024-11-07 00:28:20 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.cluster-name 2024-11-07 00:28:20 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.set.auto-rejoin-tries 2024-11-07 00:28:20 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.auto-rejoin-tries 2024-11-07 00:28:20 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.set.expel-timeout 2024-11-07 00:28:20 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.expel-timeout 2024-11-07 00:28:20 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.set.innodb-buffer-pool-size 2024-11-07 00:28:20 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.set.innodb-change-buffering 2024-11-07 00:28:20 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.innodb-change-buffering 2024-11-07 00:28:20 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.set.innodb-io-capacity 2024-11-07 00:28:20 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.innodb-io-capacity 2024-11-07 00:28:20 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.set.innodb-file-per-table 2024-11-07 00:28:20 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.innodb-file-per-table 2024-11-07 00:28:20 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.set.tuning-level 2024-11-07 00:28:20 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.tuning-level 2024-11-07 00:28:20 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.set.table-open-cache 2024-11-07 00:28:20 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.table-open-cache 2024-11-07 00:28:20 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.set.max-connections 2024-11-07 00:28:20 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.enable-binlogs 2024-11-07 00:28:20 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.set.binlogs-path 2024-11-07 00:28:20 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.binlogs-path 2024-11-07 00:28:20 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.set.binlogs-max-size 2024-11-07 00:28:20 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.binlogs-max-size 2024-11-07 00:28:20 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.set.binlogs-expire-days 2024-11-07 00:28:20 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.binlogs-expire-days 2024-11-07 00:28:20 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.prefer-ipv6 2024-11-07 00:28:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.set.wait-timeout 2024-11-07 00:28:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.wait-timeout 2024-11-07 00:28:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: set flag config.default.os-db-router-hostname 2024-11-07 00:28:21 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Initializing Snap Layer 2024-11-07 00:28:21 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: coordinator.DelayedActionCoordinator Loading state 2024-11-07 00:28:21 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:28:21 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Coordinator: Initializing coordinator layer 2024-11-07 00:28:21 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Initializing Leadership Layer (is leader) 2024-11-07 00:28:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer> tracer: starting handler dispatch, 92 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-49-102-64 tracer: set flag leadership.set.cluster-instance-clustered-252-49-107-157 tracer: set flag leadership.set.cluster-instance-clustered-252-49-94-42 tracer: set flag leadership.set.cluster-instance-configured-252-49-102-64 tracer: set flag leadership.set.cluster-instance-configured-252-49-107-157 tracer: set flag leadership.set.cluster-instance-configured-252-49-94-42 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-11-07 00:28:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer: hooks phase, 0 handlers queued 2024-11-07 00:28:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:334:db_router_respond 2024-11-07 00:28:21 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 00:28:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Found peers: 252.49.107.157,252.49.94.42 2024-11-07 00:28:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Expect 2 peers 2024-11-07 00:28:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Reached quorum 2024-11-07 00:28:21 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:334:db_router_respond 2024-11-07 00:28:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: DB router respond 2024-11-07 00:28:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Checking cluster status. 2024-11-07 00:28:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Checking cluster status. 2024-11-07 00:28:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Opening db connection for clusteruser@252.49.102.64 2024-11-07 00:28:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Single hostname provided by relation: 252.49.180.63 2024-11-07 00:28:23 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Opening db connection for root@None 2024-11-07 00:28:23 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Grant exists for host '252.49.180.63' on db 'keystone' 2024-11-07 00:28:23 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Proactively resetting ssl_ca 2024-11-07 00:28:23 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Single hostname provided by relation: 252.49.180.63 2024-11-07 00:28:23 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: DB user mysqlrouteruser already exists. 2024-11-07 00:28:23 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: DB user mysqlrouteruser already exists. 2024-11-07 00:28:23 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Proactively resetting ssl_ca 2024-11-07 00:28:23 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Single hostname provided by relation: 252.49.232.189 2024-11-07 00:28:23 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Grant exists for host '252.49.232.189' on db 'glance' 2024-11-07 00:28:23 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Proactively resetting ssl_ca 2024-11-07 00:28:23 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Single hostname provided by relation: 252.49.232.189 2024-11-07 00:28:23 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: DB user mysqlrouteruser already exists. 2024-11-07 00:28:23 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: DB user mysqlrouteruser already exists. 2024-11-07 00:28:23 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Proactively resetting ssl_ca 2024-11-07 00:28:23 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Single hostname provided by relation: 252.49.40.210 2024-11-07 00:28:23 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Generating new password file '/var/lib/charm/mysql-innodb-cluster/mysql-horizon.passwd' 2024-11-07 00:28:23 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Writing file /var/lib/charm/mysql-innodb-cluster/mysql-horizon.passwd root:root 660 2024-11-07 00:28:23 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Grant exists for host '252.49.40.210' on db 'horizon' 2024-11-07 00:28:23 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Proactively resetting ssl_ca 2024-11-07 00:28:23 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Single hostname provided by relation: 252.49.40.210 2024-11-07 00:28:23 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: DB user mysqlrouteruser already exists. 2024-11-07 00:28:23 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: DB user mysqlrouteruser already exists. 2024-11-07 00:28:23 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for mysql-innodb-cluster/1: ok=true 2024-11-07 00:28:23 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Proactively resetting ssl_ca 2024-11-07 00:28:23 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Single hostname provided by relation: 252.49.118.130 2024-11-07 00:28:23 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Grant exists for host '252.49.118.130' on db 'heat' 2024-11-07 00:28:23 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Proactively resetting ssl_ca 2024-11-07 00:28:23 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Single hostname provided by relation: 252.49.118.130 2024-11-07 00:28:23 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: DB user mysqlrouteruser already exists. 2024-11-07 00:28:23 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: DB user mysqlrouteruser already exists. 2024-11-07 00:28:23 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Proactively resetting ssl_ca 2024-11-07 00:28:23 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: DB Router relation created DBs and users. 2024-11-07 00:28:23 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: tracer> tracer: cleared flag endpoint.db-router.changed tracer: -- dequeue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: -- dequeue handler reactive/mysql_innodb_cluster_handlers.py:334:db_router_respond 2024-11-07 00:28:23 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-11-07 00:28:23 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-11-07 00:28:23 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-11-07 00:28:23 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 00:28:23 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Running _assess_status() 2024-11-07 00:28:24 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-11-07 00:28:24 DEBUG unit.mysql-innodb-cluster/1.db-router-relation-changed logger.go:60 active 2024-11-07 00:28:24 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Opening db connection for root@localhost 2024-11-07 00:28:24 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Checking cluster status. 2024-11-07 00:28:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: Opening db connection for root@None 2024-11-07 00:28:25 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:28:25 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:43: coordinator.DelayedActionCoordinator Publishing state 2024-11-07 00:28:25 INFO juju.worker.uniter.operation runhook.go:159 ran "db-router-relation-changed" hook (via explicit, bespoke hook script) 2024-11-07 00:28:25 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (43; unit: dashboard-mysql-router/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:28:25 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-07 00:28:25 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/1 uniter (run relation-changed (43; unit: dashboard-mysql-router/0) hook) 2024-11-07 00:28:25 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/1 2024-11-07 00:28:25 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:28:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-11-07 00:28:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 00:28:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 00:28:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 00:28:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 00:28:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 00:28:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 00:28:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 00:28:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-11-07 00:28:25 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 2024-11-07 00:28:25 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:28:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 00:28:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 00:28:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 00:28:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 00:28:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 00:28:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-11-07 00:28:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 00:28:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-11-07 00:28:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 00:28:30 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for mysql-innodb-cluster/1 : {39 {map[nova-mysql-router/0:{0}] map[] []}} 2024-11-07 00:28:30 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:28:30 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 00:28:30 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 00:28:30 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 00:28:30 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-joined (39; unit: nova-mysql-router/0) hook for mysql-innodb-cluster/1 2024-11-07 00:28:30 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/1 uniter (run relation-joined (39; unit: nova-mysql-router/0) hook) 2024-11-07 00:28:30 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/1 uniter (run relation-joined (39; unit: nova-mysql-router/0) hook) 2024-11-07 00:28:30 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-joined (39; unit: nova-mysql-router/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:28:30 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-joined (39; unit: nova-mysql-router/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:28:30 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running db-router-relation-joined hook for nova-mysql-router/0 2024-11-07 00:28:30 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-1/agent.socket } 2024-11-07 00:28:30 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Reactive main running for hook db-router-relation-joined 2024-11-07 00:28:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer> tracer: set flag endpoint.db-router.changed tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:334:db_router_respond 2024-11-07 00:28:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.snapd_refresh 2024-11-07 00:28:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.ssl_cert 2024-11-07 00:28:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.ssl_key 2024-11-07 00:28:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.ssl_ca 2024-11-07 00:28:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.set.source 2024-11-07 00:28:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.source 2024-11-07 00:28:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.set.cluster-name 2024-11-07 00:28:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.cluster-name 2024-11-07 00:28:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.set.auto-rejoin-tries 2024-11-07 00:28:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.auto-rejoin-tries 2024-11-07 00:28:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.set.expel-timeout 2024-11-07 00:28:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.expel-timeout 2024-11-07 00:28:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.set.innodb-buffer-pool-size 2024-11-07 00:28:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.set.innodb-change-buffering 2024-11-07 00:28:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.innodb-change-buffering 2024-11-07 00:28:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.set.innodb-io-capacity 2024-11-07 00:28:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.innodb-io-capacity 2024-11-07 00:28:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.set.innodb-file-per-table 2024-11-07 00:28:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.innodb-file-per-table 2024-11-07 00:28:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.set.tuning-level 2024-11-07 00:28:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.tuning-level 2024-11-07 00:28:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.set.table-open-cache 2024-11-07 00:28:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.table-open-cache 2024-11-07 00:28:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.set.max-connections 2024-11-07 00:28:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.enable-binlogs 2024-11-07 00:28:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.set.binlogs-path 2024-11-07 00:28:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.binlogs-path 2024-11-07 00:28:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.set.binlogs-max-size 2024-11-07 00:28:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.binlogs-max-size 2024-11-07 00:28:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.set.binlogs-expire-days 2024-11-07 00:28:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.binlogs-expire-days 2024-11-07 00:28:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.prefer-ipv6 2024-11-07 00:28:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.set.wait-timeout 2024-11-07 00:28:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.wait-timeout 2024-11-07 00:28:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.os-db-router-hostname 2024-11-07 00:28:32 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Initializing Snap Layer 2024-11-07 00:28:32 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: coordinator.DelayedActionCoordinator Loading state 2024-11-07 00:28:32 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:28:32 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Coordinator: Initializing coordinator layer 2024-11-07 00:28:32 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Initializing Leadership Layer (is leader) 2024-11-07 00:28:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag leadership.changed.mysql-horizon.passwd 2024-11-07 00:28:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag leadership.set.mysql-horizon.passwd 2024-11-07 00:28:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag leadership.changed 2024-11-07 00:28:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer> tracer: starting handler dispatch, 95 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.changed tracer: set flag leadership.changed.mysql-horizon.passwd tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-49-102-64 tracer: set flag leadership.set.cluster-instance-clustered-252-49-107-157 tracer: set flag leadership.set.cluster-instance-clustered-252-49-94-42 tracer: set flag leadership.set.cluster-instance-configured-252-49-102-64 tracer: set flag leadership.set.cluster-instance-configured-252-49-107-157 tracer: set flag leadership.set.cluster-instance-configured-252-49-94-42 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-11-07 00:28:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: hooks phase, 0 handlers queued 2024-11-07 00:28:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:334:db_router_respond 2024-11-07 00:28:32 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 00:28:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Found peers: 252.49.107.157,252.49.94.42 2024-11-07 00:28:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Expect 2 peers 2024-11-07 00:28:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Reached quorum 2024-11-07 00:28:32 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:334:db_router_respond 2024-11-07 00:28:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: DB router respond 2024-11-07 00:28:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Checking cluster status. 2024-11-07 00:28:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Checking cluster status. 2024-11-07 00:28:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Opening db connection for clusteruser@252.49.102.64 2024-11-07 00:28:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Single hostname provided by relation: 252.49.180.63 2024-11-07 00:28:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Opening db connection for root@None 2024-11-07 00:28:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Grant exists for host '252.49.180.63' on db 'keystone' 2024-11-07 00:28:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Proactively resetting ssl_ca 2024-11-07 00:28:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Single hostname provided by relation: 252.49.180.63 2024-11-07 00:28:34 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: DB user mysqlrouteruser already exists. 2024-11-07 00:28:34 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: DB user mysqlrouteruser already exists. 2024-11-07 00:28:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Proactively resetting ssl_ca 2024-11-07 00:28:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Single hostname provided by relation: 252.49.232.189 2024-11-07 00:28:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Grant exists for host '252.49.232.189' on db 'glance' 2024-11-07 00:28:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Proactively resetting ssl_ca 2024-11-07 00:28:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Single hostname provided by relation: 252.49.232.189 2024-11-07 00:28:34 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: DB user mysqlrouteruser already exists. 2024-11-07 00:28:34 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: DB user mysqlrouteruser already exists. 2024-11-07 00:28:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Proactively resetting ssl_ca 2024-11-07 00:28:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Single hostname provided by relation: 252.49.40.210 2024-11-07 00:28:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Grant exists for host '252.49.40.210' on db 'horizon' 2024-11-07 00:28:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Proactively resetting ssl_ca 2024-11-07 00:28:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Single hostname provided by relation: 252.49.40.210 2024-11-07 00:28:34 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: DB user mysqlrouteruser already exists. 2024-11-07 00:28:34 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: DB user mysqlrouteruser already exists. 2024-11-07 00:28:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Proactively resetting ssl_ca 2024-11-07 00:28:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Single hostname provided by relation: 252.49.118.130 2024-11-07 00:28:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Grant exists for host '252.49.118.130' on db 'heat' 2024-11-07 00:28:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Proactively resetting ssl_ca 2024-11-07 00:28:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Single hostname provided by relation: 252.49.118.130 2024-11-07 00:28:34 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: DB user mysqlrouteruser already exists. 2024-11-07 00:28:34 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: DB user mysqlrouteruser already exists. 2024-11-07 00:28:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Proactively resetting ssl_ca 2024-11-07 00:28:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: DB Router relation created DBs and users. 2024-11-07 00:28:35 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer> tracer: cleared flag endpoint.db-router.changed tracer: -- dequeue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: -- dequeue handler reactive/mysql_innodb_cluster_handlers.py:334:db_router_respond 2024-11-07 00:28:35 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-11-07 00:28:35 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-11-07 00:28:35 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-11-07 00:28:35 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 00:28:35 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Running _assess_status() 2024-11-07 00:28:35 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-11-07 00:28:35 DEBUG unit.mysql-innodb-cluster/1.db-router-relation-joined logger.go:60 active 2024-11-07 00:28:35 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Opening db connection for root@localhost 2024-11-07 00:28:35 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Checking cluster status. 2024-11-07 00:28:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Opening db connection for root@None 2024-11-07 00:28:36 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:28:36 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: coordinator.DelayedActionCoordinator Publishing state 2024-11-07 00:28:36 INFO juju.worker.uniter.operation runhook.go:159 ran "db-router-relation-joined" hook (via explicit, bespoke hook script) 2024-11-07 00:28:36 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-joined (39; unit: nova-mysql-router/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:28:36 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-07 00:28:36 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/1 uniter (run relation-joined (39; unit: nova-mysql-router/0) hook) 2024-11-07 00:28:36 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/1 2024-11-07 00:28:36 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:28:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 00:28:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 00:28:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 00:28:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 00:28:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 00:28:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 00:28:36 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (39; unit: nova-mysql-router/0) hook for mysql-innodb-cluster/1 2024-11-07 00:28:36 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/1 uniter (run relation-changed (39; unit: nova-mysql-router/0) hook) 2024-11-07 00:28:36 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/1 uniter (run relation-changed (39; unit: nova-mysql-router/0) hook) 2024-11-07 00:28:36 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (39; unit: nova-mysql-router/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:28:37 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (39; unit: nova-mysql-router/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:28:37 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running db-router-relation-changed hook for nova-mysql-router/0 2024-11-07 00:28:37 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-1/agent.socket } 2024-11-07 00:28:37 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Reactive main running for hook db-router-relation-changed 2024-11-07 00:28:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 00:28:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.ssl_cert 2024-11-07 00:28:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.ssl_key 2024-11-07 00:28:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.ssl_ca 2024-11-07 00:28:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.set.source 2024-11-07 00:28:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.source 2024-11-07 00:28:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.set.cluster-name 2024-11-07 00:28:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.cluster-name 2024-11-07 00:28:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.set.auto-rejoin-tries 2024-11-07 00:28:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.auto-rejoin-tries 2024-11-07 00:28:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.set.expel-timeout 2024-11-07 00:28:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.expel-timeout 2024-11-07 00:28:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.set.innodb-buffer-pool-size 2024-11-07 00:28:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.set.innodb-change-buffering 2024-11-07 00:28:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.innodb-change-buffering 2024-11-07 00:28:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.set.innodb-io-capacity 2024-11-07 00:28:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.innodb-io-capacity 2024-11-07 00:28:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.set.innodb-file-per-table 2024-11-07 00:28:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.innodb-file-per-table 2024-11-07 00:28:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.set.tuning-level 2024-11-07 00:28:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.tuning-level 2024-11-07 00:28:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.set.table-open-cache 2024-11-07 00:28:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.table-open-cache 2024-11-07 00:28:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.set.max-connections 2024-11-07 00:28:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.enable-binlogs 2024-11-07 00:28:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.set.binlogs-path 2024-11-07 00:28:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.binlogs-path 2024-11-07 00:28:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.set.binlogs-max-size 2024-11-07 00:28:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.binlogs-max-size 2024-11-07 00:28:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.set.binlogs-expire-days 2024-11-07 00:28:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.binlogs-expire-days 2024-11-07 00:28:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.prefer-ipv6 2024-11-07 00:28:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.set.wait-timeout 2024-11-07 00:28:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.wait-timeout 2024-11-07 00:28:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.os-db-router-hostname 2024-11-07 00:28:38 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Initializing Snap Layer 2024-11-07 00:28:38 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: coordinator.DelayedActionCoordinator Loading state 2024-11-07 00:28:38 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:28:38 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Coordinator: Initializing coordinator layer 2024-11-07 00:28:38 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Initializing Leadership Layer (is leader) 2024-11-07 00:28:39 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: cleared flag leadership.changed.mysql-horizon.passwd 2024-11-07 00:28:39 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: cleared flag leadership.changed 2024-11-07 00:28:39 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer> tracer: starting handler dispatch, 92 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-49-102-64 tracer: set flag leadership.set.cluster-instance-clustered-252-49-107-157 tracer: set flag leadership.set.cluster-instance-clustered-252-49-94-42 tracer: set flag leadership.set.cluster-instance-configured-252-49-102-64 tracer: set flag leadership.set.cluster-instance-configured-252-49-107-157 tracer: set flag leadership.set.cluster-instance-configured-252-49-94-42 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-11-07 00:28:39 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: hooks phase, 0 handlers queued 2024-11-07 00:28:39 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer> tracer: main dispatch loop, 5 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 00:28:39 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 00:28:39 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Found peers: 252.49.107.157,252.49.94.42 2024-11-07 00:28:39 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Expect 2 peers 2024-11-07 00:28:39 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Reached quorum 2024-11-07 00:28:39 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-11-07 00:28:39 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-11-07 00:28:39 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-11-07 00:28:39 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 00:28:39 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:28:39 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: coordinator.DelayedActionCoordinator Publishing state 2024-11-07 00:28:39 INFO juju.worker.uniter.operation runhook.go:159 ran "db-router-relation-changed" hook (via explicit, bespoke hook script) 2024-11-07 00:28:39 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (39; unit: nova-mysql-router/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:28:39 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-07 00:28:39 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/1 uniter (run relation-changed (39; unit: nova-mysql-router/0) hook) 2024-11-07 00:28:39 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/1 2024-11-07 00:28:39 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:28:39 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 00:28:39 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 00:28:39 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-11-07 00:28:39 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-11-07 00:28:39 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 00:28:39 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-11-07 00:28:39 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 00:28:39 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 00:28:39 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 00:28:39 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 00:28:39 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 2024-11-07 00:28:53 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for mysql-innodb-cluster/1 : {47 {map[placement-mysql-router/0:{0}] map[] []}} 2024-11-07 00:28:53 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:28:53 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 00:28:53 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 00:28:53 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-11-07 00:28:53 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 00:28:53 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-11-07 00:28:53 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 00:28:53 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 00:28:53 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-joined (47; unit: placement-mysql-router/0) hook for mysql-innodb-cluster/1 2024-11-07 00:28:53 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/1 uniter (run relation-joined (47; unit: placement-mysql-router/0) hook) 2024-11-07 00:28:53 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/1 uniter (run relation-joined (47; unit: placement-mysql-router/0) hook) 2024-11-07 00:28:53 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-joined (47; unit: placement-mysql-router/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:28:53 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-joined (47; unit: placement-mysql-router/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:28:53 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running db-router-relation-joined hook for placement-mysql-router/0 2024-11-07 00:28:53 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-1/agent.socket } 2024-11-07 00:28:53 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Reactive main running for hook db-router-relation-joined 2024-11-07 00:28:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer> tracer: set flag endpoint.db-router.changed tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:334:db_router_respond 2024-11-07 00:28:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.snapd_refresh 2024-11-07 00:28:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.ssl_cert 2024-11-07 00:28:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.ssl_key 2024-11-07 00:28:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.ssl_ca 2024-11-07 00:28:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.set.source 2024-11-07 00:28:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.source 2024-11-07 00:28:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.set.cluster-name 2024-11-07 00:28:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.cluster-name 2024-11-07 00:28:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.set.auto-rejoin-tries 2024-11-07 00:28:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.auto-rejoin-tries 2024-11-07 00:28:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.set.expel-timeout 2024-11-07 00:28:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.expel-timeout 2024-11-07 00:28:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.set.innodb-buffer-pool-size 2024-11-07 00:28:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.set.innodb-change-buffering 2024-11-07 00:28:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.innodb-change-buffering 2024-11-07 00:28:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.set.innodb-io-capacity 2024-11-07 00:28:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.innodb-io-capacity 2024-11-07 00:28:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.set.innodb-file-per-table 2024-11-07 00:28:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.innodb-file-per-table 2024-11-07 00:28:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.set.tuning-level 2024-11-07 00:28:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.tuning-level 2024-11-07 00:28:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.set.table-open-cache 2024-11-07 00:28:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.table-open-cache 2024-11-07 00:28:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.set.max-connections 2024-11-07 00:28:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.enable-binlogs 2024-11-07 00:28:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.set.binlogs-path 2024-11-07 00:28:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.binlogs-path 2024-11-07 00:28:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.set.binlogs-max-size 2024-11-07 00:28:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.binlogs-max-size 2024-11-07 00:28:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.set.binlogs-expire-days 2024-11-07 00:28:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.binlogs-expire-days 2024-11-07 00:28:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.prefer-ipv6 2024-11-07 00:28:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.set.wait-timeout 2024-11-07 00:28:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.wait-timeout 2024-11-07 00:28:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.os-db-router-hostname 2024-11-07 00:28:55 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Initializing Snap Layer 2024-11-07 00:28:55 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: coordinator.DelayedActionCoordinator Loading state 2024-11-07 00:28:55 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:28:55 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Coordinator: Initializing coordinator layer 2024-11-07 00:28:55 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Initializing Leadership Layer (is leader) 2024-11-07 00:28:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer> tracer: starting handler dispatch, 93 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-49-102-64 tracer: set flag leadership.set.cluster-instance-clustered-252-49-107-157 tracer: set flag leadership.set.cluster-instance-clustered-252-49-94-42 tracer: set flag leadership.set.cluster-instance-configured-252-49-102-64 tracer: set flag leadership.set.cluster-instance-configured-252-49-107-157 tracer: set flag leadership.set.cluster-instance-configured-252-49-94-42 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-11-07 00:28:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: hooks phase, 0 handlers queued 2024-11-07 00:28:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:334:db_router_respond 2024-11-07 00:28:55 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 00:28:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Found peers: 252.49.107.157,252.49.94.42 2024-11-07 00:28:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Expect 2 peers 2024-11-07 00:28:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Reached quorum 2024-11-07 00:28:55 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:334:db_router_respond 2024-11-07 00:28:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: DB router respond 2024-11-07 00:28:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Checking cluster status. 2024-11-07 00:28:56 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Checking cluster status. 2024-11-07 00:28:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Opening db connection for clusteruser@252.49.102.64 2024-11-07 00:28:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Single hostname provided by relation: 252.49.180.63 2024-11-07 00:28:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Opening db connection for root@None 2024-11-07 00:28:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Grant exists for host '252.49.180.63' on db 'keystone' 2024-11-07 00:28:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Proactively resetting ssl_ca 2024-11-07 00:28:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Single hostname provided by relation: 252.49.180.63 2024-11-07 00:28:57 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: DB user mysqlrouteruser already exists. 2024-11-07 00:28:57 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: DB user mysqlrouteruser already exists. 2024-11-07 00:28:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Proactively resetting ssl_ca 2024-11-07 00:28:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Single hostname provided by relation: 252.49.232.189 2024-11-07 00:28:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Grant exists for host '252.49.232.189' on db 'glance' 2024-11-07 00:28:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Proactively resetting ssl_ca 2024-11-07 00:28:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Single hostname provided by relation: 252.49.232.189 2024-11-07 00:28:57 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: DB user mysqlrouteruser already exists. 2024-11-07 00:28:57 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: DB user mysqlrouteruser already exists. 2024-11-07 00:28:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Proactively resetting ssl_ca 2024-11-07 00:28:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Single hostname provided by relation: 252.49.40.210 2024-11-07 00:28:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Grant exists for host '252.49.40.210' on db 'horizon' 2024-11-07 00:28:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Proactively resetting ssl_ca 2024-11-07 00:28:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Single hostname provided by relation: 252.49.40.210 2024-11-07 00:28:57 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: DB user mysqlrouteruser already exists. 2024-11-07 00:28:57 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: DB user mysqlrouteruser already exists. 2024-11-07 00:28:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Proactively resetting ssl_ca 2024-11-07 00:28:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Single hostname provided by relation: 252.49.118.130 2024-11-07 00:28:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Grant exists for host '252.49.118.130' on db 'heat' 2024-11-07 00:28:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Proactively resetting ssl_ca 2024-11-07 00:28:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Single hostname provided by relation: 252.49.118.130 2024-11-07 00:28:57 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: DB user mysqlrouteruser already exists. 2024-11-07 00:28:57 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: DB user mysqlrouteruser already exists. 2024-11-07 00:28:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Proactively resetting ssl_ca 2024-11-07 00:28:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: DB Router relation created DBs and users. 2024-11-07 00:28:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer> tracer: cleared flag endpoint.db-router.changed tracer: -- dequeue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: -- dequeue handler reactive/mysql_innodb_cluster_handlers.py:334:db_router_respond 2024-11-07 00:28:58 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-11-07 00:28:58 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-11-07 00:28:58 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-11-07 00:28:58 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 00:28:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Running _assess_status() 2024-11-07 00:28:58 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-11-07 00:28:58 DEBUG unit.mysql-innodb-cluster/1.db-router-relation-joined logger.go:60 active 2024-11-07 00:28:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Opening db connection for root@localhost 2024-11-07 00:28:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Checking cluster status. 2024-11-07 00:28:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Opening db connection for root@None 2024-11-07 00:28:59 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:28:59 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: coordinator.DelayedActionCoordinator Publishing state 2024-11-07 00:29:00 INFO juju.worker.uniter.operation runhook.go:159 ran "db-router-relation-joined" hook (via explicit, bespoke hook script) 2024-11-07 00:29:00 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-joined (47; unit: placement-mysql-router/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:29:00 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-07 00:29:00 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/1 uniter (run relation-joined (47; unit: placement-mysql-router/0) hook) 2024-11-07 00:29:00 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/1 2024-11-07 00:29:00 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:29:00 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 00:29:00 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-11-07 00:29:00 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (47; unit: placement-mysql-router/0) hook for mysql-innodb-cluster/1 2024-11-07 00:29:00 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/1 uniter (run relation-changed (47; unit: placement-mysql-router/0) hook) 2024-11-07 00:29:00 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/1 uniter (run relation-changed (47; unit: placement-mysql-router/0) hook) 2024-11-07 00:29:00 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (47; unit: placement-mysql-router/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:29:00 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (47; unit: placement-mysql-router/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:29:00 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running db-router-relation-changed hook for placement-mysql-router/0 2024-11-07 00:29:00 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-1/agent.socket } 2024-11-07 00:29:00 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Reactive main running for hook db-router-relation-changed 2024-11-07 00:29:00 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 00:29:00 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.ssl_cert 2024-11-07 00:29:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.ssl_key 2024-11-07 00:29:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.ssl_ca 2024-11-07 00:29:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.set.source 2024-11-07 00:29:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.source 2024-11-07 00:29:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.set.cluster-name 2024-11-07 00:29:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.cluster-name 2024-11-07 00:29:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.set.auto-rejoin-tries 2024-11-07 00:29:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.auto-rejoin-tries 2024-11-07 00:29:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.set.expel-timeout 2024-11-07 00:29:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.expel-timeout 2024-11-07 00:29:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.set.innodb-buffer-pool-size 2024-11-07 00:29:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.set.innodb-change-buffering 2024-11-07 00:29:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.innodb-change-buffering 2024-11-07 00:29:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.set.innodb-io-capacity 2024-11-07 00:29:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.innodb-io-capacity 2024-11-07 00:29:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.set.innodb-file-per-table 2024-11-07 00:29:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.innodb-file-per-table 2024-11-07 00:29:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.set.tuning-level 2024-11-07 00:29:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.tuning-level 2024-11-07 00:29:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.set.table-open-cache 2024-11-07 00:29:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.table-open-cache 2024-11-07 00:29:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.set.max-connections 2024-11-07 00:29:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.enable-binlogs 2024-11-07 00:29:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.set.binlogs-path 2024-11-07 00:29:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.binlogs-path 2024-11-07 00:29:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.set.binlogs-max-size 2024-11-07 00:29:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.binlogs-max-size 2024-11-07 00:29:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.set.binlogs-expire-days 2024-11-07 00:29:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.binlogs-expire-days 2024-11-07 00:29:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.prefer-ipv6 2024-11-07 00:29:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.set.wait-timeout 2024-11-07 00:29:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.wait-timeout 2024-11-07 00:29:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.os-db-router-hostname 2024-11-07 00:29:01 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Initializing Snap Layer 2024-11-07 00:29:01 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: coordinator.DelayedActionCoordinator Loading state 2024-11-07 00:29:02 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:29:02 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Coordinator: Initializing coordinator layer 2024-11-07 00:29:02 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Initializing Leadership Layer (is leader) 2024-11-07 00:29:02 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer> tracer: starting handler dispatch, 92 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-49-102-64 tracer: set flag leadership.set.cluster-instance-clustered-252-49-107-157 tracer: set flag leadership.set.cluster-instance-clustered-252-49-94-42 tracer: set flag leadership.set.cluster-instance-configured-252-49-102-64 tracer: set flag leadership.set.cluster-instance-configured-252-49-107-157 tracer: set flag leadership.set.cluster-instance-configured-252-49-94-42 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-11-07 00:29:02 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: hooks phase, 0 handlers queued 2024-11-07 00:29:02 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer> tracer: main dispatch loop, 5 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 00:29:02 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 00:29:02 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Found peers: 252.49.107.157,252.49.94.42 2024-11-07 00:29:02 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Expect 2 peers 2024-11-07 00:29:02 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Reached quorum 2024-11-07 00:29:02 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-11-07 00:29:02 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-11-07 00:29:02 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-11-07 00:29:02 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 00:29:02 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:29:02 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: coordinator.DelayedActionCoordinator Publishing state 2024-11-07 00:29:02 INFO juju.worker.uniter.operation runhook.go:159 ran "db-router-relation-changed" hook (via explicit, bespoke hook script) 2024-11-07 00:29:02 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (47; unit: placement-mysql-router/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:29:02 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-07 00:29:02 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/1 uniter (run relation-changed (47; unit: placement-mysql-router/0) hook) 2024-11-07 00:29:02 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/1 2024-11-07 00:29:02 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:29:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 00:29:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-11-07 00:29:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 00:29:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 00:29:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-11-07 00:29:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-11-07 00:29:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-11-07 00:29:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 00:29:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 00:29:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 00:29:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 00:29:02 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 2024-11-07 00:29:13 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for mysql-innodb-cluster/1 : {47 {map[placement-mysql-router/0:{1}] map[] []}} 2024-11-07 00:29:13 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:29:13 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-11-07 00:29:13 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-11-07 00:29:13 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 00:29:13 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 00:29:13 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-11-07 00:29:13 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (47; unit: placement-mysql-router/0) hook for mysql-innodb-cluster/1 2024-11-07 00:29:13 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/1 uniter (run relation-changed (47; unit: placement-mysql-router/0) hook) 2024-11-07 00:29:13 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/1 uniter (run relation-changed (47; unit: placement-mysql-router/0) hook) 2024-11-07 00:29:13 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (47; unit: placement-mysql-router/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:29:13 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (47; unit: placement-mysql-router/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:29:13 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running db-router-relation-changed hook for placement-mysql-router/0 2024-11-07 00:29:13 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-1/agent.socket } 2024-11-07 00:29:14 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Reactive main running for hook db-router-relation-changed 2024-11-07 00:29:14 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer> tracer: set flag endpoint.db-router.changed tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:334:db_router_respond 2024-11-07 00:29:14 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.snapd_refresh 2024-11-07 00:29:14 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.ssl_cert 2024-11-07 00:29:14 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.ssl_key 2024-11-07 00:29:14 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.ssl_ca 2024-11-07 00:29:14 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.set.source 2024-11-07 00:29:14 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.source 2024-11-07 00:29:14 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.set.cluster-name 2024-11-07 00:29:15 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.cluster-name 2024-11-07 00:29:15 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.set.auto-rejoin-tries 2024-11-07 00:29:15 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.auto-rejoin-tries 2024-11-07 00:29:15 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.set.expel-timeout 2024-11-07 00:29:15 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.expel-timeout 2024-11-07 00:29:15 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.set.innodb-buffer-pool-size 2024-11-07 00:29:15 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.set.innodb-change-buffering 2024-11-07 00:29:15 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.innodb-change-buffering 2024-11-07 00:29:15 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.set.innodb-io-capacity 2024-11-07 00:29:15 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.innodb-io-capacity 2024-11-07 00:29:15 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.set.innodb-file-per-table 2024-11-07 00:29:15 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.innodb-file-per-table 2024-11-07 00:29:15 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.set.tuning-level 2024-11-07 00:29:15 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.tuning-level 2024-11-07 00:29:15 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.set.table-open-cache 2024-11-07 00:29:15 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.table-open-cache 2024-11-07 00:29:15 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.set.max-connections 2024-11-07 00:29:15 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.enable-binlogs 2024-11-07 00:29:15 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.set.binlogs-path 2024-11-07 00:29:15 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.binlogs-path 2024-11-07 00:29:15 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.set.binlogs-max-size 2024-11-07 00:29:15 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.binlogs-max-size 2024-11-07 00:29:15 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.set.binlogs-expire-days 2024-11-07 00:29:15 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.binlogs-expire-days 2024-11-07 00:29:15 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.prefer-ipv6 2024-11-07 00:29:15 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.set.wait-timeout 2024-11-07 00:29:15 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.wait-timeout 2024-11-07 00:29:15 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.os-db-router-hostname 2024-11-07 00:29:15 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Initializing Snap Layer 2024-11-07 00:29:15 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: coordinator.DelayedActionCoordinator Loading state 2024-11-07 00:29:15 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:29:15 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Coordinator: Initializing coordinator layer 2024-11-07 00:29:15 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Initializing Leadership Layer (is leader) 2024-11-07 00:29:16 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer> tracer: starting handler dispatch, 93 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-49-102-64 tracer: set flag leadership.set.cluster-instance-clustered-252-49-107-157 tracer: set flag leadership.set.cluster-instance-clustered-252-49-94-42 tracer: set flag leadership.set.cluster-instance-configured-252-49-102-64 tracer: set flag leadership.set.cluster-instance-configured-252-49-107-157 tracer: set flag leadership.set.cluster-instance-configured-252-49-94-42 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-11-07 00:29:16 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: hooks phase, 0 handlers queued 2024-11-07 00:29:16 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:334:db_router_respond 2024-11-07 00:29:16 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 00:29:16 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Found peers: 252.49.107.157,252.49.94.42 2024-11-07 00:29:16 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Expect 2 peers 2024-11-07 00:29:16 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Reached quorum 2024-11-07 00:29:16 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:334:db_router_respond 2024-11-07 00:29:16 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: DB router respond 2024-11-07 00:29:16 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Checking cluster status. 2024-11-07 00:29:16 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Checking cluster status. 2024-11-07 00:29:17 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Opening db connection for clusteruser@252.49.102.64 2024-11-07 00:29:17 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Single hostname provided by relation: 252.49.180.63 2024-11-07 00:29:17 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Opening db connection for root@None 2024-11-07 00:29:17 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Grant exists for host '252.49.180.63' on db 'keystone' 2024-11-07 00:29:17 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Proactively resetting ssl_ca 2024-11-07 00:29:17 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Single hostname provided by relation: 252.49.180.63 2024-11-07 00:29:17 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: DB user mysqlrouteruser already exists. 2024-11-07 00:29:17 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: DB user mysqlrouteruser already exists. 2024-11-07 00:29:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Proactively resetting ssl_ca 2024-11-07 00:29:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Single hostname provided by relation: 252.49.232.189 2024-11-07 00:29:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Grant exists for host '252.49.232.189' on db 'glance' 2024-11-07 00:29:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Proactively resetting ssl_ca 2024-11-07 00:29:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Single hostname provided by relation: 252.49.232.189 2024-11-07 00:29:18 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: DB user mysqlrouteruser already exists. 2024-11-07 00:29:18 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: DB user mysqlrouteruser already exists. 2024-11-07 00:29:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Proactively resetting ssl_ca 2024-11-07 00:29:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Single hostname provided by relation: 252.49.40.210 2024-11-07 00:29:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Grant exists for host '252.49.40.210' on db 'horizon' 2024-11-07 00:29:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Proactively resetting ssl_ca 2024-11-07 00:29:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Single hostname provided by relation: 252.49.40.210 2024-11-07 00:29:18 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: DB user mysqlrouteruser already exists. 2024-11-07 00:29:18 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: DB user mysqlrouteruser already exists. 2024-11-07 00:29:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Proactively resetting ssl_ca 2024-11-07 00:29:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Single hostname provided by relation: 252.49.118.130 2024-11-07 00:29:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Grant exists for host '252.49.118.130' on db 'heat' 2024-11-07 00:29:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Proactively resetting ssl_ca 2024-11-07 00:29:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Single hostname provided by relation: 252.49.118.130 2024-11-07 00:29:18 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: DB user mysqlrouteruser already exists. 2024-11-07 00:29:18 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: DB user mysqlrouteruser already exists. 2024-11-07 00:29:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Proactively resetting ssl_ca 2024-11-07 00:29:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Single hostname provided by relation: 252.49.117.199 2024-11-07 00:29:18 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: DB user mysqlrouteruser already exists. 2024-11-07 00:29:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Proactively resetting ssl_ca 2024-11-07 00:29:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: DB Router relation created DBs and users. 2024-11-07 00:29:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer> tracer: cleared flag endpoint.db-router.changed tracer: -- dequeue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: -- dequeue handler reactive/mysql_innodb_cluster_handlers.py:334:db_router_respond 2024-11-07 00:29:18 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-11-07 00:29:18 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-11-07 00:29:18 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-11-07 00:29:18 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 00:29:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Running _assess_status() 2024-11-07 00:29:18 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for mysql-innodb-cluster/1 : {41 {map[neutron-mysql-router/0:{1}] map[] []}} 2024-11-07 00:29:19 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-11-07 00:29:19 DEBUG unit.mysql-innodb-cluster/1.db-router-relation-changed logger.go:60 active 2024-11-07 00:29:19 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Opening db connection for root@localhost 2024-11-07 00:29:19 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Checking cluster status. 2024-11-07 00:29:19 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Opening db connection for root@None 2024-11-07 00:29:19 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:29:19 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: coordinator.DelayedActionCoordinator Publishing state 2024-11-07 00:29:20 INFO juju.worker.uniter.operation runhook.go:159 ran "db-router-relation-changed" hook (via explicit, bespoke hook script) 2024-11-07 00:29:20 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (47; unit: placement-mysql-router/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:29:20 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-07 00:29:20 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/1 uniter (run relation-changed (47; unit: placement-mysql-router/0) hook) 2024-11-07 00:29:20 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/1 2024-11-07 00:29:20 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:29:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-11-07 00:29:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 00:29:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 00:29:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-11-07 00:29:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 00:29:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 00:29:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 00:29:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-11-07 00:29:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 00:29:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-11-07 00:29:20 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (41; unit: neutron-mysql-router/0) hook for mysql-innodb-cluster/1 2024-11-07 00:29:20 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/1 uniter (run relation-changed (41; unit: neutron-mysql-router/0) hook) 2024-11-07 00:29:20 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/1 uniter (run relation-changed (41; unit: neutron-mysql-router/0) hook) 2024-11-07 00:29:20 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (41; unit: neutron-mysql-router/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:29:20 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (41; unit: neutron-mysql-router/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:29:20 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running db-router-relation-changed hook for neutron-mysql-router/0 2024-11-07 00:29:20 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-1/agent.socket } 2024-11-07 00:29:21 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Reactive main running for hook db-router-relation-changed 2024-11-07 00:29:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer> tracer: set flag endpoint.db-router.changed tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:334:db_router_respond 2024-11-07 00:29:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.snapd_refresh 2024-11-07 00:29:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.ssl_cert 2024-11-07 00:29:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.ssl_key 2024-11-07 00:29:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.ssl_ca 2024-11-07 00:29:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.set.source 2024-11-07 00:29:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.source 2024-11-07 00:29:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.set.cluster-name 2024-11-07 00:29:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.cluster-name 2024-11-07 00:29:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.set.auto-rejoin-tries 2024-11-07 00:29:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.auto-rejoin-tries 2024-11-07 00:29:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.set.expel-timeout 2024-11-07 00:29:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.expel-timeout 2024-11-07 00:29:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.set.innodb-buffer-pool-size 2024-11-07 00:29:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.set.innodb-change-buffering 2024-11-07 00:29:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.innodb-change-buffering 2024-11-07 00:29:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.set.innodb-io-capacity 2024-11-07 00:29:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.innodb-io-capacity 2024-11-07 00:29:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.set.innodb-file-per-table 2024-11-07 00:29:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.innodb-file-per-table 2024-11-07 00:29:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.set.tuning-level 2024-11-07 00:29:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.tuning-level 2024-11-07 00:29:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.set.table-open-cache 2024-11-07 00:29:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.table-open-cache 2024-11-07 00:29:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.set.max-connections 2024-11-07 00:29:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.enable-binlogs 2024-11-07 00:29:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.set.binlogs-path 2024-11-07 00:29:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.binlogs-path 2024-11-07 00:29:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.set.binlogs-max-size 2024-11-07 00:29:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.binlogs-max-size 2024-11-07 00:29:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.set.binlogs-expire-days 2024-11-07 00:29:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.binlogs-expire-days 2024-11-07 00:29:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.prefer-ipv6 2024-11-07 00:29:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.set.wait-timeout 2024-11-07 00:29:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.wait-timeout 2024-11-07 00:29:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.os-db-router-hostname 2024-11-07 00:29:22 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Initializing Snap Layer 2024-11-07 00:29:22 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: coordinator.DelayedActionCoordinator Loading state 2024-11-07 00:29:22 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:29:22 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Coordinator: Initializing coordinator layer 2024-11-07 00:29:22 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Initializing Leadership Layer (is leader) 2024-11-07 00:29:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer> tracer: starting handler dispatch, 93 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-49-102-64 tracer: set flag leadership.set.cluster-instance-clustered-252-49-107-157 tracer: set flag leadership.set.cluster-instance-clustered-252-49-94-42 tracer: set flag leadership.set.cluster-instance-configured-252-49-102-64 tracer: set flag leadership.set.cluster-instance-configured-252-49-107-157 tracer: set flag leadership.set.cluster-instance-configured-252-49-94-42 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-11-07 00:29:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: hooks phase, 0 handlers queued 2024-11-07 00:29:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:334:db_router_respond 2024-11-07 00:29:22 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 00:29:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Found peers: 252.49.107.157,252.49.94.42 2024-11-07 00:29:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Expect 2 peers 2024-11-07 00:29:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Reached quorum 2024-11-07 00:29:22 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:334:db_router_respond 2024-11-07 00:29:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: DB router respond 2024-11-07 00:29:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Checking cluster status. 2024-11-07 00:29:23 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Checking cluster status. 2024-11-07 00:29:24 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Opening db connection for clusteruser@252.49.102.64 2024-11-07 00:29:24 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Single hostname provided by relation: 252.49.180.63 2024-11-07 00:29:24 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Opening db connection for root@None 2024-11-07 00:29:24 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Grant exists for host '252.49.180.63' on db 'keystone' 2024-11-07 00:29:24 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Proactively resetting ssl_ca 2024-11-07 00:29:24 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Single hostname provided by relation: 252.49.180.63 2024-11-07 00:29:24 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: DB user mysqlrouteruser already exists. 2024-11-07 00:29:24 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: DB user mysqlrouteruser already exists. 2024-11-07 00:29:24 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Proactively resetting ssl_ca 2024-11-07 00:29:24 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Single hostname provided by relation: 252.49.232.189 2024-11-07 00:29:24 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Grant exists for host '252.49.232.189' on db 'glance' 2024-11-07 00:29:24 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Proactively resetting ssl_ca 2024-11-07 00:29:24 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Single hostname provided by relation: 252.49.232.189 2024-11-07 00:29:24 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: DB user mysqlrouteruser already exists. 2024-11-07 00:29:24 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: DB user mysqlrouteruser already exists. 2024-11-07 00:29:24 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Proactively resetting ssl_ca 2024-11-07 00:29:24 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Single hostname provided by relation: 252.49.162.4 2024-11-07 00:29:24 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: DB user mysqlrouteruser already exists. 2024-11-07 00:29:24 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Proactively resetting ssl_ca 2024-11-07 00:29:24 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Single hostname provided by relation: 252.49.40.210 2024-11-07 00:29:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Grant exists for host '252.49.40.210' on db 'horizon' 2024-11-07 00:29:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Proactively resetting ssl_ca 2024-11-07 00:29:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Single hostname provided by relation: 252.49.40.210 2024-11-07 00:29:25 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: DB user mysqlrouteruser already exists. 2024-11-07 00:29:25 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: DB user mysqlrouteruser already exists. 2024-11-07 00:29:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Proactively resetting ssl_ca 2024-11-07 00:29:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Single hostname provided by relation: 252.49.118.130 2024-11-07 00:29:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Grant exists for host '252.49.118.130' on db 'heat' 2024-11-07 00:29:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Proactively resetting ssl_ca 2024-11-07 00:29:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Single hostname provided by relation: 252.49.118.130 2024-11-07 00:29:25 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: DB user mysqlrouteruser already exists. 2024-11-07 00:29:25 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: DB user mysqlrouteruser already exists. 2024-11-07 00:29:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Proactively resetting ssl_ca 2024-11-07 00:29:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Single hostname provided by relation: 252.49.117.199 2024-11-07 00:29:25 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: DB user mysqlrouteruser already exists. 2024-11-07 00:29:25 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: DB user mysqlrouteruser already exists. 2024-11-07 00:29:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Proactively resetting ssl_ca 2024-11-07 00:29:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: DB Router relation created DBs and users. 2024-11-07 00:29:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer> tracer: cleared flag endpoint.db-router.changed tracer: -- dequeue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: -- dequeue handler reactive/mysql_innodb_cluster_handlers.py:334:db_router_respond 2024-11-07 00:29:25 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-11-07 00:29:25 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-11-07 00:29:25 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-11-07 00:29:25 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 00:29:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Running _assess_status() 2024-11-07 00:29:26 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-11-07 00:29:26 DEBUG unit.mysql-innodb-cluster/1.db-router-relation-changed logger.go:60 active 2024-11-07 00:29:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Opening db connection for root@localhost 2024-11-07 00:29:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Checking cluster status. 2024-11-07 00:29:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Opening db connection for root@None 2024-11-07 00:29:26 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:29:26 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: coordinator.DelayedActionCoordinator Publishing state 2024-11-07 00:29:27 INFO juju.worker.uniter.operation runhook.go:159 ran "db-router-relation-changed" hook (via explicit, bespoke hook script) 2024-11-07 00:29:27 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (41; unit: neutron-mysql-router/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:29:27 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-07 00:29:27 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/1 uniter (run relation-changed (41; unit: neutron-mysql-router/0) hook) 2024-11-07 00:29:27 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/1 2024-11-07 00:29:27 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:29:27 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 00:29:27 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 00:29:27 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 00:29:27 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-11-07 00:29:27 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 00:29:27 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 00:29:27 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 00:29:27 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-11-07 00:29:27 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 00:29:27 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-11-07 00:29:27 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-11-07 00:29:27 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 2024-11-07 00:29:27 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:29:27 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-11-07 00:29:27 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 00:29:27 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 00:29:27 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-11-07 00:29:27 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 00:29:27 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 00:29:27 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-11-07 00:29:27 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-11-07 00:29:27 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 00:29:27 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 00:29:27 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 00:29:27 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for mysql-innodb-cluster/1 : {47 {map[placement-mysql-router/0:{2}] map[] []}} 2024-11-07 00:29:27 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:29:27 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 00:29:27 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 00:29:27 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-11-07 00:29:27 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 00:29:27 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-11-07 00:29:27 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-11-07 00:29:27 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 00:29:27 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-11-07 00:29:27 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (47; unit: placement-mysql-router/0) hook for mysql-innodb-cluster/1 2024-11-07 00:29:27 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/1 uniter (run relation-changed (47; unit: placement-mysql-router/0) hook) 2024-11-07 00:29:27 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/1 uniter (run relation-changed (47; unit: placement-mysql-router/0) hook) 2024-11-07 00:29:27 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (47; unit: placement-mysql-router/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:29:27 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (47; unit: placement-mysql-router/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:29:27 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running db-router-relation-changed hook for placement-mysql-router/0 2024-11-07 00:29:27 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-1/agent.socket } 2024-11-07 00:29:28 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Reactive main running for hook db-router-relation-changed 2024-11-07 00:29:28 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer> tracer: set flag endpoint.db-router.changed tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:334:db_router_respond 2024-11-07 00:29:28 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag endpoint.db-router.changed.novaapi_database 2024-11-07 00:29:28 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag endpoint.db-router.changed.novaapi_hostname 2024-11-07 00:29:28 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag endpoint.db-router.changed.novaapi_username 2024-11-07 00:29:28 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag endpoint.db-router.changed.placement_database 2024-11-07 00:29:28 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag endpoint.db-router.changed.placement_hostname 2024-11-07 00:29:28 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag endpoint.db-router.changed.placement_username 2024-11-07 00:29:28 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.snapd_refresh 2024-11-07 00:29:28 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.ssl_cert 2024-11-07 00:29:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.ssl_key 2024-11-07 00:29:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.ssl_ca 2024-11-07 00:29:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.set.source 2024-11-07 00:29:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.source 2024-11-07 00:29:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.set.cluster-name 2024-11-07 00:29:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.cluster-name 2024-11-07 00:29:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.set.auto-rejoin-tries 2024-11-07 00:29:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.auto-rejoin-tries 2024-11-07 00:29:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.set.expel-timeout 2024-11-07 00:29:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.expel-timeout 2024-11-07 00:29:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.set.innodb-buffer-pool-size 2024-11-07 00:29:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.set.innodb-change-buffering 2024-11-07 00:29:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.innodb-change-buffering 2024-11-07 00:29:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.set.innodb-io-capacity 2024-11-07 00:29:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.innodb-io-capacity 2024-11-07 00:29:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.set.innodb-file-per-table 2024-11-07 00:29:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.innodb-file-per-table 2024-11-07 00:29:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.set.tuning-level 2024-11-07 00:29:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.tuning-level 2024-11-07 00:29:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.set.table-open-cache 2024-11-07 00:29:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.table-open-cache 2024-11-07 00:29:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.set.max-connections 2024-11-07 00:29:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.enable-binlogs 2024-11-07 00:29:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.set.binlogs-path 2024-11-07 00:29:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.binlogs-path 2024-11-07 00:29:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.set.binlogs-max-size 2024-11-07 00:29:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.binlogs-max-size 2024-11-07 00:29:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.set.binlogs-expire-days 2024-11-07 00:29:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.binlogs-expire-days 2024-11-07 00:29:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.prefer-ipv6 2024-11-07 00:29:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.set.wait-timeout 2024-11-07 00:29:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.wait-timeout 2024-11-07 00:29:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: set flag config.default.os-db-router-hostname 2024-11-07 00:29:30 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Initializing Snap Layer 2024-11-07 00:29:30 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: coordinator.DelayedActionCoordinator Loading state 2024-11-07 00:29:30 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:29:30 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Coordinator: Initializing coordinator layer 2024-11-07 00:29:30 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Initializing Leadership Layer (is leader) 2024-11-07 00:29:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer> tracer: starting handler dispatch, 99 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-49-102-64 tracer: set flag leadership.set.cluster-instance-clustered-252-49-107-157 tracer: set flag leadership.set.cluster-instance-clustered-252-49-94-42 tracer: set flag leadership.set.cluster-instance-configured-252-49-102-64 tracer: set flag leadership.set.cluster-instance-configured-252-49-107-157 tracer: set flag leadership.set.cluster-instance-configured-252-49-94-42 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-11-07 00:29:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer: hooks phase, 0 handlers queued 2024-11-07 00:29:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:334:db_router_respond 2024-11-07 00:29:30 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 00:29:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Found peers: 252.49.107.157,252.49.94.42 2024-11-07 00:29:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Expect 2 peers 2024-11-07 00:29:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Reached quorum 2024-11-07 00:29:30 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:334:db_router_respond 2024-11-07 00:29:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: DB router respond 2024-11-07 00:29:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Checking cluster status. 2024-11-07 00:29:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Checking cluster status. 2024-11-07 00:29:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Opening db connection for clusteruser@252.49.102.64 2024-11-07 00:29:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Single hostname provided by relation: 252.49.180.63 2024-11-07 00:29:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Opening db connection for root@None 2024-11-07 00:29:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Grant exists for host '252.49.180.63' on db 'keystone' 2024-11-07 00:29:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Proactively resetting ssl_ca 2024-11-07 00:29:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Single hostname provided by relation: 252.49.180.63 2024-11-07 00:29:32 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: DB user mysqlrouteruser already exists. 2024-11-07 00:29:32 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: DB user mysqlrouteruser already exists. 2024-11-07 00:29:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Proactively resetting ssl_ca 2024-11-07 00:29:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Single hostname provided by relation: 252.49.232.189 2024-11-07 00:29:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Grant exists for host '252.49.232.189' on db 'glance' 2024-11-07 00:29:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Proactively resetting ssl_ca 2024-11-07 00:29:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Single hostname provided by relation: 252.49.232.189 2024-11-07 00:29:32 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: DB user mysqlrouteruser already exists. 2024-11-07 00:29:32 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: DB user mysqlrouteruser already exists. 2024-11-07 00:29:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Proactively resetting ssl_ca 2024-11-07 00:29:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Single hostname provided by relation: 252.49.162.4 2024-11-07 00:29:32 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: DB user mysqlrouteruser already exists. 2024-11-07 00:29:32 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: DB user mysqlrouteruser already exists. 2024-11-07 00:29:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Proactively resetting ssl_ca 2024-11-07 00:29:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Single hostname provided by relation: 252.49.40.210 2024-11-07 00:29:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Grant exists for host '252.49.40.210' on db 'horizon' 2024-11-07 00:29:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Proactively resetting ssl_ca 2024-11-07 00:29:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Single hostname provided by relation: 252.49.40.210 2024-11-07 00:29:32 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: DB user mysqlrouteruser already exists. 2024-11-07 00:29:32 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: DB user mysqlrouteruser already exists. 2024-11-07 00:29:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Proactively resetting ssl_ca 2024-11-07 00:29:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Single hostname provided by relation: 252.49.118.130 2024-11-07 00:29:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Grant exists for host '252.49.118.130' on db 'heat' 2024-11-07 00:29:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Proactively resetting ssl_ca 2024-11-07 00:29:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Single hostname provided by relation: 252.49.118.130 2024-11-07 00:29:33 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: DB user mysqlrouteruser already exists. 2024-11-07 00:29:33 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: DB user mysqlrouteruser already exists. 2024-11-07 00:29:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Proactively resetting ssl_ca 2024-11-07 00:29:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Single hostname provided by relation: 252.49.117.199 2024-11-07 00:29:33 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: DB user mysqlrouteruser already exists. 2024-11-07 00:29:33 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: DB user mysqlrouteruser already exists. 2024-11-07 00:29:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Proactively resetting ssl_ca 2024-11-07 00:29:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Single hostname provided by relation: 252.49.117.199 2024-11-07 00:29:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Generating new password file '/var/lib/charm/mysql-innodb-cluster/mysql-nova.passwd' 2024-11-07 00:29:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Writing file /var/lib/charm/mysql-innodb-cluster/mysql-nova.passwd root:root 660 2024-11-07 00:29:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Grant exists for host '252.49.117.199' on db 'nova_api' 2024-11-07 00:29:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Proactively resetting ssl_ca 2024-11-07 00:29:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Single hostname provided by relation: 252.49.117.199 2024-11-07 00:29:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Generating new password file '/var/lib/charm/mysql-innodb-cluster/mysql-placement.passwd' 2024-11-07 00:29:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Writing file /var/lib/charm/mysql-innodb-cluster/mysql-placement.passwd root:root 660 2024-11-07 00:29:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Grant exists for host '252.49.117.199' on db 'placement' 2024-11-07 00:29:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Proactively resetting ssl_ca 2024-11-07 00:29:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: DB Router relation created DBs and users. 2024-11-07 00:29:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: tracer> tracer: cleared flag endpoint.db-router.changed tracer: -- dequeue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: -- dequeue handler reactive/mysql_innodb_cluster_handlers.py:334:db_router_respond 2024-11-07 00:29:33 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-11-07 00:29:33 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-11-07 00:29:33 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-11-07 00:29:33 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 00:29:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Running _assess_status() 2024-11-07 00:29:33 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for mysql-innodb-cluster/1: ok=true 2024-11-07 00:29:34 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-11-07 00:29:34 DEBUG unit.mysql-innodb-cluster/1.db-router-relation-changed logger.go:60 active 2024-11-07 00:29:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Opening db connection for root@localhost 2024-11-07 00:29:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Checking cluster status. 2024-11-07 00:29:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: Opening db connection for root@None 2024-11-07 00:29:34 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:29:34 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:47: coordinator.DelayedActionCoordinator Publishing state 2024-11-07 00:29:35 INFO juju.worker.uniter.operation runhook.go:159 ran "db-router-relation-changed" hook (via explicit, bespoke hook script) 2024-11-07 00:29:35 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (47; unit: placement-mysql-router/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:29:35 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-07 00:29:35 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/1 uniter (run relation-changed (47; unit: placement-mysql-router/0) hook) 2024-11-07 00:29:35 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/1 2024-11-07 00:29:35 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:29:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 00:29:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 00:29:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-11-07 00:29:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 00:29:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 00:29:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-11-07 00:29:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 00:29:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 00:29:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-11-07 00:29:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 00:29:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-11-07 00:29:35 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 2024-11-07 00:29:35 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:29:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 00:29:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 00:29:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-11-07 00:29:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 00:29:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-11-07 00:29:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 00:29:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 00:29:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 00:29:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-11-07 00:29:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 00:29:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-11-07 00:29:38 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for mysql-innodb-cluster/1 : {39 {map[nova-mysql-router/0:{1}] map[] []}} 2024-11-07 00:29:38 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:29:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-11-07 00:29:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-11-07 00:29:38 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (39; unit: nova-mysql-router/0) hook for mysql-innodb-cluster/1 2024-11-07 00:29:38 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/1 uniter (run relation-changed (39; unit: nova-mysql-router/0) hook) 2024-11-07 00:29:38 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/1 uniter (run relation-changed (39; unit: nova-mysql-router/0) hook) 2024-11-07 00:29:38 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (39; unit: nova-mysql-router/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:29:38 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (39; unit: nova-mysql-router/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:29:38 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running db-router-relation-changed hook for nova-mysql-router/0 2024-11-07 00:29:38 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-1/agent.socket } 2024-11-07 00:29:38 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for mysql-innodb-cluster/1 : {41 {map[neutron-mysql-router/0:{2}] map[] []}} 2024-11-07 00:29:38 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Reactive main running for hook db-router-relation-changed 2024-11-07 00:29:39 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer> tracer: set flag endpoint.db-router.changed tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:334:db_router_respond 2024-11-07 00:29:39 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.snapd_refresh 2024-11-07 00:29:39 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.ssl_cert 2024-11-07 00:29:39 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.ssl_key 2024-11-07 00:29:39 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.ssl_ca 2024-11-07 00:29:39 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.set.source 2024-11-07 00:29:39 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.source 2024-11-07 00:29:39 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.set.cluster-name 2024-11-07 00:29:39 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.cluster-name 2024-11-07 00:29:39 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.set.auto-rejoin-tries 2024-11-07 00:29:39 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.auto-rejoin-tries 2024-11-07 00:29:39 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.set.expel-timeout 2024-11-07 00:29:39 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.expel-timeout 2024-11-07 00:29:39 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.set.innodb-buffer-pool-size 2024-11-07 00:29:39 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.set.innodb-change-buffering 2024-11-07 00:29:39 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.innodb-change-buffering 2024-11-07 00:29:39 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.set.innodb-io-capacity 2024-11-07 00:29:39 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.innodb-io-capacity 2024-11-07 00:29:39 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.set.innodb-file-per-table 2024-11-07 00:29:39 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.innodb-file-per-table 2024-11-07 00:29:39 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.set.tuning-level 2024-11-07 00:29:39 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.tuning-level 2024-11-07 00:29:39 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.set.table-open-cache 2024-11-07 00:29:39 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.table-open-cache 2024-11-07 00:29:39 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.set.max-connections 2024-11-07 00:29:39 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.enable-binlogs 2024-11-07 00:29:39 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.set.binlogs-path 2024-11-07 00:29:39 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.binlogs-path 2024-11-07 00:29:39 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.set.binlogs-max-size 2024-11-07 00:29:39 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.binlogs-max-size 2024-11-07 00:29:39 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.set.binlogs-expire-days 2024-11-07 00:29:39 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.binlogs-expire-days 2024-11-07 00:29:40 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.prefer-ipv6 2024-11-07 00:29:40 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.set.wait-timeout 2024-11-07 00:29:40 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.wait-timeout 2024-11-07 00:29:40 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.os-db-router-hostname 2024-11-07 00:29:40 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Initializing Snap Layer 2024-11-07 00:29:40 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: coordinator.DelayedActionCoordinator Loading state 2024-11-07 00:29:40 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:29:40 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Coordinator: Initializing coordinator layer 2024-11-07 00:29:40 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Initializing Leadership Layer (is leader) 2024-11-07 00:29:40 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag leadership.changed.mysql-nova.passwd 2024-11-07 00:29:40 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag leadership.set.mysql-nova.passwd 2024-11-07 00:29:40 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag leadership.changed.mysql-placement.passwd 2024-11-07 00:29:40 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag leadership.set.mysql-placement.passwd 2024-11-07 00:29:40 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag leadership.changed 2024-11-07 00:29:40 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer> tracer: starting handler dispatch, 104 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.changed tracer: set flag leadership.changed.mysql-nova.passwd tracer: set flag leadership.changed.mysql-placement.passwd tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-49-102-64 tracer: set flag leadership.set.cluster-instance-clustered-252-49-107-157 tracer: set flag leadership.set.cluster-instance-clustered-252-49-94-42 tracer: set flag leadership.set.cluster-instance-configured-252-49-102-64 tracer: set flag leadership.set.cluster-instance-configured-252-49-107-157 tracer: set flag leadership.set.cluster-instance-configured-252-49-94-42 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-11-07 00:29:40 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: hooks phase, 0 handlers queued 2024-11-07 00:29:40 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:334:db_router_respond 2024-11-07 00:29:40 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 00:29:40 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Found peers: 252.49.107.157,252.49.94.42 2024-11-07 00:29:40 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Expect 2 peers 2024-11-07 00:29:40 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Reached quorum 2024-11-07 00:29:40 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:334:db_router_respond 2024-11-07 00:29:40 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: DB router respond 2024-11-07 00:29:40 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Checking cluster status. 2024-11-07 00:29:41 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Checking cluster status. 2024-11-07 00:29:42 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Opening db connection for clusteruser@252.49.102.64 2024-11-07 00:29:42 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Single hostname provided by relation: 252.49.180.63 2024-11-07 00:29:42 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Opening db connection for root@None 2024-11-07 00:29:42 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Grant exists for host '252.49.180.63' on db 'keystone' 2024-11-07 00:29:42 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Proactively resetting ssl_ca 2024-11-07 00:29:42 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Single hostname provided by relation: 252.49.180.63 2024-11-07 00:29:42 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: DB user mysqlrouteruser already exists. 2024-11-07 00:29:42 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: DB user mysqlrouteruser already exists. 2024-11-07 00:29:42 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Proactively resetting ssl_ca 2024-11-07 00:29:42 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Single hostname provided by relation: 252.49.232.189 2024-11-07 00:29:42 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Grant exists for host '252.49.232.189' on db 'glance' 2024-11-07 00:29:42 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Proactively resetting ssl_ca 2024-11-07 00:29:42 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Single hostname provided by relation: 252.49.232.189 2024-11-07 00:29:42 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: DB user mysqlrouteruser already exists. 2024-11-07 00:29:42 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: DB user mysqlrouteruser already exists. 2024-11-07 00:29:42 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Proactively resetting ssl_ca 2024-11-07 00:29:42 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Single hostname provided by relation: 252.49.151.102 2024-11-07 00:29:42 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: DB user mysqlrouteruser already exists. 2024-11-07 00:29:42 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Proactively resetting ssl_ca 2024-11-07 00:29:42 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Single hostname provided by relation: 252.49.162.4 2024-11-07 00:29:42 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: DB user mysqlrouteruser already exists. 2024-11-07 00:29:42 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: DB user mysqlrouteruser already exists. 2024-11-07 00:29:42 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Proactively resetting ssl_ca 2024-11-07 00:29:42 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Single hostname provided by relation: 252.49.40.210 2024-11-07 00:29:42 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Grant exists for host '252.49.40.210' on db 'horizon' 2024-11-07 00:29:42 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Proactively resetting ssl_ca 2024-11-07 00:29:42 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Single hostname provided by relation: 252.49.40.210 2024-11-07 00:29:42 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: DB user mysqlrouteruser already exists. 2024-11-07 00:29:42 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: DB user mysqlrouteruser already exists. 2024-11-07 00:29:42 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Proactively resetting ssl_ca 2024-11-07 00:29:42 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Single hostname provided by relation: 252.49.118.130 2024-11-07 00:29:42 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Grant exists for host '252.49.118.130' on db 'heat' 2024-11-07 00:29:42 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Proactively resetting ssl_ca 2024-11-07 00:29:42 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Single hostname provided by relation: 252.49.118.130 2024-11-07 00:29:42 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: DB user mysqlrouteruser already exists. 2024-11-07 00:29:42 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: DB user mysqlrouteruser already exists. 2024-11-07 00:29:42 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Proactively resetting ssl_ca 2024-11-07 00:29:42 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Single hostname provided by relation: 252.49.117.199 2024-11-07 00:29:42 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: DB user mysqlrouteruser already exists. 2024-11-07 00:29:42 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: DB user mysqlrouteruser already exists. 2024-11-07 00:29:43 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Proactively resetting ssl_ca 2024-11-07 00:29:43 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Single hostname provided by relation: 252.49.117.199 2024-11-07 00:29:43 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Grant exists for host '252.49.117.199' on db 'nova_api' 2024-11-07 00:29:43 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Proactively resetting ssl_ca 2024-11-07 00:29:43 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Single hostname provided by relation: 252.49.117.199 2024-11-07 00:29:43 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Grant exists for host '252.49.117.199' on db 'placement' 2024-11-07 00:29:43 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Proactively resetting ssl_ca 2024-11-07 00:29:43 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: DB Router relation created DBs and users. 2024-11-07 00:29:43 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer> tracer: cleared flag endpoint.db-router.changed tracer: -- dequeue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: -- dequeue handler reactive/mysql_innodb_cluster_handlers.py:334:db_router_respond 2024-11-07 00:29:43 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-11-07 00:29:43 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-11-07 00:29:43 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-11-07 00:29:43 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 00:29:43 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Running _assess_status() 2024-11-07 00:29:43 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-11-07 00:29:43 DEBUG unit.mysql-innodb-cluster/1.db-router-relation-changed logger.go:60 active 2024-11-07 00:29:43 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Opening db connection for root@localhost 2024-11-07 00:29:43 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Checking cluster status. 2024-11-07 00:29:44 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Opening db connection for root@None 2024-11-07 00:29:44 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:29:44 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: coordinator.DelayedActionCoordinator Publishing state 2024-11-07 00:29:44 INFO juju.worker.uniter.operation runhook.go:159 ran "db-router-relation-changed" hook (via explicit, bespoke hook script) 2024-11-07 00:29:44 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (39; unit: nova-mysql-router/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:29:44 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-07 00:29:44 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/1 uniter (run relation-changed (39; unit: nova-mysql-router/0) hook) 2024-11-07 00:29:44 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/1 2024-11-07 00:29:44 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:29:44 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-11-07 00:29:44 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (41; unit: neutron-mysql-router/0) hook for mysql-innodb-cluster/1 2024-11-07 00:29:44 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/1 uniter (run relation-changed (41; unit: neutron-mysql-router/0) hook) 2024-11-07 00:29:44 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/1 uniter (run relation-changed (41; unit: neutron-mysql-router/0) hook) 2024-11-07 00:29:44 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (41; unit: neutron-mysql-router/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:29:45 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (41; unit: neutron-mysql-router/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:29:45 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running db-router-relation-changed hook for neutron-mysql-router/0 2024-11-07 00:29:45 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-1/agent.socket } 2024-11-07 00:29:45 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Reactive main running for hook db-router-relation-changed 2024-11-07 00:29:45 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer> tracer: set flag endpoint.db-router.changed tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:334:db_router_respond 2024-11-07 00:29:45 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.snapd_refresh 2024-11-07 00:29:45 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.ssl_cert 2024-11-07 00:29:45 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.ssl_key 2024-11-07 00:29:45 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.ssl_ca 2024-11-07 00:29:45 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.set.source 2024-11-07 00:29:45 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.source 2024-11-07 00:29:46 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.set.cluster-name 2024-11-07 00:29:46 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.cluster-name 2024-11-07 00:29:46 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.set.auto-rejoin-tries 2024-11-07 00:29:46 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.auto-rejoin-tries 2024-11-07 00:29:46 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.set.expel-timeout 2024-11-07 00:29:46 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.expel-timeout 2024-11-07 00:29:46 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.set.innodb-buffer-pool-size 2024-11-07 00:29:46 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.set.innodb-change-buffering 2024-11-07 00:29:46 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.innodb-change-buffering 2024-11-07 00:29:46 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.set.innodb-io-capacity 2024-11-07 00:29:46 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.innodb-io-capacity 2024-11-07 00:29:46 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.set.innodb-file-per-table 2024-11-07 00:29:46 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.innodb-file-per-table 2024-11-07 00:29:46 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.set.tuning-level 2024-11-07 00:29:46 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.tuning-level 2024-11-07 00:29:46 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.set.table-open-cache 2024-11-07 00:29:46 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.table-open-cache 2024-11-07 00:29:46 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.set.max-connections 2024-11-07 00:29:46 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.enable-binlogs 2024-11-07 00:29:46 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.set.binlogs-path 2024-11-07 00:29:46 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.binlogs-path 2024-11-07 00:29:46 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.set.binlogs-max-size 2024-11-07 00:29:46 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.binlogs-max-size 2024-11-07 00:29:46 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.set.binlogs-expire-days 2024-11-07 00:29:46 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.binlogs-expire-days 2024-11-07 00:29:46 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.prefer-ipv6 2024-11-07 00:29:46 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.set.wait-timeout 2024-11-07 00:29:46 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.wait-timeout 2024-11-07 00:29:46 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: set flag config.default.os-db-router-hostname 2024-11-07 00:29:46 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Initializing Snap Layer 2024-11-07 00:29:46 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: coordinator.DelayedActionCoordinator Loading state 2024-11-07 00:29:46 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:29:46 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Coordinator: Initializing coordinator layer 2024-11-07 00:29:46 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Initializing Leadership Layer (is leader) 2024-11-07 00:29:47 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: cleared flag leadership.changed.mysql-nova.passwd 2024-11-07 00:29:47 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: cleared flag leadership.changed.mysql-placement.passwd 2024-11-07 00:29:47 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: cleared flag leadership.changed 2024-11-07 00:29:47 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer> tracer: starting handler dispatch, 101 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-49-102-64 tracer: set flag leadership.set.cluster-instance-clustered-252-49-107-157 tracer: set flag leadership.set.cluster-instance-clustered-252-49-94-42 tracer: set flag leadership.set.cluster-instance-configured-252-49-102-64 tracer: set flag leadership.set.cluster-instance-configured-252-49-107-157 tracer: set flag leadership.set.cluster-instance-configured-252-49-94-42 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-11-07 00:29:47 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer: hooks phase, 0 handlers queued 2024-11-07 00:29:47 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:334:db_router_respond 2024-11-07 00:29:47 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 00:29:47 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Found peers: 252.49.107.157,252.49.94.42 2024-11-07 00:29:47 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Expect 2 peers 2024-11-07 00:29:47 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Reached quorum 2024-11-07 00:29:47 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:334:db_router_respond 2024-11-07 00:29:47 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: DB router respond 2024-11-07 00:29:47 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Checking cluster status. 2024-11-07 00:29:47 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Checking cluster status. 2024-11-07 00:29:48 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Opening db connection for clusteruser@252.49.102.64 2024-11-07 00:29:48 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Single hostname provided by relation: 252.49.180.63 2024-11-07 00:29:48 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Opening db connection for root@None 2024-11-07 00:29:48 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Grant exists for host '252.49.180.63' on db 'keystone' 2024-11-07 00:29:48 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Proactively resetting ssl_ca 2024-11-07 00:29:48 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Single hostname provided by relation: 252.49.180.63 2024-11-07 00:29:48 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: DB user mysqlrouteruser already exists. 2024-11-07 00:29:48 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: DB user mysqlrouteruser already exists. 2024-11-07 00:29:48 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Proactively resetting ssl_ca 2024-11-07 00:29:48 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Single hostname provided by relation: 252.49.232.189 2024-11-07 00:29:48 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Grant exists for host '252.49.232.189' on db 'glance' 2024-11-07 00:29:48 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Proactively resetting ssl_ca 2024-11-07 00:29:49 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Single hostname provided by relation: 252.49.232.189 2024-11-07 00:29:49 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: DB user mysqlrouteruser already exists. 2024-11-07 00:29:49 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: DB user mysqlrouteruser already exists. 2024-11-07 00:29:49 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Proactively resetting ssl_ca 2024-11-07 00:29:49 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Single hostname provided by relation: 252.49.151.102 2024-11-07 00:29:49 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: DB user mysqlrouteruser already exists. 2024-11-07 00:29:49 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: DB user mysqlrouteruser already exists. 2024-11-07 00:29:49 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Proactively resetting ssl_ca 2024-11-07 00:29:49 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Single hostname provided by relation: 252.49.162.4 2024-11-07 00:29:49 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Generating new password file '/var/lib/charm/mysql-innodb-cluster/mysql-neutron.passwd' 2024-11-07 00:29:49 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Writing file /var/lib/charm/mysql-innodb-cluster/mysql-neutron.passwd root:root 660 2024-11-07 00:29:49 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Grant exists for host '252.49.162.4' on db 'neutron' 2024-11-07 00:29:49 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for mysql-innodb-cluster/1: ok=true 2024-11-07 00:29:49 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Proactively resetting ssl_ca 2024-11-07 00:29:49 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Single hostname provided by relation: 252.49.162.4 2024-11-07 00:29:49 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: DB user mysqlrouteruser already exists. 2024-11-07 00:29:49 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: DB user mysqlrouteruser already exists. 2024-11-07 00:29:49 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Proactively resetting ssl_ca 2024-11-07 00:29:49 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Single hostname provided by relation: 252.49.40.210 2024-11-07 00:29:49 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Grant exists for host '252.49.40.210' on db 'horizon' 2024-11-07 00:29:49 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Proactively resetting ssl_ca 2024-11-07 00:29:49 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Single hostname provided by relation: 252.49.40.210 2024-11-07 00:29:49 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: DB user mysqlrouteruser already exists. 2024-11-07 00:29:49 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: DB user mysqlrouteruser already exists. 2024-11-07 00:29:49 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Proactively resetting ssl_ca 2024-11-07 00:29:49 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Single hostname provided by relation: 252.49.118.130 2024-11-07 00:29:49 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Grant exists for host '252.49.118.130' on db 'heat' 2024-11-07 00:29:49 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Proactively resetting ssl_ca 2024-11-07 00:29:49 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Single hostname provided by relation: 252.49.118.130 2024-11-07 00:29:49 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: DB user mysqlrouteruser already exists. 2024-11-07 00:29:49 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: DB user mysqlrouteruser already exists. 2024-11-07 00:29:49 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Proactively resetting ssl_ca 2024-11-07 00:29:49 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Single hostname provided by relation: 252.49.117.199 2024-11-07 00:29:49 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: DB user mysqlrouteruser already exists. 2024-11-07 00:29:49 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: DB user mysqlrouteruser already exists. 2024-11-07 00:29:49 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Proactively resetting ssl_ca 2024-11-07 00:29:49 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Single hostname provided by relation: 252.49.117.199 2024-11-07 00:29:49 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Grant exists for host '252.49.117.199' on db 'nova_api' 2024-11-07 00:29:49 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Proactively resetting ssl_ca 2024-11-07 00:29:49 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Single hostname provided by relation: 252.49.117.199 2024-11-07 00:29:49 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Grant exists for host '252.49.117.199' on db 'placement' 2024-11-07 00:29:49 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Proactively resetting ssl_ca 2024-11-07 00:29:49 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: DB Router relation created DBs and users. 2024-11-07 00:29:49 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: tracer> tracer: cleared flag endpoint.db-router.changed tracer: -- dequeue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: -- dequeue handler reactive/mysql_innodb_cluster_handlers.py:334:db_router_respond 2024-11-07 00:29:49 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-11-07 00:29:49 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-11-07 00:29:49 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-11-07 00:29:49 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 00:29:49 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Running _assess_status() 2024-11-07 00:29:50 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-11-07 00:29:50 DEBUG unit.mysql-innodb-cluster/1.db-router-relation-changed logger.go:60 active 2024-11-07 00:29:50 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Opening db connection for root@localhost 2024-11-07 00:29:50 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Checking cluster status. 2024-11-07 00:29:51 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: Opening db connection for root@None 2024-11-07 00:29:51 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:29:51 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:41: coordinator.DelayedActionCoordinator Publishing state 2024-11-07 00:29:51 INFO juju.worker.uniter.operation runhook.go:159 ran "db-router-relation-changed" hook (via explicit, bespoke hook script) 2024-11-07 00:29:51 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (41; unit: neutron-mysql-router/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:29:51 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-07 00:29:51 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/1 uniter (run relation-changed (41; unit: neutron-mysql-router/0) hook) 2024-11-07 00:29:51 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/1 2024-11-07 00:29:51 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:29:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-11-07 00:29:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 00:29:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-11-07 00:29:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 00:29:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 00:29:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 00:29:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-11-07 00:29:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 00:29:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-11-07 00:29:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 00:29:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 00:29:51 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 2024-11-07 00:29:51 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:29:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-11-07 00:29:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 00:29:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 00:29:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 00:29:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-11-07 00:29:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 00:29:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 00:29:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 00:29:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 00:29:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-11-07 00:29:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-11-07 00:30:43 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for mysql-innodb-cluster/1 2024-11-07 00:30:43 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:30:43 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-11-07 00:30:43 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 00:30:43 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 00:30:43 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-11-07 00:30:43 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 00:30:43 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 00:30:43 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 00:30:43 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-11-07 00:30:43 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 00:30:43 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-11-07 00:30:43 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 00:30:43 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for mysql-innodb-cluster/1 2024-11-07 00:30:43 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 00:30:43 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 00:30:43 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 00:30:44 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 00:30:44 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-1/agent.socket } 2024-11-07 00:30:44 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Reactive main running for hook update-status 2024-11-07 00:30:44 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 00:30:44 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_cert 2024-11-07 00:30:44 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_key 2024-11-07 00:30:44 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_ca 2024-11-07 00:30:44 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.source 2024-11-07 00:30:44 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.source 2024-11-07 00:30:44 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.cluster-name 2024-11-07 00:30:44 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.cluster-name 2024-11-07 00:30:44 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.auto-rejoin-tries 2024-11-07 00:30:45 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.auto-rejoin-tries 2024-11-07 00:30:45 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.expel-timeout 2024-11-07 00:30:45 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.expel-timeout 2024-11-07 00:30:45 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-buffer-pool-size 2024-11-07 00:30:45 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-change-buffering 2024-11-07 00:30:45 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-change-buffering 2024-11-07 00:30:45 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-io-capacity 2024-11-07 00:30:45 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-io-capacity 2024-11-07 00:30:45 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-file-per-table 2024-11-07 00:30:45 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-file-per-table 2024-11-07 00:30:45 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.tuning-level 2024-11-07 00:30:45 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.tuning-level 2024-11-07 00:30:45 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.table-open-cache 2024-11-07 00:30:45 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.table-open-cache 2024-11-07 00:30:45 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.max-connections 2024-11-07 00:30:45 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.enable-binlogs 2024-11-07 00:30:45 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-path 2024-11-07 00:30:45 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-path 2024-11-07 00:30:45 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-max-size 2024-11-07 00:30:45 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-max-size 2024-11-07 00:30:45 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-expire-days 2024-11-07 00:30:45 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-expire-days 2024-11-07 00:30:45 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.prefer-ipv6 2024-11-07 00:30:45 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.wait-timeout 2024-11-07 00:30:45 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.wait-timeout 2024-11-07 00:30:45 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.os-db-router-hostname 2024-11-07 00:30:45 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Initializing Snap Layer 2024-11-07 00:30:45 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Loading state 2024-11-07 00:30:45 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:30:45 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Coordinator: Initializing coordinator layer 2024-11-07 00:30:45 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Initializing Leadership Layer (is leader) 2024-11-07 00:30:45 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag leadership.changed.mysql-neutron.passwd 2024-11-07 00:30:45 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag leadership.set.mysql-neutron.passwd 2024-11-07 00:30:45 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag leadership.changed 2024-11-07 00:30:45 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: starting handler dispatch, 103 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.changed tracer: set flag leadership.changed.mysql-neutron.passwd tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-49-102-64 tracer: set flag leadership.set.cluster-instance-clustered-252-49-107-157 tracer: set flag leadership.set.cluster-instance-clustered-252-49-94-42 tracer: set flag leadership.set.cluster-instance-configured-252-49-102-64 tracer: set flag leadership.set.cluster-instance-configured-252-49-107-157 tracer: set flag leadership.set.cluster-instance-configured-252-49-94-42 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-11-07 00:30:45 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:64:default_update_status 2024-11-07 00:30:45 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:64:default_update_status 2024-11-07 00:30:45 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag run-default-update-status 2024-11-07 00:30:45 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag is-update-status-hook 2024-11-07 00:30:46 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:82:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:93:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 00:30:46 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:82:check_really_is_update_status 2024-11-07 00:30:46 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:93:run_default_update_status 2024-11-07 00:30:46 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:93:run_default_update_status 2024-11-07 00:30:46 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 00:30:46 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Found peers: 252.49.107.157,252.49.94.42 2024-11-07 00:30:46 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Expect 2 peers 2024-11-07 00:30:46 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Reached quorum 2024-11-07 00:30:46 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-11-07 00:30:46 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-11-07 00:30:46 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-11-07 00:30:46 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 00:30:46 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Running _assess_status() 2024-11-07 00:30:46 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-11-07 00:30:46 DEBUG unit.mysql-innodb-cluster/1.update-status logger.go:60 active 2024-11-07 00:30:46 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Opening db connection for root@localhost 2024-11-07 00:30:46 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Checking cluster status. 2024-11-07 00:30:47 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Opening db connection for root@None 2024-11-07 00:30:47 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 00:30:47 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:30:47 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Publishing state 2024-11-07 00:30:48 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-11-07 00:30:48 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 00:30:48 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-07 00:30:48 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 00:30:48 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/1 2024-11-07 00:30:48 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:30:48 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 00:30:48 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 00:30:48 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 00:30:48 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-11-07 00:30:48 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 00:30:48 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-11-07 00:30:48 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-11-07 00:30:48 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 00:30:48 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-11-07 00:30:48 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 00:30:48 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 00:32:30 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for mysql-innodb-cluster/1 : {39 {map[nova-mysql-router/0:{2}] map[] []}} 2024-11-07 00:32:30 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:32:30 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 00:32:30 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 00:32:30 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 00:32:30 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 00:32:30 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 00:32:30 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 00:32:30 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-11-07 00:32:30 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-11-07 00:32:30 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-11-07 00:32:30 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-11-07 00:32:30 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (39; unit: nova-mysql-router/0) hook for mysql-innodb-cluster/1 2024-11-07 00:32:30 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/1 uniter (run relation-changed (39; unit: nova-mysql-router/0) hook) 2024-11-07 00:32:30 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/1 uniter (run relation-changed (39; unit: nova-mysql-router/0) hook) 2024-11-07 00:32:30 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (39; unit: nova-mysql-router/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:32:30 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (39; unit: nova-mysql-router/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:32:30 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running db-router-relation-changed hook for nova-mysql-router/0 2024-11-07 00:32:30 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-1/agent.socket } 2024-11-07 00:32:30 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Reactive main running for hook db-router-relation-changed 2024-11-07 00:32:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer> tracer: set flag endpoint.db-router.changed tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:334:db_router_respond 2024-11-07 00:32:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag endpoint.db-router.changed.nova_database 2024-11-07 00:32:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag endpoint.db-router.changed.nova_hostname 2024-11-07 00:32:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag endpoint.db-router.changed.nova_username 2024-11-07 00:32:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag endpoint.db-router.changed.novacell0_database 2024-11-07 00:32:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag endpoint.db-router.changed.novacell0_hostname 2024-11-07 00:32:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag endpoint.db-router.changed.novacell0_username 2024-11-07 00:32:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.snapd_refresh 2024-11-07 00:32:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.ssl_cert 2024-11-07 00:32:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.ssl_key 2024-11-07 00:32:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.ssl_ca 2024-11-07 00:32:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.set.source 2024-11-07 00:32:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.source 2024-11-07 00:32:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.set.cluster-name 2024-11-07 00:32:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.cluster-name 2024-11-07 00:32:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.set.auto-rejoin-tries 2024-11-07 00:32:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.auto-rejoin-tries 2024-11-07 00:32:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.set.expel-timeout 2024-11-07 00:32:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.expel-timeout 2024-11-07 00:32:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.set.innodb-buffer-pool-size 2024-11-07 00:32:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.set.innodb-change-buffering 2024-11-07 00:32:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.innodb-change-buffering 2024-11-07 00:32:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.set.innodb-io-capacity 2024-11-07 00:32:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.innodb-io-capacity 2024-11-07 00:32:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.set.innodb-file-per-table 2024-11-07 00:32:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.innodb-file-per-table 2024-11-07 00:32:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.set.tuning-level 2024-11-07 00:32:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.tuning-level 2024-11-07 00:32:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.set.table-open-cache 2024-11-07 00:32:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.table-open-cache 2024-11-07 00:32:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.set.max-connections 2024-11-07 00:32:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.enable-binlogs 2024-11-07 00:32:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.set.binlogs-path 2024-11-07 00:32:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.binlogs-path 2024-11-07 00:32:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.set.binlogs-max-size 2024-11-07 00:32:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.binlogs-max-size 2024-11-07 00:32:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.set.binlogs-expire-days 2024-11-07 00:32:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.binlogs-expire-days 2024-11-07 00:32:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.prefer-ipv6 2024-11-07 00:32:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.set.wait-timeout 2024-11-07 00:32:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.wait-timeout 2024-11-07 00:32:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: set flag config.default.os-db-router-hostname 2024-11-07 00:32:32 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Initializing Snap Layer 2024-11-07 00:32:32 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: coordinator.DelayedActionCoordinator Loading state 2024-11-07 00:32:32 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:32:32 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Coordinator: Initializing coordinator layer 2024-11-07 00:32:32 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Initializing Leadership Layer (is leader) 2024-11-07 00:32:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: cleared flag leadership.changed.mysql-neutron.passwd 2024-11-07 00:32:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: cleared flag leadership.changed 2024-11-07 00:32:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer> tracer: starting handler dispatch, 108 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-49-102-64 tracer: set flag leadership.set.cluster-instance-clustered-252-49-107-157 tracer: set flag leadership.set.cluster-instance-clustered-252-49-94-42 tracer: set flag leadership.set.cluster-instance-configured-252-49-102-64 tracer: set flag leadership.set.cluster-instance-configured-252-49-107-157 tracer: set flag leadership.set.cluster-instance-configured-252-49-94-42 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-11-07 00:32:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer: hooks phase, 0 handlers queued 2024-11-07 00:32:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:334:db_router_respond 2024-11-07 00:32:32 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 00:32:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Found peers: 252.49.107.157,252.49.94.42 2024-11-07 00:32:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Expect 2 peers 2024-11-07 00:32:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Reached quorum 2024-11-07 00:32:32 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:334:db_router_respond 2024-11-07 00:32:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: DB router respond 2024-11-07 00:32:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Checking cluster status. 2024-11-07 00:32:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Checking cluster status. 2024-11-07 00:32:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Opening db connection for clusteruser@252.49.102.64 2024-11-07 00:32:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Single hostname provided by relation: 252.49.180.63 2024-11-07 00:32:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Opening db connection for root@None 2024-11-07 00:32:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Grant exists for host '252.49.180.63' on db 'keystone' 2024-11-07 00:32:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Proactively resetting ssl_ca 2024-11-07 00:32:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Single hostname provided by relation: 252.49.180.63 2024-11-07 00:32:34 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: DB user mysqlrouteruser already exists. 2024-11-07 00:32:34 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: DB user mysqlrouteruser already exists. 2024-11-07 00:32:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Proactively resetting ssl_ca 2024-11-07 00:32:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Single hostname provided by relation: 252.49.232.189 2024-11-07 00:32:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Grant exists for host '252.49.232.189' on db 'glance' 2024-11-07 00:32:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Proactively resetting ssl_ca 2024-11-07 00:32:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Single hostname provided by relation: 252.49.232.189 2024-11-07 00:32:34 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: DB user mysqlrouteruser already exists. 2024-11-07 00:32:34 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: DB user mysqlrouteruser already exists. 2024-11-07 00:32:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Proactively resetting ssl_ca 2024-11-07 00:32:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Single hostname provided by relation: 252.49.151.102 2024-11-07 00:32:34 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: DB user mysqlrouteruser already exists. 2024-11-07 00:32:34 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: DB user mysqlrouteruser already exists. 2024-11-07 00:32:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Proactively resetting ssl_ca 2024-11-07 00:32:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Single hostname provided by relation: 252.49.151.102 2024-11-07 00:32:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Grant exists for host '252.49.151.102' on db 'nova' 2024-11-07 00:32:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Proactively resetting ssl_ca 2024-11-07 00:32:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Single hostname provided by relation: 252.49.151.102 2024-11-07 00:32:34 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: DB user nova already exists. 2024-11-07 00:32:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Grant exists for host '252.49.151.102' on db 'nova_api' 2024-11-07 00:32:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Proactively resetting ssl_ca 2024-11-07 00:32:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Single hostname provided by relation: 252.49.151.102 2024-11-07 00:32:34 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: DB user nova already exists. 2024-11-07 00:32:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Grant exists for host '252.49.151.102' on db 'nova_cell0' 2024-11-07 00:32:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Proactively resetting ssl_ca 2024-11-07 00:32:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Single hostname provided by relation: 252.49.162.4 2024-11-07 00:32:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Grant exists for host '252.49.162.4' on db 'neutron' 2024-11-07 00:32:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Proactively resetting ssl_ca 2024-11-07 00:32:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Single hostname provided by relation: 252.49.162.4 2024-11-07 00:32:34 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: DB user mysqlrouteruser already exists. 2024-11-07 00:32:34 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: DB user mysqlrouteruser already exists. 2024-11-07 00:32:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Proactively resetting ssl_ca 2024-11-07 00:32:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Single hostname provided by relation: 252.49.40.210 2024-11-07 00:32:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Grant exists for host '252.49.40.210' on db 'horizon' 2024-11-07 00:32:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Proactively resetting ssl_ca 2024-11-07 00:32:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Single hostname provided by relation: 252.49.40.210 2024-11-07 00:32:35 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: DB user mysqlrouteruser already exists. 2024-11-07 00:32:35 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: DB user mysqlrouteruser already exists. 2024-11-07 00:32:35 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Proactively resetting ssl_ca 2024-11-07 00:32:35 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Single hostname provided by relation: 252.49.118.130 2024-11-07 00:32:35 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Grant exists for host '252.49.118.130' on db 'heat' 2024-11-07 00:32:35 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Proactively resetting ssl_ca 2024-11-07 00:32:35 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Single hostname provided by relation: 252.49.118.130 2024-11-07 00:32:35 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: DB user mysqlrouteruser already exists. 2024-11-07 00:32:35 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: DB user mysqlrouteruser already exists. 2024-11-07 00:32:35 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Proactively resetting ssl_ca 2024-11-07 00:32:35 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Single hostname provided by relation: 252.49.117.199 2024-11-07 00:32:35 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: DB user mysqlrouteruser already exists. 2024-11-07 00:32:35 WARNING unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: DB user mysqlrouteruser already exists. 2024-11-07 00:32:35 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Proactively resetting ssl_ca 2024-11-07 00:32:35 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Single hostname provided by relation: 252.49.117.199 2024-11-07 00:32:35 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Grant exists for host '252.49.117.199' on db 'nova_api' 2024-11-07 00:32:35 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Proactively resetting ssl_ca 2024-11-07 00:32:35 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Single hostname provided by relation: 252.49.117.199 2024-11-07 00:32:35 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Grant exists for host '252.49.117.199' on db 'placement' 2024-11-07 00:32:35 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Proactively resetting ssl_ca 2024-11-07 00:32:35 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: DB Router relation created DBs and users. 2024-11-07 00:32:35 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: tracer> tracer: cleared flag endpoint.db-router.changed tracer: -- dequeue handler hooks/relations/mysql-router/provides.py:53:changed:db-router tracer: -- dequeue handler reactive/mysql_innodb_cluster_handlers.py:334:db_router_respond 2024-11-07 00:32:35 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-11-07 00:32:35 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-11-07 00:32:35 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-11-07 00:32:35 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 00:32:35 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Running _assess_status() 2024-11-07 00:32:35 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-11-07 00:32:35 DEBUG unit.mysql-innodb-cluster/1.db-router-relation-changed logger.go:60 active 2024-11-07 00:32:35 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Opening db connection for root@localhost 2024-11-07 00:32:35 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Checking cluster status. 2024-11-07 00:32:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: Opening db connection for root@None 2024-11-07 00:32:36 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:32:36 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 db-router:39: coordinator.DelayedActionCoordinator Publishing state 2024-11-07 00:32:37 INFO juju.worker.uniter.operation runhook.go:159 ran "db-router-relation-changed" hook (via explicit, bespoke hook script) 2024-11-07 00:32:37 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (39; unit: nova-mysql-router/0) hook" for mysql-innodb-cluster/1 2024-11-07 00:32:37 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-07 00:32:37 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/1 uniter (run relation-changed (39; unit: nova-mysql-router/0) hook) 2024-11-07 00:32:37 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/1 2024-11-07 00:32:37 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:32:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-11-07 00:32:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 00:32:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-11-07 00:32:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 00:32:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-11-07 00:32:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-11-07 00:32:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 00:32:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 00:32:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 00:32:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 00:32:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 00:32:37 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 2024-11-07 00:36:35 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for mysql-innodb-cluster/1 2024-11-07 00:36:35 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:36:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 00:36:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 00:36:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 00:36:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-11-07 00:36:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 00:36:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 00:36:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 00:36:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-11-07 00:36:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-11-07 00:36:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-11-07 00:36:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 00:36:35 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for mysql-innodb-cluster/1 2024-11-07 00:36:35 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 00:36:35 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 00:36:35 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 00:36:35 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 00:36:35 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-1/agent.socket } 2024-11-07 00:36:36 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Reactive main running for hook update-status 2024-11-07 00:36:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 00:36:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_cert 2024-11-07 00:36:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_key 2024-11-07 00:36:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_ca 2024-11-07 00:36:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.source 2024-11-07 00:36:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.source 2024-11-07 00:36:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.cluster-name 2024-11-07 00:36:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.cluster-name 2024-11-07 00:36:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.auto-rejoin-tries 2024-11-07 00:36:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.auto-rejoin-tries 2024-11-07 00:36:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.expel-timeout 2024-11-07 00:36:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.expel-timeout 2024-11-07 00:36:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-buffer-pool-size 2024-11-07 00:36:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-change-buffering 2024-11-07 00:36:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-change-buffering 2024-11-07 00:36:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-io-capacity 2024-11-07 00:36:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-io-capacity 2024-11-07 00:36:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-file-per-table 2024-11-07 00:36:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-file-per-table 2024-11-07 00:36:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.tuning-level 2024-11-07 00:36:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.tuning-level 2024-11-07 00:36:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.table-open-cache 2024-11-07 00:36:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.table-open-cache 2024-11-07 00:36:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.max-connections 2024-11-07 00:36:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.enable-binlogs 2024-11-07 00:36:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-path 2024-11-07 00:36:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-path 2024-11-07 00:36:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-max-size 2024-11-07 00:36:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-max-size 2024-11-07 00:36:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-expire-days 2024-11-07 00:36:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-expire-days 2024-11-07 00:36:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.prefer-ipv6 2024-11-07 00:36:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.wait-timeout 2024-11-07 00:36:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.wait-timeout 2024-11-07 00:36:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.os-db-router-hostname 2024-11-07 00:36:37 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Initializing Snap Layer 2024-11-07 00:36:37 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Loading state 2024-11-07 00:36:37 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:36:37 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Coordinator: Initializing coordinator layer 2024-11-07 00:36:37 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Initializing Leadership Layer (is leader) 2024-11-07 00:36:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: starting handler dispatch, 107 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-49-102-64 tracer: set flag leadership.set.cluster-instance-clustered-252-49-107-157 tracer: set flag leadership.set.cluster-instance-clustered-252-49-94-42 tracer: set flag leadership.set.cluster-instance-configured-252-49-102-64 tracer: set flag leadership.set.cluster-instance-configured-252-49-107-157 tracer: set flag leadership.set.cluster-instance-configured-252-49-94-42 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-11-07 00:36:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:64:default_update_status 2024-11-07 00:36:37 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:64:default_update_status 2024-11-07 00:36:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag run-default-update-status 2024-11-07 00:36:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag is-update-status-hook 2024-11-07 00:36:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:82:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:93:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 00:36:37 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:82:check_really_is_update_status 2024-11-07 00:36:37 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:93:run_default_update_status 2024-11-07 00:36:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:93:run_default_update_status 2024-11-07 00:36:37 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 00:36:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Found peers: 252.49.107.157,252.49.94.42 2024-11-07 00:36:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Expect 2 peers 2024-11-07 00:36:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Reached quorum 2024-11-07 00:36:37 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-11-07 00:36:37 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-11-07 00:36:37 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-11-07 00:36:37 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 00:36:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Running _assess_status() 2024-11-07 00:36:38 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-11-07 00:36:38 DEBUG unit.mysql-innodb-cluster/1.update-status logger.go:60 active 2024-11-07 00:36:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Opening db connection for root@localhost 2024-11-07 00:36:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Checking cluster status. 2024-11-07 00:36:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Opening db connection for root@None 2024-11-07 00:36:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 00:36:38 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:36:39 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Publishing state 2024-11-07 00:36:39 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-11-07 00:36:39 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 00:36:39 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-07 00:36:39 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 00:36:39 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/1 2024-11-07 00:36:39 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:36:39 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 00:36:39 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 00:36:39 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 00:36:39 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-11-07 00:36:39 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-11-07 00:36:39 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 00:36:39 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 00:36:39 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 00:36:39 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-11-07 00:36:39 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 00:36:39 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-11-07 00:40:59 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for mysql-innodb-cluster/1 2024-11-07 00:40:59 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:40:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 00:40:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 00:40:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-11-07 00:40:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 00:40:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-11-07 00:40:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 00:40:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 00:40:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-11-07 00:40:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-11-07 00:40:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 00:40:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 00:40:59 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for mysql-innodb-cluster/1 2024-11-07 00:40:59 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 00:40:59 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 00:40:59 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 00:40:59 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 00:40:59 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-1/agent.socket } 2024-11-07 00:41:00 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Reactive main running for hook update-status 2024-11-07 00:41:00 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 00:41:00 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_cert 2024-11-07 00:41:00 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_key 2024-11-07 00:41:00 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_ca 2024-11-07 00:41:00 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.source 2024-11-07 00:41:00 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.source 2024-11-07 00:41:00 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.cluster-name 2024-11-07 00:41:00 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.cluster-name 2024-11-07 00:41:00 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.auto-rejoin-tries 2024-11-07 00:41:00 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.auto-rejoin-tries 2024-11-07 00:41:00 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.expel-timeout 2024-11-07 00:41:00 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.expel-timeout 2024-11-07 00:41:00 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-buffer-pool-size 2024-11-07 00:41:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-change-buffering 2024-11-07 00:41:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-change-buffering 2024-11-07 00:41:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-io-capacity 2024-11-07 00:41:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-io-capacity 2024-11-07 00:41:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-file-per-table 2024-11-07 00:41:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-file-per-table 2024-11-07 00:41:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.tuning-level 2024-11-07 00:41:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.tuning-level 2024-11-07 00:41:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.table-open-cache 2024-11-07 00:41:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.table-open-cache 2024-11-07 00:41:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.max-connections 2024-11-07 00:41:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.enable-binlogs 2024-11-07 00:41:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-path 2024-11-07 00:41:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-path 2024-11-07 00:41:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-max-size 2024-11-07 00:41:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-max-size 2024-11-07 00:41:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-expire-days 2024-11-07 00:41:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-expire-days 2024-11-07 00:41:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.prefer-ipv6 2024-11-07 00:41:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.wait-timeout 2024-11-07 00:41:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.wait-timeout 2024-11-07 00:41:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.os-db-router-hostname 2024-11-07 00:41:01 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Initializing Snap Layer 2024-11-07 00:41:01 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Loading state 2024-11-07 00:41:01 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:41:01 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Coordinator: Initializing coordinator layer 2024-11-07 00:41:01 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Initializing Leadership Layer (is leader) 2024-11-07 00:41:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: starting handler dispatch, 107 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-49-102-64 tracer: set flag leadership.set.cluster-instance-clustered-252-49-107-157 tracer: set flag leadership.set.cluster-instance-clustered-252-49-94-42 tracer: set flag leadership.set.cluster-instance-configured-252-49-102-64 tracer: set flag leadership.set.cluster-instance-configured-252-49-107-157 tracer: set flag leadership.set.cluster-instance-configured-252-49-94-42 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-11-07 00:41:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:64:default_update_status 2024-11-07 00:41:01 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:64:default_update_status 2024-11-07 00:41:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag run-default-update-status 2024-11-07 00:41:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag is-update-status-hook 2024-11-07 00:41:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:82:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:93:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 00:41:01 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:82:check_really_is_update_status 2024-11-07 00:41:01 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:93:run_default_update_status 2024-11-07 00:41:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:93:run_default_update_status 2024-11-07 00:41:01 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 00:41:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Found peers: 252.49.107.157,252.49.94.42 2024-11-07 00:41:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Expect 2 peers 2024-11-07 00:41:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Reached quorum 2024-11-07 00:41:01 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-11-07 00:41:01 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-11-07 00:41:01 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-11-07 00:41:01 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 00:41:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Running _assess_status() 2024-11-07 00:41:02 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-11-07 00:41:02 DEBUG unit.mysql-innodb-cluster/1.update-status logger.go:60 active 2024-11-07 00:41:02 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Opening db connection for root@localhost 2024-11-07 00:41:02 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Checking cluster status. 2024-11-07 00:41:03 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Opening db connection for root@None 2024-11-07 00:41:03 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 00:41:03 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:41:03 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Publishing state 2024-11-07 00:41:04 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-11-07 00:41:04 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 00:41:04 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-07 00:41:04 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 00:41:04 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/1 2024-11-07 00:41:04 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:41:04 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 00:41:04 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 00:41:04 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 00:41:04 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-11-07 00:41:04 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-11-07 00:41:04 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-11-07 00:41:04 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 00:41:04 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 00:41:04 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 00:41:04 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-11-07 00:41:04 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 00:45:17 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for mysql-innodb-cluster/1 2024-11-07 00:45:17 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:45:17 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-11-07 00:45:17 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 00:45:17 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 00:45:17 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 00:45:17 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 00:45:17 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-11-07 00:45:17 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 00:45:17 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 00:45:17 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-11-07 00:45:17 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-11-07 00:45:17 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 00:45:17 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for mysql-innodb-cluster/1 2024-11-07 00:45:17 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 00:45:17 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 00:45:17 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 00:45:17 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 00:45:17 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-1/agent.socket } 2024-11-07 00:45:17 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Reactive main running for hook update-status 2024-11-07 00:45:17 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 00:45:17 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_cert 2024-11-07 00:45:17 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_key 2024-11-07 00:45:17 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_ca 2024-11-07 00:45:17 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.source 2024-11-07 00:45:17 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.source 2024-11-07 00:45:17 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.cluster-name 2024-11-07 00:45:17 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.cluster-name 2024-11-07 00:45:17 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.auto-rejoin-tries 2024-11-07 00:45:17 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.auto-rejoin-tries 2024-11-07 00:45:17 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.expel-timeout 2024-11-07 00:45:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.expel-timeout 2024-11-07 00:45:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-buffer-pool-size 2024-11-07 00:45:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-change-buffering 2024-11-07 00:45:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-change-buffering 2024-11-07 00:45:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-io-capacity 2024-11-07 00:45:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-io-capacity 2024-11-07 00:45:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-file-per-table 2024-11-07 00:45:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-file-per-table 2024-11-07 00:45:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.tuning-level 2024-11-07 00:45:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.tuning-level 2024-11-07 00:45:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.table-open-cache 2024-11-07 00:45:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.table-open-cache 2024-11-07 00:45:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.max-connections 2024-11-07 00:45:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.enable-binlogs 2024-11-07 00:45:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-path 2024-11-07 00:45:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-path 2024-11-07 00:45:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-max-size 2024-11-07 00:45:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-max-size 2024-11-07 00:45:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-expire-days 2024-11-07 00:45:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-expire-days 2024-11-07 00:45:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.prefer-ipv6 2024-11-07 00:45:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.wait-timeout 2024-11-07 00:45:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.wait-timeout 2024-11-07 00:45:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.os-db-router-hostname 2024-11-07 00:45:18 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Initializing Snap Layer 2024-11-07 00:45:18 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Loading state 2024-11-07 00:45:18 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:45:18 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Coordinator: Initializing coordinator layer 2024-11-07 00:45:18 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Initializing Leadership Layer (is leader) 2024-11-07 00:45:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: starting handler dispatch, 107 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-49-102-64 tracer: set flag leadership.set.cluster-instance-clustered-252-49-107-157 tracer: set flag leadership.set.cluster-instance-clustered-252-49-94-42 tracer: set flag leadership.set.cluster-instance-configured-252-49-102-64 tracer: set flag leadership.set.cluster-instance-configured-252-49-107-157 tracer: set flag leadership.set.cluster-instance-configured-252-49-94-42 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-11-07 00:45:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:64:default_update_status 2024-11-07 00:45:18 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:64:default_update_status 2024-11-07 00:45:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag run-default-update-status 2024-11-07 00:45:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag is-update-status-hook 2024-11-07 00:45:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:82:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:93:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 00:45:18 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:82:check_really_is_update_status 2024-11-07 00:45:18 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:93:run_default_update_status 2024-11-07 00:45:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:93:run_default_update_status 2024-11-07 00:45:18 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 00:45:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Found peers: 252.49.107.157,252.49.94.42 2024-11-07 00:45:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Expect 2 peers 2024-11-07 00:45:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Reached quorum 2024-11-07 00:45:18 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-11-07 00:45:18 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-11-07 00:45:18 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-11-07 00:45:19 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 00:45:19 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Running _assess_status() 2024-11-07 00:45:19 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-11-07 00:45:19 DEBUG unit.mysql-innodb-cluster/1.update-status logger.go:60 active 2024-11-07 00:45:19 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Opening db connection for root@localhost 2024-11-07 00:45:19 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Checking cluster status. 2024-11-07 00:45:20 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Opening db connection for root@None 2024-11-07 00:45:20 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 00:45:20 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:45:20 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Publishing state 2024-11-07 00:45:20 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-11-07 00:45:20 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 00:45:20 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-07 00:45:20 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 00:45:20 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/1 2024-11-07 00:45:20 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:45:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-11-07 00:45:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-11-07 00:45:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-11-07 00:45:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 00:45:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 00:45:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-11-07 00:45:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 00:45:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 00:45:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 00:45:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 00:45:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 00:50:35 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for mysql-innodb-cluster/1 2024-11-07 00:50:35 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:50:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 00:50:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-11-07 00:50:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 00:50:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 00:50:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-11-07 00:50:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 00:50:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-11-07 00:50:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 00:50:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-11-07 00:50:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 00:50:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 00:50:35 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for mysql-innodb-cluster/1 2024-11-07 00:50:35 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 00:50:35 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 00:50:35 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 00:50:35 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 00:50:35 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-1/agent.socket } 2024-11-07 00:50:36 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Reactive main running for hook update-status 2024-11-07 00:50:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 00:50:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_cert 2024-11-07 00:50:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_key 2024-11-07 00:50:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_ca 2024-11-07 00:50:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.source 2024-11-07 00:50:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.source 2024-11-07 00:50:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.cluster-name 2024-11-07 00:50:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.cluster-name 2024-11-07 00:50:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.auto-rejoin-tries 2024-11-07 00:50:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.auto-rejoin-tries 2024-11-07 00:50:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.expel-timeout 2024-11-07 00:50:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.expel-timeout 2024-11-07 00:50:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-buffer-pool-size 2024-11-07 00:50:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-change-buffering 2024-11-07 00:50:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-change-buffering 2024-11-07 00:50:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-io-capacity 2024-11-07 00:50:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-io-capacity 2024-11-07 00:50:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-file-per-table 2024-11-07 00:50:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-file-per-table 2024-11-07 00:50:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.tuning-level 2024-11-07 00:50:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.tuning-level 2024-11-07 00:50:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.table-open-cache 2024-11-07 00:50:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.table-open-cache 2024-11-07 00:50:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.max-connections 2024-11-07 00:50:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.enable-binlogs 2024-11-07 00:50:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-path 2024-11-07 00:50:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-path 2024-11-07 00:50:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-max-size 2024-11-07 00:50:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-max-size 2024-11-07 00:50:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-expire-days 2024-11-07 00:50:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-expire-days 2024-11-07 00:50:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.prefer-ipv6 2024-11-07 00:50:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.wait-timeout 2024-11-07 00:50:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.wait-timeout 2024-11-07 00:50:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.os-db-router-hostname 2024-11-07 00:50:37 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Initializing Snap Layer 2024-11-07 00:50:37 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Loading state 2024-11-07 00:50:37 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:50:37 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Coordinator: Initializing coordinator layer 2024-11-07 00:50:37 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Initializing Leadership Layer (is leader) 2024-11-07 00:50:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: starting handler dispatch, 107 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-49-102-64 tracer: set flag leadership.set.cluster-instance-clustered-252-49-107-157 tracer: set flag leadership.set.cluster-instance-clustered-252-49-94-42 tracer: set flag leadership.set.cluster-instance-configured-252-49-102-64 tracer: set flag leadership.set.cluster-instance-configured-252-49-107-157 tracer: set flag leadership.set.cluster-instance-configured-252-49-94-42 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-11-07 00:50:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:64:default_update_status 2024-11-07 00:50:37 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:64:default_update_status 2024-11-07 00:50:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag run-default-update-status 2024-11-07 00:50:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag is-update-status-hook 2024-11-07 00:50:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:82:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:93:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 00:50:37 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:82:check_really_is_update_status 2024-11-07 00:50:37 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:93:run_default_update_status 2024-11-07 00:50:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:93:run_default_update_status 2024-11-07 00:50:37 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 00:50:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Found peers: 252.49.107.157,252.49.94.42 2024-11-07 00:50:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Expect 2 peers 2024-11-07 00:50:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Reached quorum 2024-11-07 00:50:37 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-11-07 00:50:37 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-11-07 00:50:37 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-11-07 00:50:37 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 00:50:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Running _assess_status() 2024-11-07 00:50:38 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-11-07 00:50:38 DEBUG unit.mysql-innodb-cluster/1.update-status logger.go:60 active 2024-11-07 00:50:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Opening db connection for root@localhost 2024-11-07 00:50:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Checking cluster status. 2024-11-07 00:50:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Opening db connection for root@None 2024-11-07 00:50:39 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 00:50:39 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:50:39 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Publishing state 2024-11-07 00:50:39 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-11-07 00:50:39 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 00:50:39 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-07 00:50:39 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 00:50:39 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/1 2024-11-07 00:50:39 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:50:39 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-11-07 00:50:39 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 00:50:39 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 00:50:39 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 00:50:39 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 00:50:39 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-11-07 00:50:39 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 00:50:39 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 00:50:39 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-11-07 00:50:39 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 00:50:39 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-11-07 00:55:37 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for mysql-innodb-cluster/1 2024-11-07 00:55:37 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:55:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 00:55:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 00:55:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-11-07 00:55:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 00:55:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 00:55:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 00:55:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 00:55:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 00:55:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-11-07 00:55:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-11-07 00:55:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-11-07 00:55:37 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for mysql-innodb-cluster/1 2024-11-07 00:55:37 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 00:55:37 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 00:55:37 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 00:55:37 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 00:55:37 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-1/agent.socket } 2024-11-07 00:55:38 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Reactive main running for hook update-status 2024-11-07 00:55:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 00:55:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_cert 2024-11-07 00:55:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_key 2024-11-07 00:55:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_ca 2024-11-07 00:55:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.source 2024-11-07 00:55:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.source 2024-11-07 00:55:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.cluster-name 2024-11-07 00:55:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.cluster-name 2024-11-07 00:55:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.auto-rejoin-tries 2024-11-07 00:55:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.auto-rejoin-tries 2024-11-07 00:55:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.expel-timeout 2024-11-07 00:55:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.expel-timeout 2024-11-07 00:55:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-buffer-pool-size 2024-11-07 00:55:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-change-buffering 2024-11-07 00:55:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-change-buffering 2024-11-07 00:55:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-io-capacity 2024-11-07 00:55:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-io-capacity 2024-11-07 00:55:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-file-per-table 2024-11-07 00:55:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-file-per-table 2024-11-07 00:55:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.tuning-level 2024-11-07 00:55:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.tuning-level 2024-11-07 00:55:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.table-open-cache 2024-11-07 00:55:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.table-open-cache 2024-11-07 00:55:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.max-connections 2024-11-07 00:55:39 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.enable-binlogs 2024-11-07 00:55:39 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-path 2024-11-07 00:55:39 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-path 2024-11-07 00:55:39 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-max-size 2024-11-07 00:55:39 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-max-size 2024-11-07 00:55:39 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-expire-days 2024-11-07 00:55:39 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-expire-days 2024-11-07 00:55:39 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.prefer-ipv6 2024-11-07 00:55:39 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.wait-timeout 2024-11-07 00:55:39 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.wait-timeout 2024-11-07 00:55:39 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.os-db-router-hostname 2024-11-07 00:55:39 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Initializing Snap Layer 2024-11-07 00:55:39 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Loading state 2024-11-07 00:55:39 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:55:39 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Coordinator: Initializing coordinator layer 2024-11-07 00:55:39 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Initializing Leadership Layer (is leader) 2024-11-07 00:55:39 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: starting handler dispatch, 107 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-49-102-64 tracer: set flag leadership.set.cluster-instance-clustered-252-49-107-157 tracer: set flag leadership.set.cluster-instance-clustered-252-49-94-42 tracer: set flag leadership.set.cluster-instance-configured-252-49-102-64 tracer: set flag leadership.set.cluster-instance-configured-252-49-107-157 tracer: set flag leadership.set.cluster-instance-configured-252-49-94-42 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-11-07 00:55:39 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:64:default_update_status 2024-11-07 00:55:39 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:64:default_update_status 2024-11-07 00:55:39 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag run-default-update-status 2024-11-07 00:55:39 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag is-update-status-hook 2024-11-07 00:55:39 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:82:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:93:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 00:55:39 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:82:check_really_is_update_status 2024-11-07 00:55:39 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:93:run_default_update_status 2024-11-07 00:55:39 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:93:run_default_update_status 2024-11-07 00:55:39 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 00:55:39 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Found peers: 252.49.107.157,252.49.94.42 2024-11-07 00:55:39 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Expect 2 peers 2024-11-07 00:55:39 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Reached quorum 2024-11-07 00:55:39 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-11-07 00:55:39 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-11-07 00:55:39 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-11-07 00:55:39 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 00:55:39 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Running _assess_status() 2024-11-07 00:55:40 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-11-07 00:55:40 DEBUG unit.mysql-innodb-cluster/1.update-status logger.go:60 active 2024-11-07 00:55:40 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Opening db connection for root@localhost 2024-11-07 00:55:40 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Checking cluster status. 2024-11-07 00:55:40 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Opening db connection for root@None 2024-11-07 00:55:40 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 00:55:40 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 00:55:40 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Publishing state 2024-11-07 00:55:41 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-11-07 00:55:41 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 00:55:41 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-07 00:55:41 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 00:55:41 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/1 2024-11-07 00:55:41 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 00:55:41 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 00:55:41 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 00:55:41 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 00:55:41 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 00:55:41 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-11-07 00:55:41 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-11-07 00:55:41 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-11-07 00:55:41 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-11-07 00:55:41 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 00:55:41 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 00:55:41 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 01:00:53 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for mysql-innodb-cluster/1 2024-11-07 01:00:53 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 01:00:53 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-11-07 01:00:53 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-11-07 01:00:53 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 01:00:53 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 01:00:53 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 01:00:53 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 01:00:53 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 01:00:53 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 01:00:53 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-11-07 01:00:53 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-11-07 01:00:53 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 01:00:53 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for mysql-innodb-cluster/1 2024-11-07 01:00:53 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 01:00:53 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 01:00:53 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 01:00:53 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 01:00:53 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-1/agent.socket } 2024-11-07 01:00:54 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Reactive main running for hook update-status 2024-11-07 01:00:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 01:00:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_cert 2024-11-07 01:00:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_key 2024-11-07 01:00:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_ca 2024-11-07 01:00:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.source 2024-11-07 01:00:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.source 2024-11-07 01:00:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.cluster-name 2024-11-07 01:00:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.cluster-name 2024-11-07 01:00:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.auto-rejoin-tries 2024-11-07 01:00:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.auto-rejoin-tries 2024-11-07 01:00:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.expel-timeout 2024-11-07 01:00:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.expel-timeout 2024-11-07 01:00:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-buffer-pool-size 2024-11-07 01:00:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-change-buffering 2024-11-07 01:00:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-change-buffering 2024-11-07 01:00:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-io-capacity 2024-11-07 01:00:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-io-capacity 2024-11-07 01:00:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-file-per-table 2024-11-07 01:00:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-file-per-table 2024-11-07 01:00:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.tuning-level 2024-11-07 01:00:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.tuning-level 2024-11-07 01:00:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.table-open-cache 2024-11-07 01:00:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.table-open-cache 2024-11-07 01:00:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.max-connections 2024-11-07 01:00:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.enable-binlogs 2024-11-07 01:00:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-path 2024-11-07 01:00:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-path 2024-11-07 01:00:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-max-size 2024-11-07 01:00:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-max-size 2024-11-07 01:00:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-expire-days 2024-11-07 01:00:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-expire-days 2024-11-07 01:00:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.prefer-ipv6 2024-11-07 01:00:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.wait-timeout 2024-11-07 01:00:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.wait-timeout 2024-11-07 01:00:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.os-db-router-hostname 2024-11-07 01:00:55 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Initializing Snap Layer 2024-11-07 01:00:55 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Loading state 2024-11-07 01:00:55 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 01:00:55 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Coordinator: Initializing coordinator layer 2024-11-07 01:00:55 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Initializing Leadership Layer (is leader) 2024-11-07 01:00:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: starting handler dispatch, 107 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-49-102-64 tracer: set flag leadership.set.cluster-instance-clustered-252-49-107-157 tracer: set flag leadership.set.cluster-instance-clustered-252-49-94-42 tracer: set flag leadership.set.cluster-instance-configured-252-49-102-64 tracer: set flag leadership.set.cluster-instance-configured-252-49-107-157 tracer: set flag leadership.set.cluster-instance-configured-252-49-94-42 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-11-07 01:00:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:64:default_update_status 2024-11-07 01:00:55 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:64:default_update_status 2024-11-07 01:00:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag run-default-update-status 2024-11-07 01:00:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag is-update-status-hook 2024-11-07 01:00:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:82:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:93:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 01:00:55 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:82:check_really_is_update_status 2024-11-07 01:00:55 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:93:run_default_update_status 2024-11-07 01:00:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:93:run_default_update_status 2024-11-07 01:00:55 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 01:00:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Found peers: 252.49.107.157,252.49.94.42 2024-11-07 01:00:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Expect 2 peers 2024-11-07 01:00:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Reached quorum 2024-11-07 01:00:55 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-11-07 01:00:55 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-11-07 01:00:55 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-11-07 01:00:55 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 01:00:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Running _assess_status() 2024-11-07 01:00:56 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-11-07 01:00:56 DEBUG unit.mysql-innodb-cluster/1.update-status logger.go:60 active 2024-11-07 01:00:56 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Opening db connection for root@localhost 2024-11-07 01:00:56 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Checking cluster status. 2024-11-07 01:00:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Opening db connection for root@None 2024-11-07 01:00:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 01:00:57 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 01:00:57 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Publishing state 2024-11-07 01:00:57 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-11-07 01:00:57 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 01:00:57 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-07 01:00:57 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 01:00:57 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/1 2024-11-07 01:00:57 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 01:00:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-11-07 01:00:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-11-07 01:00:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 01:00:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 01:00:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 01:00:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 01:00:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 01:00:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 01:00:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 01:00:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-11-07 01:00:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-11-07 01:05:56 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for mysql-innodb-cluster/1 2024-11-07 01:05:56 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 01:05:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 01:05:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-11-07 01:05:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-11-07 01:05:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 01:05:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-11-07 01:05:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 01:05:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 01:05:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-11-07 01:05:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 01:05:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 01:05:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 01:05:56 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for mysql-innodb-cluster/1 2024-11-07 01:05:56 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 01:05:56 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 01:05:56 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 01:05:56 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 01:05:56 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-1/agent.socket } 2024-11-07 01:05:56 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Reactive main running for hook update-status 2024-11-07 01:05:56 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 01:05:56 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_cert 2024-11-07 01:05:56 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_key 2024-11-07 01:05:56 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_ca 2024-11-07 01:05:56 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.source 2024-11-07 01:05:56 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.source 2024-11-07 01:05:56 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.cluster-name 2024-11-07 01:05:56 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.cluster-name 2024-11-07 01:05:56 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.auto-rejoin-tries 2024-11-07 01:05:56 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.auto-rejoin-tries 2024-11-07 01:05:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.expel-timeout 2024-11-07 01:05:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.expel-timeout 2024-11-07 01:05:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-buffer-pool-size 2024-11-07 01:05:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-change-buffering 2024-11-07 01:05:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-change-buffering 2024-11-07 01:05:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-io-capacity 2024-11-07 01:05:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-io-capacity 2024-11-07 01:05:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-file-per-table 2024-11-07 01:05:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-file-per-table 2024-11-07 01:05:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.tuning-level 2024-11-07 01:05:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.tuning-level 2024-11-07 01:05:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.table-open-cache 2024-11-07 01:05:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.table-open-cache 2024-11-07 01:05:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.max-connections 2024-11-07 01:05:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.enable-binlogs 2024-11-07 01:05:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-path 2024-11-07 01:05:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-path 2024-11-07 01:05:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-max-size 2024-11-07 01:05:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-max-size 2024-11-07 01:05:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-expire-days 2024-11-07 01:05:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-expire-days 2024-11-07 01:05:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.prefer-ipv6 2024-11-07 01:05:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.wait-timeout 2024-11-07 01:05:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.wait-timeout 2024-11-07 01:05:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.os-db-router-hostname 2024-11-07 01:05:57 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Initializing Snap Layer 2024-11-07 01:05:57 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Loading state 2024-11-07 01:05:57 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 01:05:57 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Coordinator: Initializing coordinator layer 2024-11-07 01:05:57 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Initializing Leadership Layer (is leader) 2024-11-07 01:05:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: starting handler dispatch, 107 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-49-102-64 tracer: set flag leadership.set.cluster-instance-clustered-252-49-107-157 tracer: set flag leadership.set.cluster-instance-clustered-252-49-94-42 tracer: set flag leadership.set.cluster-instance-configured-252-49-102-64 tracer: set flag leadership.set.cluster-instance-configured-252-49-107-157 tracer: set flag leadership.set.cluster-instance-configured-252-49-94-42 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-11-07 01:05:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:64:default_update_status 2024-11-07 01:05:57 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:64:default_update_status 2024-11-07 01:05:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag run-default-update-status 2024-11-07 01:05:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag is-update-status-hook 2024-11-07 01:05:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:82:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:93:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 01:05:57 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:82:check_really_is_update_status 2024-11-07 01:05:57 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:93:run_default_update_status 2024-11-07 01:05:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:93:run_default_update_status 2024-11-07 01:05:57 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 01:05:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Found peers: 252.49.107.157,252.49.94.42 2024-11-07 01:05:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Expect 2 peers 2024-11-07 01:05:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Reached quorum 2024-11-07 01:05:57 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-11-07 01:05:58 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-11-07 01:05:58 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-11-07 01:05:58 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 01:05:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Running _assess_status() 2024-11-07 01:05:58 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-11-07 01:05:58 DEBUG unit.mysql-innodb-cluster/1.update-status logger.go:60 active 2024-11-07 01:05:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Opening db connection for root@localhost 2024-11-07 01:05:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Checking cluster status. 2024-11-07 01:05:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Opening db connection for root@None 2024-11-07 01:05:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 01:05:59 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 01:05:59 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Publishing state 2024-11-07 01:05:59 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-11-07 01:05:59 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 01:05:59 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-07 01:05:59 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 01:05:59 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/1 2024-11-07 01:05:59 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 01:05:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 01:05:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 01:05:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 01:05:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-11-07 01:05:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 01:05:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 01:05:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 01:05:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 01:05:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-11-07 01:05:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-11-07 01:05:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-11-07 01:10:29 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for mysql-innodb-cluster/1 2024-11-07 01:10:29 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 01:10:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 01:10:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 01:10:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-11-07 01:10:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 01:10:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 01:10:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-11-07 01:10:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 01:10:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 01:10:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-11-07 01:10:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-11-07 01:10:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 01:10:29 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for mysql-innodb-cluster/1 2024-11-07 01:10:29 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 01:10:29 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 01:10:29 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 01:10:29 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 01:10:29 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-1/agent.socket } 2024-11-07 01:10:29 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Reactive main running for hook update-status 2024-11-07 01:10:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 01:10:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_cert 2024-11-07 01:10:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_key 2024-11-07 01:10:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_ca 2024-11-07 01:10:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.source 2024-11-07 01:10:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.source 2024-11-07 01:10:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.cluster-name 2024-11-07 01:10:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.cluster-name 2024-11-07 01:10:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.auto-rejoin-tries 2024-11-07 01:10:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.auto-rejoin-tries 2024-11-07 01:10:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.expel-timeout 2024-11-07 01:10:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.expel-timeout 2024-11-07 01:10:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-buffer-pool-size 2024-11-07 01:10:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-change-buffering 2024-11-07 01:10:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-change-buffering 2024-11-07 01:10:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-io-capacity 2024-11-07 01:10:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-io-capacity 2024-11-07 01:10:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-file-per-table 2024-11-07 01:10:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-file-per-table 2024-11-07 01:10:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.tuning-level 2024-11-07 01:10:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.tuning-level 2024-11-07 01:10:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.table-open-cache 2024-11-07 01:10:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.table-open-cache 2024-11-07 01:10:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.max-connections 2024-11-07 01:10:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.enable-binlogs 2024-11-07 01:10:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-path 2024-11-07 01:10:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-path 2024-11-07 01:10:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-max-size 2024-11-07 01:10:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-max-size 2024-11-07 01:10:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-expire-days 2024-11-07 01:10:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-expire-days 2024-11-07 01:10:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.prefer-ipv6 2024-11-07 01:10:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.wait-timeout 2024-11-07 01:10:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.wait-timeout 2024-11-07 01:10:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.os-db-router-hostname 2024-11-07 01:10:30 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Initializing Snap Layer 2024-11-07 01:10:31 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Loading state 2024-11-07 01:10:31 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 01:10:31 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Coordinator: Initializing coordinator layer 2024-11-07 01:10:31 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Initializing Leadership Layer (is leader) 2024-11-07 01:10:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: starting handler dispatch, 107 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-49-102-64 tracer: set flag leadership.set.cluster-instance-clustered-252-49-107-157 tracer: set flag leadership.set.cluster-instance-clustered-252-49-94-42 tracer: set flag leadership.set.cluster-instance-configured-252-49-102-64 tracer: set flag leadership.set.cluster-instance-configured-252-49-107-157 tracer: set flag leadership.set.cluster-instance-configured-252-49-94-42 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-11-07 01:10:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:64:default_update_status 2024-11-07 01:10:31 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:64:default_update_status 2024-11-07 01:10:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag run-default-update-status 2024-11-07 01:10:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag is-update-status-hook 2024-11-07 01:10:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:82:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:93:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 01:10:31 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:82:check_really_is_update_status 2024-11-07 01:10:31 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:93:run_default_update_status 2024-11-07 01:10:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:93:run_default_update_status 2024-11-07 01:10:31 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 01:10:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Found peers: 252.49.107.157,252.49.94.42 2024-11-07 01:10:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Expect 2 peers 2024-11-07 01:10:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Reached quorum 2024-11-07 01:10:31 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-11-07 01:10:31 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-11-07 01:10:31 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-11-07 01:10:31 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 01:10:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Running _assess_status() 2024-11-07 01:10:31 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-11-07 01:10:31 DEBUG unit.mysql-innodb-cluster/1.update-status logger.go:60 active 2024-11-07 01:10:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Opening db connection for root@localhost 2024-11-07 01:10:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Checking cluster status. 2024-11-07 01:10:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Opening db connection for root@None 2024-11-07 01:10:32 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 01:10:32 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 01:10:32 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Publishing state 2024-11-07 01:10:32 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-11-07 01:10:32 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 01:10:32 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-07 01:10:32 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 01:10:32 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/1 2024-11-07 01:10:32 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 01:10:32 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 01:10:32 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 01:10:32 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 01:10:32 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-11-07 01:10:32 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 01:10:32 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-11-07 01:10:32 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-11-07 01:10:32 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 01:10:32 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 01:10:32 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 01:10:32 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-11-07 01:15:32 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for mysql-innodb-cluster/1 2024-11-07 01:15:32 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 01:15:32 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 01:15:32 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 01:15:32 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 01:15:32 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-11-07 01:15:32 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 01:15:32 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-11-07 01:15:32 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-11-07 01:15:32 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-11-07 01:15:32 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 01:15:32 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 01:15:32 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 01:15:32 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for mysql-innodb-cluster/1 2024-11-07 01:15:32 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 01:15:32 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 01:15:32 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 01:15:32 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 01:15:32 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-1/agent.socket } 2024-11-07 01:15:32 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Reactive main running for hook update-status 2024-11-07 01:15:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 01:15:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_cert 2024-11-07 01:15:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_key 2024-11-07 01:15:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_ca 2024-11-07 01:15:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.source 2024-11-07 01:15:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.source 2024-11-07 01:15:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.cluster-name 2024-11-07 01:15:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.cluster-name 2024-11-07 01:15:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.auto-rejoin-tries 2024-11-07 01:15:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.auto-rejoin-tries 2024-11-07 01:15:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.expel-timeout 2024-11-07 01:15:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.expel-timeout 2024-11-07 01:15:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-buffer-pool-size 2024-11-07 01:15:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-change-buffering 2024-11-07 01:15:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-change-buffering 2024-11-07 01:15:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-io-capacity 2024-11-07 01:15:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-io-capacity 2024-11-07 01:15:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-file-per-table 2024-11-07 01:15:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-file-per-table 2024-11-07 01:15:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.tuning-level 2024-11-07 01:15:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.tuning-level 2024-11-07 01:15:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.table-open-cache 2024-11-07 01:15:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.table-open-cache 2024-11-07 01:15:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.max-connections 2024-11-07 01:15:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.enable-binlogs 2024-11-07 01:15:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-path 2024-11-07 01:15:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-path 2024-11-07 01:15:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-max-size 2024-11-07 01:15:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-max-size 2024-11-07 01:15:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-expire-days 2024-11-07 01:15:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-expire-days 2024-11-07 01:15:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.prefer-ipv6 2024-11-07 01:15:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.wait-timeout 2024-11-07 01:15:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.wait-timeout 2024-11-07 01:15:33 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.os-db-router-hostname 2024-11-07 01:15:33 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Initializing Snap Layer 2024-11-07 01:15:34 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Loading state 2024-11-07 01:15:34 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 01:15:34 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Coordinator: Initializing coordinator layer 2024-11-07 01:15:34 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Initializing Leadership Layer (is leader) 2024-11-07 01:15:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: starting handler dispatch, 107 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-49-102-64 tracer: set flag leadership.set.cluster-instance-clustered-252-49-107-157 tracer: set flag leadership.set.cluster-instance-clustered-252-49-94-42 tracer: set flag leadership.set.cluster-instance-configured-252-49-102-64 tracer: set flag leadership.set.cluster-instance-configured-252-49-107-157 tracer: set flag leadership.set.cluster-instance-configured-252-49-94-42 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-11-07 01:15:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:64:default_update_status 2024-11-07 01:15:34 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:64:default_update_status 2024-11-07 01:15:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag run-default-update-status 2024-11-07 01:15:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag is-update-status-hook 2024-11-07 01:15:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:82:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:93:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 01:15:34 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:82:check_really_is_update_status 2024-11-07 01:15:34 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:93:run_default_update_status 2024-11-07 01:15:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:93:run_default_update_status 2024-11-07 01:15:34 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 01:15:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Found peers: 252.49.107.157,252.49.94.42 2024-11-07 01:15:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Expect 2 peers 2024-11-07 01:15:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Reached quorum 2024-11-07 01:15:34 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-11-07 01:15:34 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-11-07 01:15:34 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-11-07 01:15:34 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 01:15:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Running _assess_status() 2024-11-07 01:15:34 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-11-07 01:15:34 DEBUG unit.mysql-innodb-cluster/1.update-status logger.go:60 active 2024-11-07 01:15:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Opening db connection for root@localhost 2024-11-07 01:15:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Checking cluster status. 2024-11-07 01:15:35 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Opening db connection for root@None 2024-11-07 01:15:35 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 01:15:35 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 01:15:35 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Publishing state 2024-11-07 01:15:36 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-11-07 01:15:36 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 01:15:36 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-07 01:15:36 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 01:15:36 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/1 2024-11-07 01:15:36 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 01:15:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 01:15:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 01:15:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 01:15:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 01:15:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 01:15:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 01:15:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 01:15:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-11-07 01:15:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-11-07 01:15:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-11-07 01:15:36 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-11-07 01:20:35 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for mysql-innodb-cluster/1 2024-11-07 01:20:35 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 01:20:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 01:20:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-11-07 01:20:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-11-07 01:20:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 01:20:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 01:20:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 01:20:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-11-07 01:20:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-11-07 01:20:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 01:20:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 01:20:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 01:20:35 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for mysql-innodb-cluster/1 2024-11-07 01:20:35 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 01:20:35 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 01:20:35 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 01:20:35 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 01:20:35 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-1/agent.socket } 2024-11-07 01:20:35 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Reactive main running for hook update-status 2024-11-07 01:20:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 01:20:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_cert 2024-11-07 01:20:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_key 2024-11-07 01:20:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_ca 2024-11-07 01:20:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.source 2024-11-07 01:20:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.source 2024-11-07 01:20:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.cluster-name 2024-11-07 01:20:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.cluster-name 2024-11-07 01:20:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.auto-rejoin-tries 2024-11-07 01:20:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.auto-rejoin-tries 2024-11-07 01:20:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.expel-timeout 2024-11-07 01:20:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.expel-timeout 2024-11-07 01:20:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-buffer-pool-size 2024-11-07 01:20:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-change-buffering 2024-11-07 01:20:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-change-buffering 2024-11-07 01:20:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-io-capacity 2024-11-07 01:20:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-io-capacity 2024-11-07 01:20:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-file-per-table 2024-11-07 01:20:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-file-per-table 2024-11-07 01:20:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.tuning-level 2024-11-07 01:20:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.tuning-level 2024-11-07 01:20:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.table-open-cache 2024-11-07 01:20:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.table-open-cache 2024-11-07 01:20:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.max-connections 2024-11-07 01:20:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.enable-binlogs 2024-11-07 01:20:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-path 2024-11-07 01:20:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-path 2024-11-07 01:20:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-max-size 2024-11-07 01:20:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-max-size 2024-11-07 01:20:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-expire-days 2024-11-07 01:20:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-expire-days 2024-11-07 01:20:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.prefer-ipv6 2024-11-07 01:20:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.wait-timeout 2024-11-07 01:20:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.wait-timeout 2024-11-07 01:20:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.os-db-router-hostname 2024-11-07 01:20:36 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Initializing Snap Layer 2024-11-07 01:20:37 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Loading state 2024-11-07 01:20:37 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 01:20:37 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Coordinator: Initializing coordinator layer 2024-11-07 01:20:37 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Initializing Leadership Layer (is leader) 2024-11-07 01:20:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: starting handler dispatch, 107 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-49-102-64 tracer: set flag leadership.set.cluster-instance-clustered-252-49-107-157 tracer: set flag leadership.set.cluster-instance-clustered-252-49-94-42 tracer: set flag leadership.set.cluster-instance-configured-252-49-102-64 tracer: set flag leadership.set.cluster-instance-configured-252-49-107-157 tracer: set flag leadership.set.cluster-instance-configured-252-49-94-42 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-11-07 01:20:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:64:default_update_status 2024-11-07 01:20:37 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:64:default_update_status 2024-11-07 01:20:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag run-default-update-status 2024-11-07 01:20:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag is-update-status-hook 2024-11-07 01:20:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:82:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:93:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 01:20:37 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:82:check_really_is_update_status 2024-11-07 01:20:37 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:93:run_default_update_status 2024-11-07 01:20:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:93:run_default_update_status 2024-11-07 01:20:37 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 01:20:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Found peers: 252.49.107.157,252.49.94.42 2024-11-07 01:20:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Expect 2 peers 2024-11-07 01:20:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Reached quorum 2024-11-07 01:20:37 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-11-07 01:20:37 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-11-07 01:20:37 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-11-07 01:20:37 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 01:20:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Running _assess_status() 2024-11-07 01:20:37 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-11-07 01:20:37 DEBUG unit.mysql-innodb-cluster/1.update-status logger.go:60 active 2024-11-07 01:20:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Opening db connection for root@localhost 2024-11-07 01:20:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Checking cluster status. 2024-11-07 01:20:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Opening db connection for root@None 2024-11-07 01:20:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 01:20:38 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 01:20:38 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Publishing state 2024-11-07 01:20:38 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-11-07 01:20:38 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 01:20:38 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-07 01:20:38 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 01:20:38 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/1 2024-11-07 01:20:38 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 01:20:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 01:20:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 01:20:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-11-07 01:20:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-11-07 01:20:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 01:20:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-11-07 01:20:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 01:20:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 01:20:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-11-07 01:20:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 01:20:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 01:24:51 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for mysql-innodb-cluster/1 2024-11-07 01:24:51 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 01:24:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 01:24:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 01:24:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 01:24:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-11-07 01:24:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-11-07 01:24:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-11-07 01:24:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 01:24:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-11-07 01:24:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 01:24:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 01:24:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 01:24:51 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for mysql-innodb-cluster/1 2024-11-07 01:24:51 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 01:24:51 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 01:24:51 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 01:24:51 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 01:24:51 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-1/agent.socket } 2024-11-07 01:24:51 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Reactive main running for hook update-status 2024-11-07 01:24:52 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 01:24:52 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_cert 2024-11-07 01:24:52 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_key 2024-11-07 01:24:52 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_ca 2024-11-07 01:24:52 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.source 2024-11-07 01:24:52 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.source 2024-11-07 01:24:52 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.cluster-name 2024-11-07 01:24:52 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.cluster-name 2024-11-07 01:24:52 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.auto-rejoin-tries 2024-11-07 01:24:52 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.auto-rejoin-tries 2024-11-07 01:24:52 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.expel-timeout 2024-11-07 01:24:52 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.expel-timeout 2024-11-07 01:24:52 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-buffer-pool-size 2024-11-07 01:24:52 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-change-buffering 2024-11-07 01:24:52 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-change-buffering 2024-11-07 01:24:52 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-io-capacity 2024-11-07 01:24:52 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-io-capacity 2024-11-07 01:24:52 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-file-per-table 2024-11-07 01:24:52 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-file-per-table 2024-11-07 01:24:52 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.tuning-level 2024-11-07 01:24:52 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.tuning-level 2024-11-07 01:24:52 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.table-open-cache 2024-11-07 01:24:52 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.table-open-cache 2024-11-07 01:24:52 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.max-connections 2024-11-07 01:24:52 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.enable-binlogs 2024-11-07 01:24:52 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-path 2024-11-07 01:24:52 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-path 2024-11-07 01:24:52 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-max-size 2024-11-07 01:24:52 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-max-size 2024-11-07 01:24:52 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-expire-days 2024-11-07 01:24:52 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-expire-days 2024-11-07 01:24:53 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.prefer-ipv6 2024-11-07 01:24:53 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.wait-timeout 2024-11-07 01:24:53 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.wait-timeout 2024-11-07 01:24:53 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.os-db-router-hostname 2024-11-07 01:24:53 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Initializing Snap Layer 2024-11-07 01:24:53 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Loading state 2024-11-07 01:24:53 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 01:24:53 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Coordinator: Initializing coordinator layer 2024-11-07 01:24:53 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Initializing Leadership Layer (is leader) 2024-11-07 01:24:53 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: starting handler dispatch, 107 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-49-102-64 tracer: set flag leadership.set.cluster-instance-clustered-252-49-107-157 tracer: set flag leadership.set.cluster-instance-clustered-252-49-94-42 tracer: set flag leadership.set.cluster-instance-configured-252-49-102-64 tracer: set flag leadership.set.cluster-instance-configured-252-49-107-157 tracer: set flag leadership.set.cluster-instance-configured-252-49-94-42 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-11-07 01:24:53 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:64:default_update_status 2024-11-07 01:24:53 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:64:default_update_status 2024-11-07 01:24:53 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag run-default-update-status 2024-11-07 01:24:53 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag is-update-status-hook 2024-11-07 01:24:53 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:82:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:93:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 01:24:53 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:82:check_really_is_update_status 2024-11-07 01:24:53 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:93:run_default_update_status 2024-11-07 01:24:53 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:93:run_default_update_status 2024-11-07 01:24:53 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 01:24:53 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Found peers: 252.49.107.157,252.49.94.42 2024-11-07 01:24:53 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Expect 2 peers 2024-11-07 01:24:53 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Reached quorum 2024-11-07 01:24:53 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-11-07 01:24:53 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-11-07 01:24:53 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-11-07 01:24:53 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 01:24:53 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Running _assess_status() 2024-11-07 01:24:53 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-11-07 01:24:53 DEBUG unit.mysql-innodb-cluster/1.update-status logger.go:60 active 2024-11-07 01:24:53 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Opening db connection for root@localhost 2024-11-07 01:24:53 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Checking cluster status. 2024-11-07 01:24:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Opening db connection for root@None 2024-11-07 01:24:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 01:24:54 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 01:24:54 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Publishing state 2024-11-07 01:24:55 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-11-07 01:24:55 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 01:24:55 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-07 01:24:55 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 01:24:55 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/1 2024-11-07 01:24:55 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 01:24:55 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-11-07 01:24:55 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 01:24:55 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 01:24:55 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 01:24:55 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-11-07 01:24:55 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-11-07 01:24:55 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 01:24:55 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 01:24:55 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-11-07 01:24:55 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 01:24:55 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 01:29:57 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for mysql-innodb-cluster/1 2024-11-07 01:29:57 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 01:29:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-11-07 01:29:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 01:29:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-11-07 01:29:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-11-07 01:29:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 01:29:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-11-07 01:29:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 01:29:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 01:29:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 01:29:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 01:29:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 01:29:57 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for mysql-innodb-cluster/1 2024-11-07 01:29:57 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 01:29:57 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 01:29:57 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 01:29:57 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 01:29:57 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-1/agent.socket } 2024-11-07 01:29:58 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Reactive main running for hook update-status 2024-11-07 01:29:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 01:29:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_cert 2024-11-07 01:29:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_key 2024-11-07 01:29:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_ca 2024-11-07 01:29:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.source 2024-11-07 01:29:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.source 2024-11-07 01:29:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.cluster-name 2024-11-07 01:29:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.cluster-name 2024-11-07 01:29:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.auto-rejoin-tries 2024-11-07 01:29:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.auto-rejoin-tries 2024-11-07 01:29:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.expel-timeout 2024-11-07 01:29:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.expel-timeout 2024-11-07 01:29:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-buffer-pool-size 2024-11-07 01:29:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-change-buffering 2024-11-07 01:29:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-change-buffering 2024-11-07 01:29:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-io-capacity 2024-11-07 01:29:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-io-capacity 2024-11-07 01:29:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-file-per-table 2024-11-07 01:29:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-file-per-table 2024-11-07 01:29:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.tuning-level 2024-11-07 01:29:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.tuning-level 2024-11-07 01:29:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.table-open-cache 2024-11-07 01:29:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.table-open-cache 2024-11-07 01:29:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.max-connections 2024-11-07 01:29:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.enable-binlogs 2024-11-07 01:29:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-path 2024-11-07 01:29:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-path 2024-11-07 01:29:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-max-size 2024-11-07 01:29:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-max-size 2024-11-07 01:29:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-expire-days 2024-11-07 01:29:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-expire-days 2024-11-07 01:29:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.prefer-ipv6 2024-11-07 01:29:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.wait-timeout 2024-11-07 01:29:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.wait-timeout 2024-11-07 01:29:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.os-db-router-hostname 2024-11-07 01:29:59 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Initializing Snap Layer 2024-11-07 01:29:59 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Loading state 2024-11-07 01:29:59 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 01:29:59 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Coordinator: Initializing coordinator layer 2024-11-07 01:29:59 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Initializing Leadership Layer (is leader) 2024-11-07 01:29:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: starting handler dispatch, 107 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-49-102-64 tracer: set flag leadership.set.cluster-instance-clustered-252-49-107-157 tracer: set flag leadership.set.cluster-instance-clustered-252-49-94-42 tracer: set flag leadership.set.cluster-instance-configured-252-49-102-64 tracer: set flag leadership.set.cluster-instance-configured-252-49-107-157 tracer: set flag leadership.set.cluster-instance-configured-252-49-94-42 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-11-07 01:29:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:64:default_update_status 2024-11-07 01:29:59 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:64:default_update_status 2024-11-07 01:29:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag run-default-update-status 2024-11-07 01:29:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag is-update-status-hook 2024-11-07 01:29:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:82:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:93:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 01:29:59 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:82:check_really_is_update_status 2024-11-07 01:29:59 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:93:run_default_update_status 2024-11-07 01:29:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:93:run_default_update_status 2024-11-07 01:29:59 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 01:29:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Found peers: 252.49.107.157,252.49.94.42 2024-11-07 01:29:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Expect 2 peers 2024-11-07 01:29:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Reached quorum 2024-11-07 01:29:59 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-11-07 01:29:59 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-11-07 01:29:59 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-11-07 01:29:59 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 01:29:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Running _assess_status() 2024-11-07 01:30:00 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-11-07 01:30:00 DEBUG unit.mysql-innodb-cluster/1.update-status logger.go:60 active 2024-11-07 01:30:00 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Opening db connection for root@localhost 2024-11-07 01:30:00 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Checking cluster status. 2024-11-07 01:30:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Opening db connection for root@None 2024-11-07 01:30:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 01:30:01 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 01:30:01 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Publishing state 2024-11-07 01:30:01 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-11-07 01:30:01 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 01:30:01 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-07 01:30:01 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 01:30:01 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/1 2024-11-07 01:30:01 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 01:30:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 01:30:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 01:30:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 01:30:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-11-07 01:30:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 01:30:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-11-07 01:30:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 01:30:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-11-07 01:30:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 01:30:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 01:30:01 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-11-07 01:35:47 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for mysql-innodb-cluster/1 2024-11-07 01:35:47 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 01:35:47 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 01:35:47 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 01:35:47 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-11-07 01:35:47 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-11-07 01:35:47 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 01:35:47 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 01:35:47 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-11-07 01:35:47 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 01:35:47 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-11-07 01:35:47 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 01:35:47 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 01:35:47 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for mysql-innodb-cluster/1 2024-11-07 01:35:47 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 01:35:47 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 01:35:47 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 01:35:47 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 01:35:47 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-1/agent.socket } 2024-11-07 01:35:47 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Reactive main running for hook update-status 2024-11-07 01:35:48 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 01:35:48 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_cert 2024-11-07 01:35:48 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_key 2024-11-07 01:35:48 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_ca 2024-11-07 01:35:48 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.source 2024-11-07 01:35:48 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.source 2024-11-07 01:35:48 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.cluster-name 2024-11-07 01:35:48 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.cluster-name 2024-11-07 01:35:48 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.auto-rejoin-tries 2024-11-07 01:35:48 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.auto-rejoin-tries 2024-11-07 01:35:48 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.expel-timeout 2024-11-07 01:35:48 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.expel-timeout 2024-11-07 01:35:48 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-buffer-pool-size 2024-11-07 01:35:48 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-change-buffering 2024-11-07 01:35:48 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-change-buffering 2024-11-07 01:35:48 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-io-capacity 2024-11-07 01:35:48 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-io-capacity 2024-11-07 01:35:48 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-file-per-table 2024-11-07 01:35:48 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-file-per-table 2024-11-07 01:35:48 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.tuning-level 2024-11-07 01:35:48 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.tuning-level 2024-11-07 01:35:48 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.table-open-cache 2024-11-07 01:35:48 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.table-open-cache 2024-11-07 01:35:48 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.max-connections 2024-11-07 01:35:48 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.enable-binlogs 2024-11-07 01:35:48 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-path 2024-11-07 01:35:48 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-path 2024-11-07 01:35:48 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-max-size 2024-11-07 01:35:48 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-max-size 2024-11-07 01:35:48 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-expire-days 2024-11-07 01:35:48 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-expire-days 2024-11-07 01:35:48 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.prefer-ipv6 2024-11-07 01:35:48 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.wait-timeout 2024-11-07 01:35:48 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.wait-timeout 2024-11-07 01:35:48 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.os-db-router-hostname 2024-11-07 01:35:48 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Initializing Snap Layer 2024-11-07 01:35:49 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Loading state 2024-11-07 01:35:49 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 01:35:49 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Coordinator: Initializing coordinator layer 2024-11-07 01:35:49 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Initializing Leadership Layer (is leader) 2024-11-07 01:35:49 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: starting handler dispatch, 107 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-49-102-64 tracer: set flag leadership.set.cluster-instance-clustered-252-49-107-157 tracer: set flag leadership.set.cluster-instance-clustered-252-49-94-42 tracer: set flag leadership.set.cluster-instance-configured-252-49-102-64 tracer: set flag leadership.set.cluster-instance-configured-252-49-107-157 tracer: set flag leadership.set.cluster-instance-configured-252-49-94-42 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-11-07 01:35:49 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:64:default_update_status 2024-11-07 01:35:49 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:64:default_update_status 2024-11-07 01:35:49 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag run-default-update-status 2024-11-07 01:35:49 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag is-update-status-hook 2024-11-07 01:35:49 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:82:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:93:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 01:35:49 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:82:check_really_is_update_status 2024-11-07 01:35:49 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:93:run_default_update_status 2024-11-07 01:35:49 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:93:run_default_update_status 2024-11-07 01:35:49 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 01:35:49 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Found peers: 252.49.107.157,252.49.94.42 2024-11-07 01:35:49 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Expect 2 peers 2024-11-07 01:35:49 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Reached quorum 2024-11-07 01:35:49 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-11-07 01:35:49 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-11-07 01:35:49 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-11-07 01:35:49 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 01:35:49 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Running _assess_status() 2024-11-07 01:35:49 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-11-07 01:35:49 DEBUG unit.mysql-innodb-cluster/1.update-status logger.go:60 active 2024-11-07 01:35:49 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Opening db connection for root@localhost 2024-11-07 01:35:49 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Checking cluster status. 2024-11-07 01:35:50 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Opening db connection for root@None 2024-11-07 01:35:50 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 01:35:50 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 01:35:50 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Publishing state 2024-11-07 01:35:51 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-11-07 01:35:51 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 01:35:51 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-07 01:35:51 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 01:35:51 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/1 2024-11-07 01:35:51 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 01:35:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-11-07 01:35:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 01:35:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-11-07 01:35:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-11-07 01:35:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 01:35:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 01:35:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 01:35:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 01:35:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 01:35:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-11-07 01:35:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 01:40:56 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for mysql-innodb-cluster/1 2024-11-07 01:40:56 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 01:40:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 01:40:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 01:40:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 01:40:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-11-07 01:40:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-11-07 01:40:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 01:40:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-11-07 01:40:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 01:40:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 01:40:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-11-07 01:40:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 01:40:56 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for mysql-innodb-cluster/1 2024-11-07 01:40:56 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 01:40:56 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 01:40:56 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 01:40:56 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 01:40:56 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-1/agent.socket } 2024-11-07 01:40:57 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Reactive main running for hook update-status 2024-11-07 01:40:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 01:40:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_cert 2024-11-07 01:40:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_key 2024-11-07 01:40:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_ca 2024-11-07 01:40:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.source 2024-11-07 01:40:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.source 2024-11-07 01:40:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.cluster-name 2024-11-07 01:40:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.cluster-name 2024-11-07 01:40:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.auto-rejoin-tries 2024-11-07 01:40:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.auto-rejoin-tries 2024-11-07 01:40:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.expel-timeout 2024-11-07 01:40:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.expel-timeout 2024-11-07 01:40:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-buffer-pool-size 2024-11-07 01:40:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-change-buffering 2024-11-07 01:40:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-change-buffering 2024-11-07 01:40:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-io-capacity 2024-11-07 01:40:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-io-capacity 2024-11-07 01:40:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-file-per-table 2024-11-07 01:40:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-file-per-table 2024-11-07 01:40:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.tuning-level 2024-11-07 01:40:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.tuning-level 2024-11-07 01:40:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.table-open-cache 2024-11-07 01:40:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.table-open-cache 2024-11-07 01:40:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.max-connections 2024-11-07 01:40:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.enable-binlogs 2024-11-07 01:40:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-path 2024-11-07 01:40:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-path 2024-11-07 01:40:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-max-size 2024-11-07 01:40:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-max-size 2024-11-07 01:40:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-expire-days 2024-11-07 01:40:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-expire-days 2024-11-07 01:40:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.prefer-ipv6 2024-11-07 01:40:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.wait-timeout 2024-11-07 01:40:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.wait-timeout 2024-11-07 01:40:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.os-db-router-hostname 2024-11-07 01:40:58 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Initializing Snap Layer 2024-11-07 01:40:58 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Loading state 2024-11-07 01:40:58 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 01:40:58 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Coordinator: Initializing coordinator layer 2024-11-07 01:40:58 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Initializing Leadership Layer (is leader) 2024-11-07 01:40:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: starting handler dispatch, 107 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-49-102-64 tracer: set flag leadership.set.cluster-instance-clustered-252-49-107-157 tracer: set flag leadership.set.cluster-instance-clustered-252-49-94-42 tracer: set flag leadership.set.cluster-instance-configured-252-49-102-64 tracer: set flag leadership.set.cluster-instance-configured-252-49-107-157 tracer: set flag leadership.set.cluster-instance-configured-252-49-94-42 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-11-07 01:40:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:64:default_update_status 2024-11-07 01:40:58 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:64:default_update_status 2024-11-07 01:40:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag run-default-update-status 2024-11-07 01:40:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag is-update-status-hook 2024-11-07 01:40:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:82:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:93:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 01:40:58 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:82:check_really_is_update_status 2024-11-07 01:40:58 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:93:run_default_update_status 2024-11-07 01:40:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:93:run_default_update_status 2024-11-07 01:40:58 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 01:40:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Found peers: 252.49.107.157,252.49.94.42 2024-11-07 01:40:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Expect 2 peers 2024-11-07 01:40:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Reached quorum 2024-11-07 01:40:58 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-11-07 01:40:58 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-11-07 01:40:58 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-11-07 01:40:58 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 01:40:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Running _assess_status() 2024-11-07 01:40:59 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-11-07 01:40:59 DEBUG unit.mysql-innodb-cluster/1.update-status logger.go:60 active 2024-11-07 01:40:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Opening db connection for root@localhost 2024-11-07 01:40:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Checking cluster status. 2024-11-07 01:40:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Opening db connection for root@None 2024-11-07 01:40:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 01:40:59 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 01:40:59 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Publishing state 2024-11-07 01:41:00 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-11-07 01:41:00 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 01:41:00 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-07 01:41:00 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 01:41:00 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/1 2024-11-07 01:41:00 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 01:41:00 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 01:41:00 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 01:41:00 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 01:41:00 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 01:41:00 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-11-07 01:41:00 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 01:41:00 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 01:41:00 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-11-07 01:41:00 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-11-07 01:41:00 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 01:41:00 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-11-07 01:45:02 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for mysql-innodb-cluster/1 2024-11-07 01:45:02 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 01:45:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 01:45:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 01:45:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-11-07 01:45:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 01:45:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 01:45:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-11-07 01:45:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 01:45:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 01:45:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 01:45:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-11-07 01:45:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-11-07 01:45:02 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for mysql-innodb-cluster/1 2024-11-07 01:45:02 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 01:45:02 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 01:45:02 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 01:45:02 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 01:45:02 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-1/agent.socket } 2024-11-07 01:45:02 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Reactive main running for hook update-status 2024-11-07 01:45:03 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 01:45:03 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_cert 2024-11-07 01:45:03 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_key 2024-11-07 01:45:03 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_ca 2024-11-07 01:45:03 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.source 2024-11-07 01:45:03 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.source 2024-11-07 01:45:03 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.cluster-name 2024-11-07 01:45:03 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.cluster-name 2024-11-07 01:45:03 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.auto-rejoin-tries 2024-11-07 01:45:03 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.auto-rejoin-tries 2024-11-07 01:45:03 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.expel-timeout 2024-11-07 01:45:03 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.expel-timeout 2024-11-07 01:45:03 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-buffer-pool-size 2024-11-07 01:45:03 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-change-buffering 2024-11-07 01:45:03 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-change-buffering 2024-11-07 01:45:03 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-io-capacity 2024-11-07 01:45:03 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-io-capacity 2024-11-07 01:45:03 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-file-per-table 2024-11-07 01:45:03 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-file-per-table 2024-11-07 01:45:03 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.tuning-level 2024-11-07 01:45:03 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.tuning-level 2024-11-07 01:45:03 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.table-open-cache 2024-11-07 01:45:03 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.table-open-cache 2024-11-07 01:45:03 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.max-connections 2024-11-07 01:45:03 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.enable-binlogs 2024-11-07 01:45:03 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-path 2024-11-07 01:45:03 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-path 2024-11-07 01:45:03 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-max-size 2024-11-07 01:45:03 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-max-size 2024-11-07 01:45:03 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-expire-days 2024-11-07 01:45:03 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-expire-days 2024-11-07 01:45:03 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.prefer-ipv6 2024-11-07 01:45:03 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.wait-timeout 2024-11-07 01:45:03 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.wait-timeout 2024-11-07 01:45:03 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.os-db-router-hostname 2024-11-07 01:45:04 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Initializing Snap Layer 2024-11-07 01:45:04 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Loading state 2024-11-07 01:45:04 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 01:45:04 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Coordinator: Initializing coordinator layer 2024-11-07 01:45:04 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Initializing Leadership Layer (is leader) 2024-11-07 01:45:04 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: starting handler dispatch, 107 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-49-102-64 tracer: set flag leadership.set.cluster-instance-clustered-252-49-107-157 tracer: set flag leadership.set.cluster-instance-clustered-252-49-94-42 tracer: set flag leadership.set.cluster-instance-configured-252-49-102-64 tracer: set flag leadership.set.cluster-instance-configured-252-49-107-157 tracer: set flag leadership.set.cluster-instance-configured-252-49-94-42 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-11-07 01:45:04 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:64:default_update_status 2024-11-07 01:45:04 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:64:default_update_status 2024-11-07 01:45:04 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag run-default-update-status 2024-11-07 01:45:04 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag is-update-status-hook 2024-11-07 01:45:04 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:82:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:93:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 01:45:04 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:82:check_really_is_update_status 2024-11-07 01:45:04 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:93:run_default_update_status 2024-11-07 01:45:04 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:93:run_default_update_status 2024-11-07 01:45:04 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 01:45:04 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Found peers: 252.49.107.157,252.49.94.42 2024-11-07 01:45:04 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Expect 2 peers 2024-11-07 01:45:04 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Reached quorum 2024-11-07 01:45:04 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-11-07 01:45:04 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-11-07 01:45:04 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-11-07 01:45:04 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 01:45:04 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Running _assess_status() 2024-11-07 01:45:04 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-11-07 01:45:04 DEBUG unit.mysql-innodb-cluster/1.update-status logger.go:60 active 2024-11-07 01:45:04 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Opening db connection for root@localhost 2024-11-07 01:45:04 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Checking cluster status. 2024-11-07 01:45:05 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Opening db connection for root@None 2024-11-07 01:45:05 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 01:45:05 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 01:45:05 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Publishing state 2024-11-07 01:45:06 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-11-07 01:45:06 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 01:45:06 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-07 01:45:06 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 01:45:06 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/1 2024-11-07 01:45:06 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 01:45:06 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 01:45:06 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 01:45:06 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-11-07 01:45:06 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 01:45:06 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-11-07 01:45:06 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 01:45:06 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 01:45:06 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-11-07 01:45:06 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-11-07 01:45:06 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 01:45:06 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 01:49:34 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for mysql-innodb-cluster/1 2024-11-07 01:49:34 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 01:49:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-11-07 01:49:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 01:49:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 01:49:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 01:49:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 01:49:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 01:49:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-11-07 01:49:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 01:49:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 01:49:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-11-07 01:49:34 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-11-07 01:49:34 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for mysql-innodb-cluster/1 2024-11-07 01:49:34 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 01:49:34 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 01:49:34 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 01:49:34 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 01:49:34 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-1/agent.socket } 2024-11-07 01:49:35 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Reactive main running for hook update-status 2024-11-07 01:49:35 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 01:49:35 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_cert 2024-11-07 01:49:35 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_key 2024-11-07 01:49:35 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_ca 2024-11-07 01:49:35 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.source 2024-11-07 01:49:35 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.source 2024-11-07 01:49:35 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.cluster-name 2024-11-07 01:49:35 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.cluster-name 2024-11-07 01:49:35 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.auto-rejoin-tries 2024-11-07 01:49:35 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.auto-rejoin-tries 2024-11-07 01:49:35 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.expel-timeout 2024-11-07 01:49:35 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.expel-timeout 2024-11-07 01:49:35 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-buffer-pool-size 2024-11-07 01:49:35 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-change-buffering 2024-11-07 01:49:35 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-change-buffering 2024-11-07 01:49:35 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-io-capacity 2024-11-07 01:49:35 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-io-capacity 2024-11-07 01:49:35 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-file-per-table 2024-11-07 01:49:35 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-file-per-table 2024-11-07 01:49:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.tuning-level 2024-11-07 01:49:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.tuning-level 2024-11-07 01:49:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.table-open-cache 2024-11-07 01:49:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.table-open-cache 2024-11-07 01:49:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.max-connections 2024-11-07 01:49:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.enable-binlogs 2024-11-07 01:49:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-path 2024-11-07 01:49:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-path 2024-11-07 01:49:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-max-size 2024-11-07 01:49:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-max-size 2024-11-07 01:49:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-expire-days 2024-11-07 01:49:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-expire-days 2024-11-07 01:49:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.prefer-ipv6 2024-11-07 01:49:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.wait-timeout 2024-11-07 01:49:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.wait-timeout 2024-11-07 01:49:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.os-db-router-hostname 2024-11-07 01:49:36 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Initializing Snap Layer 2024-11-07 01:49:36 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Loading state 2024-11-07 01:49:36 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 01:49:36 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Coordinator: Initializing coordinator layer 2024-11-07 01:49:36 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Initializing Leadership Layer (is leader) 2024-11-07 01:49:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: starting handler dispatch, 107 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-49-102-64 tracer: set flag leadership.set.cluster-instance-clustered-252-49-107-157 tracer: set flag leadership.set.cluster-instance-clustered-252-49-94-42 tracer: set flag leadership.set.cluster-instance-configured-252-49-102-64 tracer: set flag leadership.set.cluster-instance-configured-252-49-107-157 tracer: set flag leadership.set.cluster-instance-configured-252-49-94-42 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-11-07 01:49:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:64:default_update_status 2024-11-07 01:49:36 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:64:default_update_status 2024-11-07 01:49:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag run-default-update-status 2024-11-07 01:49:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag is-update-status-hook 2024-11-07 01:49:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:82:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:93:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 01:49:36 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:82:check_really_is_update_status 2024-11-07 01:49:36 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:93:run_default_update_status 2024-11-07 01:49:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:93:run_default_update_status 2024-11-07 01:49:36 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 01:49:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Found peers: 252.49.107.157,252.49.94.42 2024-11-07 01:49:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Expect 2 peers 2024-11-07 01:49:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Reached quorum 2024-11-07 01:49:36 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-11-07 01:49:36 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-11-07 01:49:36 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-11-07 01:49:36 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 01:49:36 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Running _assess_status() 2024-11-07 01:49:37 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-11-07 01:49:37 DEBUG unit.mysql-innodb-cluster/1.update-status logger.go:60 active 2024-11-07 01:49:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Opening db connection for root@localhost 2024-11-07 01:49:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Checking cluster status. 2024-11-07 01:49:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Opening db connection for root@None 2024-11-07 01:49:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 01:49:38 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 01:49:38 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Publishing state 2024-11-07 01:49:38 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-11-07 01:49:38 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 01:49:38 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-07 01:49:38 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 01:49:38 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/1 2024-11-07 01:49:38 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 01:49:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-11-07 01:49:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 01:49:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-11-07 01:49:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 01:49:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 01:49:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-11-07 01:49:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 01:49:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 01:49:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-11-07 01:49:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 01:49:38 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 01:54:28 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for mysql-innodb-cluster/1 2024-11-07 01:54:28 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 01:54:28 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-11-07 01:54:28 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 01:54:28 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 01:54:28 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-11-07 01:54:28 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 01:54:28 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 01:54:28 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 01:54:28 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-11-07 01:54:28 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 01:54:28 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 01:54:28 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-11-07 01:54:28 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for mysql-innodb-cluster/1 2024-11-07 01:54:28 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 01:54:28 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 01:54:28 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 01:54:28 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 01:54:28 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-1/agent.socket } 2024-11-07 01:54:29 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Reactive main running for hook update-status 2024-11-07 01:54:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 01:54:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_cert 2024-11-07 01:54:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_key 2024-11-07 01:54:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_ca 2024-11-07 01:54:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.source 2024-11-07 01:54:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.source 2024-11-07 01:54:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.cluster-name 2024-11-07 01:54:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.cluster-name 2024-11-07 01:54:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.auto-rejoin-tries 2024-11-07 01:54:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.auto-rejoin-tries 2024-11-07 01:54:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.expel-timeout 2024-11-07 01:54:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.expel-timeout 2024-11-07 01:54:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-buffer-pool-size 2024-11-07 01:54:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-change-buffering 2024-11-07 01:54:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-change-buffering 2024-11-07 01:54:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-io-capacity 2024-11-07 01:54:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-io-capacity 2024-11-07 01:54:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-file-per-table 2024-11-07 01:54:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-file-per-table 2024-11-07 01:54:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.tuning-level 2024-11-07 01:54:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.tuning-level 2024-11-07 01:54:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.table-open-cache 2024-11-07 01:54:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.table-open-cache 2024-11-07 01:54:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.max-connections 2024-11-07 01:54:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.enable-binlogs 2024-11-07 01:54:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-path 2024-11-07 01:54:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-path 2024-11-07 01:54:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-max-size 2024-11-07 01:54:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-max-size 2024-11-07 01:54:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-expire-days 2024-11-07 01:54:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-expire-days 2024-11-07 01:54:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.prefer-ipv6 2024-11-07 01:54:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.wait-timeout 2024-11-07 01:54:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.wait-timeout 2024-11-07 01:54:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.os-db-router-hostname 2024-11-07 01:54:30 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Initializing Snap Layer 2024-11-07 01:54:30 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Loading state 2024-11-07 01:54:30 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 01:54:30 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Coordinator: Initializing coordinator layer 2024-11-07 01:54:30 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Initializing Leadership Layer (is leader) 2024-11-07 01:54:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: starting handler dispatch, 107 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-49-102-64 tracer: set flag leadership.set.cluster-instance-clustered-252-49-107-157 tracer: set flag leadership.set.cluster-instance-clustered-252-49-94-42 tracer: set flag leadership.set.cluster-instance-configured-252-49-102-64 tracer: set flag leadership.set.cluster-instance-configured-252-49-107-157 tracer: set flag leadership.set.cluster-instance-configured-252-49-94-42 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-11-07 01:54:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:64:default_update_status 2024-11-07 01:54:30 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:64:default_update_status 2024-11-07 01:54:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag run-default-update-status 2024-11-07 01:54:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag is-update-status-hook 2024-11-07 01:54:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:82:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:93:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 01:54:30 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:82:check_really_is_update_status 2024-11-07 01:54:30 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:93:run_default_update_status 2024-11-07 01:54:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:93:run_default_update_status 2024-11-07 01:54:30 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 01:54:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Found peers: 252.49.107.157,252.49.94.42 2024-11-07 01:54:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Expect 2 peers 2024-11-07 01:54:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Reached quorum 2024-11-07 01:54:30 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-11-07 01:54:30 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-11-07 01:54:30 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-11-07 01:54:30 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 01:54:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Running _assess_status() 2024-11-07 01:54:31 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-11-07 01:54:31 DEBUG unit.mysql-innodb-cluster/1.update-status logger.go:60 active 2024-11-07 01:54:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Opening db connection for root@localhost 2024-11-07 01:54:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Checking cluster status. 2024-11-07 01:54:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Opening db connection for root@None 2024-11-07 01:54:31 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 01:54:31 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 01:54:31 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Publishing state 2024-11-07 01:54:32 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-11-07 01:54:32 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 01:54:32 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-07 01:54:32 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 01:54:32 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/1 2024-11-07 01:54:32 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 01:54:32 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 01:54:32 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 01:54:32 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 01:54:32 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-11-07 01:54:32 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-11-07 01:54:32 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 01:54:32 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 01:54:32 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-11-07 01:54:32 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 01:54:32 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 01:54:32 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-11-07 01:59:37 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for mysql-innodb-cluster/1 2024-11-07 01:59:37 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 01:59:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-11-07 01:59:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 01:59:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 01:59:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 01:59:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-11-07 01:59:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 01:59:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-11-07 01:59:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 01:59:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-11-07 01:59:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 01:59:37 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 01:59:37 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for mysql-innodb-cluster/1 2024-11-07 01:59:37 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 01:59:37 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 01:59:37 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 01:59:37 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 01:59:37 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-1/agent.socket } 2024-11-07 01:59:37 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Reactive main running for hook update-status 2024-11-07 01:59:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 01:59:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_cert 2024-11-07 01:59:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_key 2024-11-07 01:59:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_ca 2024-11-07 01:59:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.source 2024-11-07 01:59:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.source 2024-11-07 01:59:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.cluster-name 2024-11-07 01:59:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.cluster-name 2024-11-07 01:59:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.auto-rejoin-tries 2024-11-07 01:59:37 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.auto-rejoin-tries 2024-11-07 01:59:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.expel-timeout 2024-11-07 01:59:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.expel-timeout 2024-11-07 01:59:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-buffer-pool-size 2024-11-07 01:59:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-change-buffering 2024-11-07 01:59:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-change-buffering 2024-11-07 01:59:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-io-capacity 2024-11-07 01:59:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-io-capacity 2024-11-07 01:59:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-file-per-table 2024-11-07 01:59:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-file-per-table 2024-11-07 01:59:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.tuning-level 2024-11-07 01:59:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.tuning-level 2024-11-07 01:59:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.table-open-cache 2024-11-07 01:59:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.table-open-cache 2024-11-07 01:59:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.max-connections 2024-11-07 01:59:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.enable-binlogs 2024-11-07 01:59:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-path 2024-11-07 01:59:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-path 2024-11-07 01:59:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-max-size 2024-11-07 01:59:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-max-size 2024-11-07 01:59:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-expire-days 2024-11-07 01:59:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-expire-days 2024-11-07 01:59:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.prefer-ipv6 2024-11-07 01:59:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.wait-timeout 2024-11-07 01:59:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.wait-timeout 2024-11-07 01:59:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.os-db-router-hostname 2024-11-07 01:59:38 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Initializing Snap Layer 2024-11-07 01:59:38 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Loading state 2024-11-07 01:59:38 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 01:59:38 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Coordinator: Initializing coordinator layer 2024-11-07 01:59:38 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Initializing Leadership Layer (is leader) 2024-11-07 01:59:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: starting handler dispatch, 107 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-49-102-64 tracer: set flag leadership.set.cluster-instance-clustered-252-49-107-157 tracer: set flag leadership.set.cluster-instance-clustered-252-49-94-42 tracer: set flag leadership.set.cluster-instance-configured-252-49-102-64 tracer: set flag leadership.set.cluster-instance-configured-252-49-107-157 tracer: set flag leadership.set.cluster-instance-configured-252-49-94-42 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-11-07 01:59:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:64:default_update_status 2024-11-07 01:59:38 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:64:default_update_status 2024-11-07 01:59:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag run-default-update-status 2024-11-07 01:59:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag is-update-status-hook 2024-11-07 01:59:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:82:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:93:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 01:59:38 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:82:check_really_is_update_status 2024-11-07 01:59:38 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:93:run_default_update_status 2024-11-07 01:59:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:93:run_default_update_status 2024-11-07 01:59:38 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 01:59:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Found peers: 252.49.107.157,252.49.94.42 2024-11-07 01:59:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Expect 2 peers 2024-11-07 01:59:38 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Reached quorum 2024-11-07 01:59:38 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-11-07 01:59:38 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-11-07 01:59:38 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-11-07 01:59:39 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 01:59:39 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Running _assess_status() 2024-11-07 01:59:39 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-11-07 01:59:39 DEBUG unit.mysql-innodb-cluster/1.update-status logger.go:60 active 2024-11-07 01:59:39 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Opening db connection for root@localhost 2024-11-07 01:59:39 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Checking cluster status. 2024-11-07 01:59:40 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Opening db connection for root@None 2024-11-07 01:59:40 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 01:59:40 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 01:59:40 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Publishing state 2024-11-07 01:59:40 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-11-07 01:59:40 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 01:59:40 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-07 01:59:40 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 01:59:40 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/1 2024-11-07 01:59:40 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 01:59:40 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-11-07 01:59:40 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 01:59:40 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 01:59:40 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 01:59:40 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 01:59:40 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-11-07 01:59:40 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 01:59:40 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-11-07 01:59:40 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-11-07 01:59:40 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 01:59:40 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 01:59:59 DEBUG juju.worker.uniter.remotestate watcher.go:623 got update status interval change for mysql-innodb-cluster/1: ok=true 2024-11-07 01:59:59 DEBUG juju.worker.retrystrategy worker.go:92 bouncing retrystrategy worker to get new values 2024-11-07 01:59:59 DEBUG juju.worker.dependency engine.go:621 "hook-retry-strategy" manifold worker stopped: restart immediately 2024-11-07 01:59:59 DEBUG juju.worker.uniter runlistener.go:130 juju-run listener stopping 2024-11-07 01:59:59 DEBUG juju.worker.uniter runlistener.go:149 juju-run listener stopped 2024-11-07 01:59:59 INFO juju.worker.uniter uniter.go:319 unit "mysql-innodb-cluster/1" shutting down: catacomb 0xc000b46d80 is dying 2024-11-07 01:59:59 DEBUG juju.worker.dependency engine.go:580 "hook-retry-strategy" manifold worker started at 2024-11-07 01:59:59.674772155 +0000 UTC 2024-11-07 01:59:59 DEBUG juju.worker.dependency engine.go:603 "uniter" manifold worker completed successfully 2024-11-07 01:59:59 DEBUG juju.worker.dependency engine.go:580 "uniter" manifold worker started at 2024-11-07 01:59:59.684018051 +0000 UTC 2024-11-07 02:00:01 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "mysql-innodb-cluster/1" (leader=true) entered scope for relation "neutron-mysql-router:db-router mysql-innodb-cluster:db-router" 2024-11-07 02:00:01 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "mysql-innodb-cluster/1" (leader=true) entered scope for relation "glance-mysql-router:db-router mysql-innodb-cluster:db-router" 2024-11-07 02:00:01 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "mysql-innodb-cluster/1" (leader=true) entered scope for relation "keystone-mysql-router:db-router mysql-innodb-cluster:db-router" 2024-11-07 02:00:01 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "mysql-innodb-cluster/1" (leader=true) entered scope for relation "mysql-innodb-cluster:cluster" 2024-11-07 02:00:01 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "mysql-innodb-cluster/1" (leader=true) entered scope for relation "mysql-innodb-cluster:coordinator" 2024-11-07 02:00:01 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "mysql-innodb-cluster/1" (leader=true) entered scope for relation "nova-mysql-router:db-router mysql-innodb-cluster:db-router" 2024-11-07 02:00:01 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "mysql-innodb-cluster/1" (leader=true) entered scope for relation "dashboard-mysql-router:db-router mysql-innodb-cluster:db-router" 2024-11-07 02:00:02 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "mysql-innodb-cluster/1" (leader=true) entered scope for relation "heat-mysql-router:db-router mysql-innodb-cluster:db-router" 2024-11-07 02:00:02 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "mysql-innodb-cluster/1" (leader=true) entered scope for relation "placement-mysql-router:db-router mysql-innodb-cluster:db-router" 2024-11-07 02:00:02 DEBUG juju.worker.uniter uniter.go:883 starting local juju-run listener on {unix /var/lib/juju/agents/unit-mysql-innodb-cluster-1/run.socket } 2024-11-07 02:00:02 INFO juju.worker.uniter uniter.go:335 unit "mysql-innodb-cluster/1" started 2024-11-07 02:00:02 DEBUG juju.worker.uniter runlistener.go:117 juju-run listener running 2024-11-07 02:00:02 INFO juju.worker.uniter uniter.go:361 hooks are retried false 2024-11-07 02:00:02 DEBUG juju.worker.uniter.remotestate watcher.go:595 got action change for mysql-innodb-cluster/1: [] ok=true 2024-11-07 02:00:02 DEBUG juju.worker.uniter.remotestate watcher.go:564 got upgrade series change 2024-11-07 02:00:02 DEBUG juju.worker.uniter.remotestate watcher.go:714 no upgrade series in progress, reinitializing local upgrade series state 2024-11-07 02:00:02 DEBUG juju.worker.uniter.remotestate watcher.go:603 got relations change for mysql-innodb-cluster/1: ok=true 2024-11-07 02:00:02 DEBUG juju.worker.uniter.remotestate watcher.go:499 got application change for mysql-innodb-cluster/1 2024-11-07 02:00:02 DEBUG juju.worker.uniter.remotestate watcher.go:623 got update status interval change for mysql-innodb-cluster/1: ok=true 2024-11-07 02:00:02 DEBUG juju.worker.uniter.remotestate watcher.go:542 got config change for mysql-innodb-cluster/1: ok=true, hashes=[16220c72d89b4caf072292fc8a79692b89ee0cd3ccb03f9ea52e6ca7cca5ed2b] 2024-11-07 02:00:02 DEBUG juju.worker.uniter.remotestate watcher.go:489 got unit change for mysql-innodb-cluster/1 2024-11-07 02:00:02 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for mysql-innodb-cluster/1: ok=true 2024-11-07 02:00:02 DEBUG juju.worker.uniter.remotestate watcher.go:509 got instance data change for mysql-innodb-cluster/1 2024-11-07 02:00:02 DEBUG juju.worker.uniter.remotestate watcher.go:843 LXDProfileName changed to "" 2024-11-07 02:00:02 DEBUG juju.worker.uniter.remotestate watcher.go:613 got storage change for mysql-innodb-cluster/1: [] ok=true 2024-11-07 02:00:02 DEBUG juju.worker.uniter.remotestate watcher.go:574 got address change for mysql-innodb-cluster/1: ok=true, hashes=[f4eb3045c318653b55be25c714b120ef6f410729ac6a6b0585eca24b5e1db320] 2024-11-07 02:00:02 DEBUG juju.worker.uniter.remotestate watcher.go:553 got trust config change for mysql-innodb-cluster/1: ok=true, hashes=[aeddf8dcd2b7e0ac0c37321c9d8645dff25799f0d355a7d57fccc94a3c9956b2] 2024-11-07 02:00:02 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 02:00:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-11-07 02:00:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 02:00:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 02:00:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 02:00:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 02:00:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 02:00:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-11-07 02:00:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 02:00:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-11-07 02:00:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-11-07 02:00:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 02:00:02 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 2024-11-07 02:05:56 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for mysql-innodb-cluster/1 2024-11-07 02:05:56 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 02:05:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-11-07 02:05:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-11-07 02:05:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-11-07 02:05:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 02:05:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 02:05:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-11-07 02:05:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 02:05:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 02:05:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 02:05:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 02:05:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 02:05:56 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for mysql-innodb-cluster/1 2024-11-07 02:05:56 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 02:05:56 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 02:05:56 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 02:05:56 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 02:05:56 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-1/agent.socket } 2024-11-07 02:05:57 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Reactive main running for hook update-status 2024-11-07 02:05:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 02:05:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_cert 2024-11-07 02:05:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_key 2024-11-07 02:05:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_ca 2024-11-07 02:05:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.source 2024-11-07 02:05:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.source 2024-11-07 02:05:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.cluster-name 2024-11-07 02:05:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.cluster-name 2024-11-07 02:05:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.auto-rejoin-tries 2024-11-07 02:05:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.auto-rejoin-tries 2024-11-07 02:05:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.expel-timeout 2024-11-07 02:05:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.expel-timeout 2024-11-07 02:05:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-buffer-pool-size 2024-11-07 02:05:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-change-buffering 2024-11-07 02:05:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-change-buffering 2024-11-07 02:05:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-io-capacity 2024-11-07 02:05:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-io-capacity 2024-11-07 02:05:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-file-per-table 2024-11-07 02:05:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-file-per-table 2024-11-07 02:05:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.tuning-level 2024-11-07 02:05:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.tuning-level 2024-11-07 02:05:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.table-open-cache 2024-11-07 02:05:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.table-open-cache 2024-11-07 02:05:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.max-connections 2024-11-07 02:05:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.enable-binlogs 2024-11-07 02:05:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-path 2024-11-07 02:05:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-path 2024-11-07 02:05:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-max-size 2024-11-07 02:05:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-max-size 2024-11-07 02:05:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-expire-days 2024-11-07 02:05:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-expire-days 2024-11-07 02:05:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.prefer-ipv6 2024-11-07 02:05:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.wait-timeout 2024-11-07 02:05:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.wait-timeout 2024-11-07 02:05:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.os-db-router-hostname 2024-11-07 02:05:59 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Initializing Snap Layer 2024-11-07 02:05:59 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Loading state 2024-11-07 02:05:59 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 02:05:59 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Coordinator: Initializing coordinator layer 2024-11-07 02:05:59 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Initializing Leadership Layer (is leader) 2024-11-07 02:05:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: starting handler dispatch, 107 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-49-102-64 tracer: set flag leadership.set.cluster-instance-clustered-252-49-107-157 tracer: set flag leadership.set.cluster-instance-clustered-252-49-94-42 tracer: set flag leadership.set.cluster-instance-configured-252-49-102-64 tracer: set flag leadership.set.cluster-instance-configured-252-49-107-157 tracer: set flag leadership.set.cluster-instance-configured-252-49-94-42 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-11-07 02:05:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:64:default_update_status 2024-11-07 02:05:59 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:64:default_update_status 2024-11-07 02:05:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag run-default-update-status 2024-11-07 02:05:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag is-update-status-hook 2024-11-07 02:05:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:82:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:93:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 02:05:59 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:82:check_really_is_update_status 2024-11-07 02:05:59 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:93:run_default_update_status 2024-11-07 02:06:00 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:93:run_default_update_status 2024-11-07 02:06:00 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 02:06:00 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Found peers: 252.49.107.157,252.49.94.42 2024-11-07 02:06:00 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Expect 2 peers 2024-11-07 02:06:00 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Reached quorum 2024-11-07 02:06:00 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-11-07 02:06:00 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-11-07 02:06:00 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-11-07 02:06:00 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 02:06:00 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Running _assess_status() 2024-11-07 02:06:01 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-11-07 02:06:01 DEBUG unit.mysql-innodb-cluster/1.update-status logger.go:60 active 2024-11-07 02:06:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Opening db connection for root@localhost 2024-11-07 02:06:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Checking cluster status. 2024-11-07 02:06:04 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Opening db connection for root@None 2024-11-07 02:06:04 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 02:06:04 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 02:06:04 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Publishing state 2024-11-07 02:06:04 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-11-07 02:06:04 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 02:06:04 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-07 02:06:04 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 02:06:04 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/1 2024-11-07 02:06:04 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 02:06:04 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 02:06:04 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 02:06:04 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 02:06:04 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-11-07 02:06:04 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 02:06:04 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 02:06:04 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-11-07 02:06:04 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-11-07 02:06:04 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 02:06:04 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 02:06:04 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-11-07 02:09:57 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for mysql-innodb-cluster/1 2024-11-07 02:09:57 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 02:09:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 02:09:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 02:09:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 02:09:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 02:09:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-11-07 02:09:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 02:09:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-11-07 02:09:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-11-07 02:09:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 02:09:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 02:09:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-11-07 02:09:57 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for mysql-innodb-cluster/1 2024-11-07 02:09:57 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 02:09:57 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 02:09:57 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 02:09:57 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 02:09:57 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-1/agent.socket } 2024-11-07 02:10:02 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Reactive main running for hook update-status 2024-11-07 02:10:04 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 02:10:04 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_cert 2024-11-07 02:10:04 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_key 2024-11-07 02:10:04 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_ca 2024-11-07 02:10:04 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.source 2024-11-07 02:10:04 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.source 2024-11-07 02:10:04 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.cluster-name 2024-11-07 02:10:04 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.cluster-name 2024-11-07 02:10:04 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.auto-rejoin-tries 2024-11-07 02:10:04 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.auto-rejoin-tries 2024-11-07 02:10:04 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.expel-timeout 2024-11-07 02:10:05 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.expel-timeout 2024-11-07 02:10:05 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-buffer-pool-size 2024-11-07 02:10:05 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-change-buffering 2024-11-07 02:10:05 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-change-buffering 2024-11-07 02:10:05 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-io-capacity 2024-11-07 02:10:05 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-io-capacity 2024-11-07 02:10:05 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-file-per-table 2024-11-07 02:10:05 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-file-per-table 2024-11-07 02:10:05 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.tuning-level 2024-11-07 02:10:05 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.tuning-level 2024-11-07 02:10:05 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.table-open-cache 2024-11-07 02:10:05 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.table-open-cache 2024-11-07 02:10:05 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.max-connections 2024-11-07 02:10:05 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.enable-binlogs 2024-11-07 02:10:05 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-path 2024-11-07 02:10:05 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-path 2024-11-07 02:10:05 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-max-size 2024-11-07 02:10:05 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-max-size 2024-11-07 02:10:05 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-expire-days 2024-11-07 02:10:05 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-expire-days 2024-11-07 02:10:05 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.prefer-ipv6 2024-11-07 02:10:05 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.wait-timeout 2024-11-07 02:10:05 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.wait-timeout 2024-11-07 02:10:05 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.os-db-router-hostname 2024-11-07 02:10:05 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Initializing Snap Layer 2024-11-07 02:10:06 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Loading state 2024-11-07 02:10:06 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 02:10:06 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Coordinator: Initializing coordinator layer 2024-11-07 02:10:06 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Initializing Leadership Layer (is leader) 2024-11-07 02:10:06 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: starting handler dispatch, 107 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-49-102-64 tracer: set flag leadership.set.cluster-instance-clustered-252-49-107-157 tracer: set flag leadership.set.cluster-instance-clustered-252-49-94-42 tracer: set flag leadership.set.cluster-instance-configured-252-49-102-64 tracer: set flag leadership.set.cluster-instance-configured-252-49-107-157 tracer: set flag leadership.set.cluster-instance-configured-252-49-94-42 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-11-07 02:10:06 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:64:default_update_status 2024-11-07 02:10:06 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:64:default_update_status 2024-11-07 02:10:06 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag run-default-update-status 2024-11-07 02:10:06 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag is-update-status-hook 2024-11-07 02:10:06 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:82:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:93:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 02:10:06 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:82:check_really_is_update_status 2024-11-07 02:10:06 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:93:run_default_update_status 2024-11-07 02:10:06 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:93:run_default_update_status 2024-11-07 02:10:06 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 02:10:06 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Found peers: 252.49.107.157,252.49.94.42 2024-11-07 02:10:06 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Expect 2 peers 2024-11-07 02:10:06 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Reached quorum 2024-11-07 02:10:06 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-11-07 02:10:06 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-11-07 02:10:06 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-11-07 02:10:06 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 02:10:06 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Running _assess_status() 2024-11-07 02:10:08 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-11-07 02:10:08 DEBUG unit.mysql-innodb-cluster/1.update-status logger.go:60 active 2024-11-07 02:10:08 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Opening db connection for root@localhost 2024-11-07 02:10:08 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Checking cluster status. 2024-11-07 02:10:15 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Opening db connection for root@None 2024-11-07 02:10:15 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 02:10:15 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 02:10:15 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Publishing state 2024-11-07 02:10:15 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-11-07 02:10:16 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 02:10:16 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-07 02:10:16 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 02:10:16 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/1 2024-11-07 02:10:16 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 02:10:16 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 02:10:16 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 02:10:16 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-11-07 02:10:16 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 02:10:16 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 02:10:16 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-11-07 02:10:16 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 02:10:16 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-11-07 02:10:16 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 02:10:16 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 02:10:16 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-11-07 02:14:20 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for mysql-innodb-cluster/1 2024-11-07 02:14:20 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 02:14:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 02:14:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-11-07 02:14:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-11-07 02:14:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-11-07 02:14:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-11-07 02:14:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 02:14:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 02:14:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 02:14:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 02:14:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 02:14:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 02:14:20 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for mysql-innodb-cluster/1 2024-11-07 02:14:20 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 02:14:20 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 02:14:20 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 02:14:20 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 02:14:20 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-1/agent.socket } 2024-11-07 02:14:23 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Reactive main running for hook update-status 2024-11-07 02:14:24 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 02:14:24 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_cert 2024-11-07 02:14:24 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_key 2024-11-07 02:14:24 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_ca 2024-11-07 02:14:24 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.source 2024-11-07 02:14:24 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.source 2024-11-07 02:14:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.cluster-name 2024-11-07 02:14:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.cluster-name 2024-11-07 02:14:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.auto-rejoin-tries 2024-11-07 02:14:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.auto-rejoin-tries 2024-11-07 02:14:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.expel-timeout 2024-11-07 02:14:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.expel-timeout 2024-11-07 02:14:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-buffer-pool-size 2024-11-07 02:14:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-change-buffering 2024-11-07 02:14:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-change-buffering 2024-11-07 02:14:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-io-capacity 2024-11-07 02:14:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-io-capacity 2024-11-07 02:14:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-file-per-table 2024-11-07 02:14:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-file-per-table 2024-11-07 02:14:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.tuning-level 2024-11-07 02:14:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.tuning-level 2024-11-07 02:14:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.table-open-cache 2024-11-07 02:14:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.table-open-cache 2024-11-07 02:14:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.max-connections 2024-11-07 02:14:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.enable-binlogs 2024-11-07 02:14:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-path 2024-11-07 02:14:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-path 2024-11-07 02:14:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-max-size 2024-11-07 02:14:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-max-size 2024-11-07 02:14:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-expire-days 2024-11-07 02:14:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-expire-days 2024-11-07 02:14:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.prefer-ipv6 2024-11-07 02:14:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.wait-timeout 2024-11-07 02:14:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.wait-timeout 2024-11-07 02:14:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.os-db-router-hostname 2024-11-07 02:14:26 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Initializing Snap Layer 2024-11-07 02:14:26 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Loading state 2024-11-07 02:14:26 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 02:14:26 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Coordinator: Initializing coordinator layer 2024-11-07 02:14:26 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Initializing Leadership Layer (is leader) 2024-11-07 02:14:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: starting handler dispatch, 107 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-49-102-64 tracer: set flag leadership.set.cluster-instance-clustered-252-49-107-157 tracer: set flag leadership.set.cluster-instance-clustered-252-49-94-42 tracer: set flag leadership.set.cluster-instance-configured-252-49-102-64 tracer: set flag leadership.set.cluster-instance-configured-252-49-107-157 tracer: set flag leadership.set.cluster-instance-configured-252-49-94-42 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-11-07 02:14:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:64:default_update_status 2024-11-07 02:14:26 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:64:default_update_status 2024-11-07 02:14:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag run-default-update-status 2024-11-07 02:14:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag is-update-status-hook 2024-11-07 02:14:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:82:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:93:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 02:14:26 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:82:check_really_is_update_status 2024-11-07 02:14:26 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:93:run_default_update_status 2024-11-07 02:14:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:93:run_default_update_status 2024-11-07 02:14:26 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 02:14:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Found peers: 252.49.107.157,252.49.94.42 2024-11-07 02:14:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Expect 2 peers 2024-11-07 02:14:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Reached quorum 2024-11-07 02:14:26 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-11-07 02:14:27 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-11-07 02:14:27 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-11-07 02:14:27 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 02:14:27 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Running _assess_status() 2024-11-07 02:14:28 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-11-07 02:14:28 DEBUG unit.mysql-innodb-cluster/1.update-status logger.go:60 active 2024-11-07 02:14:28 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Opening db connection for root@localhost 2024-11-07 02:14:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Checking cluster status. 2024-11-07 02:14:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Opening db connection for root@None 2024-11-07 02:14:34 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 02:14:34 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 02:14:34 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Publishing state 2024-11-07 02:14:35 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-11-07 02:14:35 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 02:14:35 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-07 02:14:35 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 02:14:35 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/1 2024-11-07 02:14:35 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 02:14:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 02:14:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 02:14:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-11-07 02:14:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 02:14:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-11-07 02:14:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 02:14:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-11-07 02:14:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-11-07 02:14:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 02:14:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 02:14:35 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 02:20:15 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for mysql-innodb-cluster/1 2024-11-07 02:20:15 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 02:20:15 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-11-07 02:20:15 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 02:20:15 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-11-07 02:20:15 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-11-07 02:20:15 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-11-07 02:20:15 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 02:20:15 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 02:20:15 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 02:20:15 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 02:20:15 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 02:20:15 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 02:20:15 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for mysql-innodb-cluster/1 2024-11-07 02:20:15 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 02:20:15 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 02:20:15 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 02:20:15 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 02:20:15 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-1/agent.socket } 2024-11-07 02:20:15 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Reactive main running for hook update-status 2024-11-07 02:20:16 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 02:20:16 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_cert 2024-11-07 02:20:16 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_key 2024-11-07 02:20:16 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_ca 2024-11-07 02:20:16 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.source 2024-11-07 02:20:16 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.source 2024-11-07 02:20:16 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.cluster-name 2024-11-07 02:20:16 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.cluster-name 2024-11-07 02:20:17 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.auto-rejoin-tries 2024-11-07 02:20:17 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.auto-rejoin-tries 2024-11-07 02:20:17 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.expel-timeout 2024-11-07 02:20:17 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.expel-timeout 2024-11-07 02:20:17 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-buffer-pool-size 2024-11-07 02:20:17 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-change-buffering 2024-11-07 02:20:17 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-change-buffering 2024-11-07 02:20:17 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-io-capacity 2024-11-07 02:20:17 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-io-capacity 2024-11-07 02:20:17 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-file-per-table 2024-11-07 02:20:17 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-file-per-table 2024-11-07 02:20:17 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.tuning-level 2024-11-07 02:20:17 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.tuning-level 2024-11-07 02:20:17 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.table-open-cache 2024-11-07 02:20:17 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.table-open-cache 2024-11-07 02:20:17 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.max-connections 2024-11-07 02:20:17 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.enable-binlogs 2024-11-07 02:20:17 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-path 2024-11-07 02:20:17 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-path 2024-11-07 02:20:17 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-max-size 2024-11-07 02:20:17 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-max-size 2024-11-07 02:20:17 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-expire-days 2024-11-07 02:20:17 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-expire-days 2024-11-07 02:20:17 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.prefer-ipv6 2024-11-07 02:20:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.wait-timeout 2024-11-07 02:20:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.wait-timeout 2024-11-07 02:20:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.os-db-router-hostname 2024-11-07 02:20:18 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Initializing Snap Layer 2024-11-07 02:20:18 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Loading state 2024-11-07 02:20:18 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 02:20:18 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Coordinator: Initializing coordinator layer 2024-11-07 02:20:18 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Initializing Leadership Layer (is leader) 2024-11-07 02:20:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: starting handler dispatch, 107 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-49-102-64 tracer: set flag leadership.set.cluster-instance-clustered-252-49-107-157 tracer: set flag leadership.set.cluster-instance-clustered-252-49-94-42 tracer: set flag leadership.set.cluster-instance-configured-252-49-102-64 tracer: set flag leadership.set.cluster-instance-configured-252-49-107-157 tracer: set flag leadership.set.cluster-instance-configured-252-49-94-42 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-11-07 02:20:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:64:default_update_status 2024-11-07 02:20:18 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:64:default_update_status 2024-11-07 02:20:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag run-default-update-status 2024-11-07 02:20:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag is-update-status-hook 2024-11-07 02:20:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:82:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:93:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 02:20:18 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:82:check_really_is_update_status 2024-11-07 02:20:18 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:93:run_default_update_status 2024-11-07 02:20:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:93:run_default_update_status 2024-11-07 02:20:18 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 02:20:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Found peers: 252.49.107.157,252.49.94.42 2024-11-07 02:20:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Expect 2 peers 2024-11-07 02:20:18 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Reached quorum 2024-11-07 02:20:18 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-11-07 02:20:18 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-11-07 02:20:18 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-11-07 02:20:19 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 02:20:19 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Running _assess_status() 2024-11-07 02:20:20 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-11-07 02:20:20 DEBUG unit.mysql-innodb-cluster/1.update-status logger.go:60 active 2024-11-07 02:20:20 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Opening db connection for root@localhost 2024-11-07 02:20:20 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Checking cluster status. 2024-11-07 02:20:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Opening db connection for root@None 2024-11-07 02:20:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 02:20:21 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 02:20:21 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Publishing state 2024-11-07 02:20:22 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-11-07 02:20:22 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 02:20:22 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-07 02:20:22 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 02:20:22 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/1 2024-11-07 02:20:22 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 02:20:22 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-11-07 02:20:22 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-11-07 02:20:22 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 02:20:22 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-11-07 02:20:22 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 02:20:22 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 02:20:22 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-11-07 02:20:22 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 02:20:22 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 02:20:22 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 02:20:22 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 02:24:51 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for mysql-innodb-cluster/1 2024-11-07 02:24:51 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 02:24:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 02:24:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 02:24:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 02:24:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 02:24:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-11-07 02:24:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 02:24:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-11-07 02:24:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 02:24:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 02:24:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-11-07 02:24:51 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-11-07 02:24:51 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for mysql-innodb-cluster/1 2024-11-07 02:24:51 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 02:24:51 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 02:24:51 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 02:24:52 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 02:24:52 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-1/agent.socket } 2024-11-07 02:24:52 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Reactive main running for hook update-status 2024-11-07 02:24:53 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 02:24:53 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_cert 2024-11-07 02:24:53 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_key 2024-11-07 02:24:53 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_ca 2024-11-07 02:24:53 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.source 2024-11-07 02:24:53 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.source 2024-11-07 02:24:53 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.cluster-name 2024-11-07 02:24:53 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.cluster-name 2024-11-07 02:24:53 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.auto-rejoin-tries 2024-11-07 02:24:53 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.auto-rejoin-tries 2024-11-07 02:24:53 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.expel-timeout 2024-11-07 02:24:53 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.expel-timeout 2024-11-07 02:24:53 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-buffer-pool-size 2024-11-07 02:24:53 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-change-buffering 2024-11-07 02:24:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-change-buffering 2024-11-07 02:24:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-io-capacity 2024-11-07 02:24:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-io-capacity 2024-11-07 02:24:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-file-per-table 2024-11-07 02:24:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-file-per-table 2024-11-07 02:24:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.tuning-level 2024-11-07 02:24:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.tuning-level 2024-11-07 02:24:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.table-open-cache 2024-11-07 02:24:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.table-open-cache 2024-11-07 02:24:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.max-connections 2024-11-07 02:24:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.enable-binlogs 2024-11-07 02:24:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-path 2024-11-07 02:24:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-path 2024-11-07 02:24:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-max-size 2024-11-07 02:24:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-max-size 2024-11-07 02:24:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-expire-days 2024-11-07 02:24:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-expire-days 2024-11-07 02:24:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.prefer-ipv6 2024-11-07 02:24:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.wait-timeout 2024-11-07 02:24:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.wait-timeout 2024-11-07 02:24:54 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.os-db-router-hostname 2024-11-07 02:24:54 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Initializing Snap Layer 2024-11-07 02:24:55 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Loading state 2024-11-07 02:24:55 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 02:24:55 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Coordinator: Initializing coordinator layer 2024-11-07 02:24:55 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Initializing Leadership Layer (is leader) 2024-11-07 02:24:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: starting handler dispatch, 107 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-49-102-64 tracer: set flag leadership.set.cluster-instance-clustered-252-49-107-157 tracer: set flag leadership.set.cluster-instance-clustered-252-49-94-42 tracer: set flag leadership.set.cluster-instance-configured-252-49-102-64 tracer: set flag leadership.set.cluster-instance-configured-252-49-107-157 tracer: set flag leadership.set.cluster-instance-configured-252-49-94-42 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-11-07 02:24:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:64:default_update_status 2024-11-07 02:24:55 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:64:default_update_status 2024-11-07 02:24:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag run-default-update-status 2024-11-07 02:24:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag is-update-status-hook 2024-11-07 02:24:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:82:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:93:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 02:24:55 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:82:check_really_is_update_status 2024-11-07 02:24:55 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:93:run_default_update_status 2024-11-07 02:24:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:93:run_default_update_status 2024-11-07 02:24:55 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 02:24:55 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Found peers: 252.49.107.157,252.49.94.42 2024-11-07 02:24:56 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Expect 2 peers 2024-11-07 02:24:56 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Reached quorum 2024-11-07 02:24:56 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-11-07 02:24:56 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-11-07 02:24:56 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-11-07 02:24:56 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 02:24:56 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Running _assess_status() 2024-11-07 02:24:57 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-11-07 02:24:57 DEBUG unit.mysql-innodb-cluster/1.update-status logger.go:60 active 2024-11-07 02:24:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Opening db connection for root@localhost 2024-11-07 02:24:57 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Checking cluster status. 2024-11-07 02:24:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Opening db connection for root@None 2024-11-07 02:24:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 02:24:59 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 02:24:59 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Publishing state 2024-11-07 02:24:59 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-11-07 02:24:59 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 02:24:59 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-07 02:24:59 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 02:24:59 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/1 2024-11-07 02:24:59 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 02:24:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 02:24:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 02:24:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 02:24:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 02:24:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 02:24:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-11-07 02:24:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-11-07 02:24:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 02:24:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-11-07 02:24:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-11-07 02:24:59 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 02:29:24 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for mysql-innodb-cluster/1 2024-11-07 02:29:24 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 02:29:24 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 02:29:24 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 02:29:24 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-11-07 02:29:24 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-11-07 02:29:24 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-11-07 02:29:24 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 02:29:24 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 02:29:24 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-11-07 02:29:24 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 02:29:24 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 02:29:24 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 02:29:24 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for mysql-innodb-cluster/1 2024-11-07 02:29:24 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 02:29:24 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 02:29:24 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 02:29:24 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 02:29:24 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-1/agent.socket } 2024-11-07 02:29:25 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Reactive main running for hook update-status 2024-11-07 02:29:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 02:29:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_cert 2024-11-07 02:29:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_key 2024-11-07 02:29:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_ca 2024-11-07 02:29:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.source 2024-11-07 02:29:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.source 2024-11-07 02:29:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.cluster-name 2024-11-07 02:29:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.cluster-name 2024-11-07 02:29:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.auto-rejoin-tries 2024-11-07 02:29:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.auto-rejoin-tries 2024-11-07 02:29:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.expel-timeout 2024-11-07 02:29:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.expel-timeout 2024-11-07 02:29:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-buffer-pool-size 2024-11-07 02:29:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-change-buffering 2024-11-07 02:29:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-change-buffering 2024-11-07 02:29:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-io-capacity 2024-11-07 02:29:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-io-capacity 2024-11-07 02:29:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-file-per-table 2024-11-07 02:29:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-file-per-table 2024-11-07 02:29:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.tuning-level 2024-11-07 02:29:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.tuning-level 2024-11-07 02:29:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.table-open-cache 2024-11-07 02:29:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.table-open-cache 2024-11-07 02:29:27 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.max-connections 2024-11-07 02:29:27 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.enable-binlogs 2024-11-07 02:29:27 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-path 2024-11-07 02:29:27 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-path 2024-11-07 02:29:27 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-max-size 2024-11-07 02:29:27 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-max-size 2024-11-07 02:29:27 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-expire-days 2024-11-07 02:29:27 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-expire-days 2024-11-07 02:29:27 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.prefer-ipv6 2024-11-07 02:29:27 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.wait-timeout 2024-11-07 02:29:27 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.wait-timeout 2024-11-07 02:29:27 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.os-db-router-hostname 2024-11-07 02:29:27 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Initializing Snap Layer 2024-11-07 02:29:27 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Loading state 2024-11-07 02:29:27 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 02:29:27 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Coordinator: Initializing coordinator layer 2024-11-07 02:29:27 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Initializing Leadership Layer (is leader) 2024-11-07 02:29:27 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: starting handler dispatch, 107 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-49-102-64 tracer: set flag leadership.set.cluster-instance-clustered-252-49-107-157 tracer: set flag leadership.set.cluster-instance-clustered-252-49-94-42 tracer: set flag leadership.set.cluster-instance-configured-252-49-102-64 tracer: set flag leadership.set.cluster-instance-configured-252-49-107-157 tracer: set flag leadership.set.cluster-instance-configured-252-49-94-42 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-11-07 02:29:27 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:64:default_update_status 2024-11-07 02:29:27 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:64:default_update_status 2024-11-07 02:29:27 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag run-default-update-status 2024-11-07 02:29:27 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag is-update-status-hook 2024-11-07 02:29:27 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:82:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:93:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 02:29:27 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:82:check_really_is_update_status 2024-11-07 02:29:27 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:93:run_default_update_status 2024-11-07 02:29:28 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:93:run_default_update_status 2024-11-07 02:29:28 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 02:29:28 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Found peers: 252.49.107.157,252.49.94.42 2024-11-07 02:29:28 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Expect 2 peers 2024-11-07 02:29:28 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Reached quorum 2024-11-07 02:29:28 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-11-07 02:29:28 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-11-07 02:29:28 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-11-07 02:29:28 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 02:29:28 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Running _assess_status() 2024-11-07 02:29:29 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-11-07 02:29:29 DEBUG unit.mysql-innodb-cluster/1.update-status logger.go:60 active 2024-11-07 02:29:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Opening db connection for root@localhost 2024-11-07 02:29:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Checking cluster status. 2024-11-07 02:29:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Opening db connection for root@None 2024-11-07 02:29:30 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 02:29:30 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 02:29:30 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Publishing state 2024-11-07 02:29:31 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-11-07 02:29:31 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 02:29:31 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-07 02:29:31 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 02:29:31 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/1 2024-11-07 02:29:31 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 02:29:31 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 02:29:31 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-11-07 02:29:31 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 02:29:31 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 02:29:31 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-11-07 02:29:31 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-11-07 02:29:31 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 02:29:31 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-11-07 02:29:31 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 02:29:31 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 02:29:31 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 02:34:18 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for mysql-innodb-cluster/1 2024-11-07 02:34:18 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 02:34:18 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 02:34:18 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 02:34:18 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-11-07 02:34:18 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-11-07 02:34:18 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 02:34:18 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 02:34:18 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-11-07 02:34:18 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-11-07 02:34:18 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 02:34:18 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 02:34:18 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 02:34:18 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for mysql-innodb-cluster/1 2024-11-07 02:34:18 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 02:34:18 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 02:34:18 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 02:34:18 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 02:34:18 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-1/agent.socket } 2024-11-07 02:34:18 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Reactive main running for hook update-status 2024-11-07 02:34:19 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 02:34:19 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_cert 2024-11-07 02:34:19 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_key 2024-11-07 02:34:19 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_ca 2024-11-07 02:34:19 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.source 2024-11-07 02:34:19 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.source 2024-11-07 02:34:19 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.cluster-name 2024-11-07 02:34:19 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.cluster-name 2024-11-07 02:34:19 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.auto-rejoin-tries 2024-11-07 02:34:20 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.auto-rejoin-tries 2024-11-07 02:34:20 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.expel-timeout 2024-11-07 02:34:20 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.expel-timeout 2024-11-07 02:34:20 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-buffer-pool-size 2024-11-07 02:34:20 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-change-buffering 2024-11-07 02:34:20 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-change-buffering 2024-11-07 02:34:20 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-io-capacity 2024-11-07 02:34:20 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-io-capacity 2024-11-07 02:34:20 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-file-per-table 2024-11-07 02:34:20 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-file-per-table 2024-11-07 02:34:20 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.tuning-level 2024-11-07 02:34:20 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.tuning-level 2024-11-07 02:34:20 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.table-open-cache 2024-11-07 02:34:20 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.table-open-cache 2024-11-07 02:34:20 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.max-connections 2024-11-07 02:34:20 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.enable-binlogs 2024-11-07 02:34:20 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-path 2024-11-07 02:34:20 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-path 2024-11-07 02:34:20 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-max-size 2024-11-07 02:34:20 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-max-size 2024-11-07 02:34:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-expire-days 2024-11-07 02:34:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-expire-days 2024-11-07 02:34:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.prefer-ipv6 2024-11-07 02:34:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.wait-timeout 2024-11-07 02:34:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.wait-timeout 2024-11-07 02:34:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.os-db-router-hostname 2024-11-07 02:34:21 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Initializing Snap Layer 2024-11-07 02:34:21 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Loading state 2024-11-07 02:34:21 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 02:34:21 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Coordinator: Initializing coordinator layer 2024-11-07 02:34:21 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Initializing Leadership Layer (is leader) 2024-11-07 02:34:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: starting handler dispatch, 107 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-49-102-64 tracer: set flag leadership.set.cluster-instance-clustered-252-49-107-157 tracer: set flag leadership.set.cluster-instance-clustered-252-49-94-42 tracer: set flag leadership.set.cluster-instance-configured-252-49-102-64 tracer: set flag leadership.set.cluster-instance-configured-252-49-107-157 tracer: set flag leadership.set.cluster-instance-configured-252-49-94-42 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-11-07 02:34:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:64:default_update_status 2024-11-07 02:34:21 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:64:default_update_status 2024-11-07 02:34:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag run-default-update-status 2024-11-07 02:34:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag is-update-status-hook 2024-11-07 02:34:21 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:82:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:93:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 02:34:21 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:82:check_really_is_update_status 2024-11-07 02:34:21 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:93:run_default_update_status 2024-11-07 02:34:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:93:run_default_update_status 2024-11-07 02:34:22 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 02:34:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Found peers: 252.49.107.157,252.49.94.42 2024-11-07 02:34:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Expect 2 peers 2024-11-07 02:34:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Reached quorum 2024-11-07 02:34:22 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-11-07 02:34:22 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-11-07 02:34:22 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-11-07 02:34:22 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 02:34:22 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Running _assess_status() 2024-11-07 02:34:23 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-11-07 02:34:23 DEBUG unit.mysql-innodb-cluster/1.update-status logger.go:60 active 2024-11-07 02:34:23 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Opening db connection for root@localhost 2024-11-07 02:34:23 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Checking cluster status. 2024-11-07 02:34:24 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Opening db connection for root@None 2024-11-07 02:34:24 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 02:34:24 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 02:34:24 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Publishing state 2024-11-07 02:34:25 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-11-07 02:34:25 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 02:34:25 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-07 02:34:25 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 02:34:25 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/1 2024-11-07 02:34:25 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 02:34:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-11-07 02:34:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-11-07 02:34:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-11-07 02:34:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 02:34:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 02:34:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 02:34:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 02:34:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 02:34:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 02:34:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-11-07 02:34:25 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 02:39:22 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for mysql-innodb-cluster/1 2024-11-07 02:39:22 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 02:39:22 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 02:39:22 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 02:39:22 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 02:39:22 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 02:39:22 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 02:39:22 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 02:39:22 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-11-07 02:39:22 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-11-07 02:39:22 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-11-07 02:39:22 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-11-07 02:39:22 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 02:39:22 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for mysql-innodb-cluster/1 2024-11-07 02:39:22 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 02:39:22 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 02:39:22 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 02:39:23 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 02:39:23 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-1/agent.socket } 2024-11-07 02:39:23 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Reactive main running for hook update-status 2024-11-07 02:39:24 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 02:39:24 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_cert 2024-11-07 02:39:24 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_key 2024-11-07 02:39:24 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_ca 2024-11-07 02:39:24 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.source 2024-11-07 02:39:24 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.source 2024-11-07 02:39:24 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.cluster-name 2024-11-07 02:39:24 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.cluster-name 2024-11-07 02:39:24 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.auto-rejoin-tries 2024-11-07 02:39:24 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.auto-rejoin-tries 2024-11-07 02:39:24 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.expel-timeout 2024-11-07 02:39:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.expel-timeout 2024-11-07 02:39:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-buffer-pool-size 2024-11-07 02:39:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-change-buffering 2024-11-07 02:39:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-change-buffering 2024-11-07 02:39:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-io-capacity 2024-11-07 02:39:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-io-capacity 2024-11-07 02:39:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-file-per-table 2024-11-07 02:39:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-file-per-table 2024-11-07 02:39:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.tuning-level 2024-11-07 02:39:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.tuning-level 2024-11-07 02:39:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.table-open-cache 2024-11-07 02:39:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.table-open-cache 2024-11-07 02:39:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.max-connections 2024-11-07 02:39:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.enable-binlogs 2024-11-07 02:39:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-path 2024-11-07 02:39:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-path 2024-11-07 02:39:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-max-size 2024-11-07 02:39:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-max-size 2024-11-07 02:39:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-expire-days 2024-11-07 02:39:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-expire-days 2024-11-07 02:39:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.prefer-ipv6 2024-11-07 02:39:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.wait-timeout 2024-11-07 02:39:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.wait-timeout 2024-11-07 02:39:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.os-db-router-hostname 2024-11-07 02:39:25 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Initializing Snap Layer 2024-11-07 02:39:26 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Loading state 2024-11-07 02:39:26 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 02:39:26 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Coordinator: Initializing coordinator layer 2024-11-07 02:39:26 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Initializing Leadership Layer (is leader) 2024-11-07 02:39:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: starting handler dispatch, 107 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-49-102-64 tracer: set flag leadership.set.cluster-instance-clustered-252-49-107-157 tracer: set flag leadership.set.cluster-instance-clustered-252-49-94-42 tracer: set flag leadership.set.cluster-instance-configured-252-49-102-64 tracer: set flag leadership.set.cluster-instance-configured-252-49-107-157 tracer: set flag leadership.set.cluster-instance-configured-252-49-94-42 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-11-07 02:39:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:64:default_update_status 2024-11-07 02:39:26 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:64:default_update_status 2024-11-07 02:39:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag run-default-update-status 2024-11-07 02:39:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag is-update-status-hook 2024-11-07 02:39:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:82:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:93:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 02:39:26 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:82:check_really_is_update_status 2024-11-07 02:39:26 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:93:run_default_update_status 2024-11-07 02:39:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:93:run_default_update_status 2024-11-07 02:39:26 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 02:39:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Found peers: 252.49.107.157,252.49.94.42 2024-11-07 02:39:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Expect 2 peers 2024-11-07 02:39:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Reached quorum 2024-11-07 02:39:26 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-11-07 02:39:26 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-11-07 02:39:26 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-11-07 02:39:27 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 02:39:27 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Running _assess_status() 2024-11-07 02:39:27 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-11-07 02:39:27 DEBUG unit.mysql-innodb-cluster/1.update-status logger.go:60 active 2024-11-07 02:39:27 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Opening db connection for root@localhost 2024-11-07 02:39:28 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Checking cluster status. 2024-11-07 02:39:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Opening db connection for root@None 2024-11-07 02:39:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 02:39:29 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 02:39:29 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Publishing state 2024-11-07 02:39:29 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-11-07 02:39:29 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 02:39:29 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-07 02:39:29 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 02:39:29 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/1 2024-11-07 02:39:29 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 02:39:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 02:39:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 02:39:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 02:39:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 02:39:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 02:39:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-11-07 02:39:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-11-07 02:39:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 02:39:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 02:39:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-11-07 02:39:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-11-07 02:43:22 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for mysql-innodb-cluster/1 2024-11-07 02:43:22 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 02:43:22 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-11-07 02:43:22 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-11-07 02:43:22 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 02:43:22 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 02:43:22 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 02:43:22 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 02:43:22 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 02:43:22 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 02:43:22 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 02:43:22 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-11-07 02:43:22 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-11-07 02:43:22 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for mysql-innodb-cluster/1 2024-11-07 02:43:22 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 02:43:22 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 02:43:22 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 02:43:22 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 02:43:22 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-1/agent.socket } 2024-11-07 02:43:23 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Reactive main running for hook update-status 2024-11-07 02:43:24 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 02:43:24 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_cert 2024-11-07 02:43:24 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_key 2024-11-07 02:43:24 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_ca 2024-11-07 02:43:24 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.source 2024-11-07 02:43:24 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.source 2024-11-07 02:43:24 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.cluster-name 2024-11-07 02:43:24 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.cluster-name 2024-11-07 02:43:24 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.auto-rejoin-tries 2024-11-07 02:43:24 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.auto-rejoin-tries 2024-11-07 02:43:24 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.expel-timeout 2024-11-07 02:43:24 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.expel-timeout 2024-11-07 02:43:24 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-buffer-pool-size 2024-11-07 02:43:24 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-change-buffering 2024-11-07 02:43:24 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-change-buffering 2024-11-07 02:43:24 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-io-capacity 2024-11-07 02:43:24 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-io-capacity 2024-11-07 02:43:24 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-file-per-table 2024-11-07 02:43:24 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-file-per-table 2024-11-07 02:43:24 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.tuning-level 2024-11-07 02:43:24 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.tuning-level 2024-11-07 02:43:24 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.table-open-cache 2024-11-07 02:43:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.table-open-cache 2024-11-07 02:43:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.max-connections 2024-11-07 02:43:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.enable-binlogs 2024-11-07 02:43:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-path 2024-11-07 02:43:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-path 2024-11-07 02:43:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-max-size 2024-11-07 02:43:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-max-size 2024-11-07 02:43:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-expire-days 2024-11-07 02:43:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-expire-days 2024-11-07 02:43:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.prefer-ipv6 2024-11-07 02:43:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.wait-timeout 2024-11-07 02:43:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.wait-timeout 2024-11-07 02:43:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.os-db-router-hostname 2024-11-07 02:43:25 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Initializing Snap Layer 2024-11-07 02:43:25 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Loading state 2024-11-07 02:43:25 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 02:43:25 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Coordinator: Initializing coordinator layer 2024-11-07 02:43:25 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Initializing Leadership Layer (is leader) 2024-11-07 02:43:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: starting handler dispatch, 107 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-49-102-64 tracer: set flag leadership.set.cluster-instance-clustered-252-49-107-157 tracer: set flag leadership.set.cluster-instance-clustered-252-49-94-42 tracer: set flag leadership.set.cluster-instance-configured-252-49-102-64 tracer: set flag leadership.set.cluster-instance-configured-252-49-107-157 tracer: set flag leadership.set.cluster-instance-configured-252-49-94-42 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-11-07 02:43:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:64:default_update_status 2024-11-07 02:43:25 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:64:default_update_status 2024-11-07 02:43:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag run-default-update-status 2024-11-07 02:43:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag is-update-status-hook 2024-11-07 02:43:25 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:82:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:93:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 02:43:25 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:82:check_really_is_update_status 2024-11-07 02:43:25 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:93:run_default_update_status 2024-11-07 02:43:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:93:run_default_update_status 2024-11-07 02:43:26 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 02:43:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Found peers: 252.49.107.157,252.49.94.42 2024-11-07 02:43:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Expect 2 peers 2024-11-07 02:43:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Reached quorum 2024-11-07 02:43:26 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-11-07 02:43:26 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-11-07 02:43:26 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-11-07 02:43:26 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 02:43:26 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Running _assess_status() 2024-11-07 02:43:27 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-11-07 02:43:27 DEBUG unit.mysql-innodb-cluster/1.update-status logger.go:60 active 2024-11-07 02:43:27 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Opening db connection for root@localhost 2024-11-07 02:43:27 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Checking cluster status. 2024-11-07 02:43:28 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Opening db connection for root@None 2024-11-07 02:43:29 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 02:43:29 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 02:43:29 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Publishing state 2024-11-07 02:43:29 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-11-07 02:43:29 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 02:43:29 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-07 02:43:29 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 02:43:29 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/1 2024-11-07 02:43:29 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 02:43:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 02:43:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 02:43:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 02:43:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-11-07 02:43:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 02:43:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-11-07 02:43:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 02:43:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 02:43:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-11-07 02:43:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 02:43:29 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-11-07 02:48:57 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for mysql-innodb-cluster/1 2024-11-07 02:48:57 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 02:48:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 02:48:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 02:48:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-11-07 02:48:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 02:48:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 02:48:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 02:48:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-11-07 02:48:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-11-07 02:48:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-11-07 02:48:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 02:48:57 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 02:48:57 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for mysql-innodb-cluster/1 2024-11-07 02:48:57 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 02:48:57 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 02:48:57 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 02:48:57 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 02:48:57 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-1/agent.socket } 2024-11-07 02:48:58 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Reactive main running for hook update-status 2024-11-07 02:48:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 02:48:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_cert 2024-11-07 02:48:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_key 2024-11-07 02:48:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_ca 2024-11-07 02:48:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.source 2024-11-07 02:48:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.source 2024-11-07 02:48:58 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.cluster-name 2024-11-07 02:48:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.cluster-name 2024-11-07 02:48:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.auto-rejoin-tries 2024-11-07 02:48:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.auto-rejoin-tries 2024-11-07 02:48:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.expel-timeout 2024-11-07 02:48:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.expel-timeout 2024-11-07 02:48:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-buffer-pool-size 2024-11-07 02:48:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-change-buffering 2024-11-07 02:48:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-change-buffering 2024-11-07 02:48:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-io-capacity 2024-11-07 02:48:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-io-capacity 2024-11-07 02:48:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-file-per-table 2024-11-07 02:48:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-file-per-table 2024-11-07 02:48:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.tuning-level 2024-11-07 02:48:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.tuning-level 2024-11-07 02:48:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.table-open-cache 2024-11-07 02:48:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.table-open-cache 2024-11-07 02:48:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.max-connections 2024-11-07 02:48:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.enable-binlogs 2024-11-07 02:48:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-path 2024-11-07 02:48:59 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-path 2024-11-07 02:49:00 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-max-size 2024-11-07 02:49:00 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-max-size 2024-11-07 02:49:00 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-expire-days 2024-11-07 02:49:00 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-expire-days 2024-11-07 02:49:00 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.prefer-ipv6 2024-11-07 02:49:00 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.wait-timeout 2024-11-07 02:49:00 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.wait-timeout 2024-11-07 02:49:00 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.os-db-router-hostname 2024-11-07 02:49:00 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Initializing Snap Layer 2024-11-07 02:49:00 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Loading state 2024-11-07 02:49:00 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 02:49:00 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Coordinator: Initializing coordinator layer 2024-11-07 02:49:00 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Initializing Leadership Layer (is leader) 2024-11-07 02:49:00 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: starting handler dispatch, 107 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-49-102-64 tracer: set flag leadership.set.cluster-instance-clustered-252-49-107-157 tracer: set flag leadership.set.cluster-instance-clustered-252-49-94-42 tracer: set flag leadership.set.cluster-instance-configured-252-49-102-64 tracer: set flag leadership.set.cluster-instance-configured-252-49-107-157 tracer: set flag leadership.set.cluster-instance-configured-252-49-94-42 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-11-07 02:49:00 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:64:default_update_status 2024-11-07 02:49:00 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:64:default_update_status 2024-11-07 02:49:00 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag run-default-update-status 2024-11-07 02:49:00 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag is-update-status-hook 2024-11-07 02:49:00 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:82:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:93:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 02:49:00 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:82:check_really_is_update_status 2024-11-07 02:49:00 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:93:run_default_update_status 2024-11-07 02:49:00 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:93:run_default_update_status 2024-11-07 02:49:00 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 02:49:00 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Found peers: 252.49.107.157,252.49.94.42 2024-11-07 02:49:00 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Expect 2 peers 2024-11-07 02:49:00 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Reached quorum 2024-11-07 02:49:00 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-11-07 02:49:01 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-11-07 02:49:01 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-11-07 02:49:01 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 02:49:01 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Running _assess_status() 2024-11-07 02:49:02 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-11-07 02:49:02 DEBUG unit.mysql-innodb-cluster/1.update-status logger.go:60 active 2024-11-07 02:49:02 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Opening db connection for root@localhost 2024-11-07 02:49:02 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Checking cluster status. 2024-11-07 02:49:03 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Opening db connection for root@None 2024-11-07 02:49:03 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 02:49:03 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 02:49:03 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Publishing state 2024-11-07 02:49:04 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-11-07 02:49:04 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 02:49:04 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-07 02:49:04 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 02:49:04 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/1 2024-11-07 02:49:04 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 02:49:04 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 02:49:04 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-11-07 02:49:04 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 02:49:04 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 02:49:04 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 02:49:04 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 02:49:04 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 02:49:04 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-11-07 02:49:04 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 02:49:04 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-11-07 02:49:04 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-11-07 02:53:08 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for mysql-innodb-cluster/1 2024-11-07 02:53:08 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 02:53:08 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-11-07 02:53:08 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 02:53:08 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-11-07 02:53:08 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 02:53:08 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 02:53:08 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 02:53:08 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-11-07 02:53:08 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 02:53:08 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3 2024-11-07 02:53:08 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-11-07 02:53:08 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 02:53:08 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for mysql-innodb-cluster/1 2024-11-07 02:53:08 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 02:53:08 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 02:53:08 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 02:53:08 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 02:53:08 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-mysql-innodb-cluster-1/agent.socket } 2024-11-07 02:53:09 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Reactive main running for hook update-status 2024-11-07 02:53:10 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: set flag config.default.snapd_refresh tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 02:53:10 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_cert 2024-11-07 02:53:10 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_key 2024-11-07 02:53:10 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.ssl_ca 2024-11-07 02:53:10 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.source 2024-11-07 02:53:10 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.source 2024-11-07 02:53:10 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.cluster-name 2024-11-07 02:53:10 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.cluster-name 2024-11-07 02:53:10 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.auto-rejoin-tries 2024-11-07 02:53:10 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.auto-rejoin-tries 2024-11-07 02:53:10 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.expel-timeout 2024-11-07 02:53:10 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.expel-timeout 2024-11-07 02:53:11 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-buffer-pool-size 2024-11-07 02:53:11 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-change-buffering 2024-11-07 02:53:11 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-change-buffering 2024-11-07 02:53:11 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-io-capacity 2024-11-07 02:53:11 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-io-capacity 2024-11-07 02:53:11 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.innodb-file-per-table 2024-11-07 02:53:11 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.innodb-file-per-table 2024-11-07 02:53:11 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.tuning-level 2024-11-07 02:53:11 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.tuning-level 2024-11-07 02:53:11 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.table-open-cache 2024-11-07 02:53:11 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.table-open-cache 2024-11-07 02:53:11 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.max-connections 2024-11-07 02:53:11 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.enable-binlogs 2024-11-07 02:53:11 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-path 2024-11-07 02:53:11 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-path 2024-11-07 02:53:11 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-max-size 2024-11-07 02:53:11 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-max-size 2024-11-07 02:53:11 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.binlogs-expire-days 2024-11-07 02:53:11 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.binlogs-expire-days 2024-11-07 02:53:11 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.prefer-ipv6 2024-11-07 02:53:11 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.set.wait-timeout 2024-11-07 02:53:11 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.wait-timeout 2024-11-07 02:53:11 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag config.default.os-db-router-hostname 2024-11-07 02:53:11 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Initializing Snap Layer 2024-11-07 02:53:11 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Loading state 2024-11-07 02:53:12 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 02:53:12 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Coordinator: Initializing coordinator layer 2024-11-07 02:53:12 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Initializing Leadership Layer (is leader) 2024-11-07 02:53:12 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: starting handler dispatch, 107 flags set tracer: set flag charm.installed tracer: set flag charms.openstack.do-default-update-status tracer: set flag cluster.available tracer: set flag cluster.clustered tracer: set flag cluster.connected tracer: set flag config.default.auto-rejoin-tries tracer: set flag config.default.binlogs-expire-days tracer: set flag config.default.binlogs-max-size tracer: set flag config.default.binlogs-path tracer: set flag config.default.cluster-name tracer: set flag config.default.enable-binlogs tracer: set flag config.default.expel-timeout tracer: set flag config.default.innodb-change-buffering tracer: set flag config.default.innodb-file-per-table tracer: set flag config.default.innodb-io-capacity tracer: set flag config.default.os-db-router-hostname tracer: set flag config.default.prefer-ipv6 tracer: set flag config.default.snapd_refresh tracer: set flag config.default.source tracer: set flag config.default.ssl_ca tracer: set flag config.default.ssl_cert tracer: set flag config.default.ssl_key tracer: set flag config.default.table-open-cache tracer: set flag config.default.tuning-level tracer: set flag config.default.wait-timeout tracer: set flag config.set.auto-rejoin-tries tracer: set flag config.set.binlogs-expire-days tracer: set flag config.set.binlogs-max-size tracer: set flag config.set.binlogs-path tracer: set flag config.set.cluster-name tracer: set flag config.set.expel-timeout tracer: set flag config.set.innodb-buffer-pool-size tracer: set flag config.set.innodb-change-buffering tracer: set flag config.set.innodb-file-per-table tracer: set flag config.set.innodb-io-capacity tracer: set flag config.set.max-connections tracer: set flag config.set.source tracer: set flag config.set.table-open-cache tracer: set flag config.set.tuning-level tracer: set flag config.set.wait-timeout tracer: set flag db-router.available tracer: set flag db-router.connected tracer: set flag endpoint.cluster.changed tracer: set flag endpoint.cluster.changed.egress-subnets tracer: set flag endpoint.cluster.changed.ingress-address tracer: set flag endpoint.cluster.changed.private-address tracer: set flag endpoint.cluster.changed.unit-clustered tracer: set flag endpoint.cluster.joined tracer: set flag endpoint.coordinator.changed tracer: set flag endpoint.coordinator.changed.coordinator tracer: set flag endpoint.coordinator.changed.egress-subnets tracer: set flag endpoint.coordinator.changed.ingress-address tracer: set flag endpoint.coordinator.changed.private-address tracer: set flag endpoint.coordinator.joined tracer: set flag endpoint.db-router.changed.MRUP_database tracer: set flag endpoint.db-router.changed.MRUP_hostname tracer: set flag endpoint.db-router.changed.MRUP_username tracer: set flag endpoint.db-router.changed.egress-subnets tracer: set flag endpoint.db-router.changed.heat_database tracer: set flag endpoint.db-router.changed.heat_hostname tracer: set flag endpoint.db-router.changed.heat_username tracer: set flag endpoint.db-router.changed.ingress-address tracer: set flag endpoint.db-router.changed.mysqlrouter_hostname tracer: set flag endpoint.db-router.changed.mysqlrouter_username tracer: set flag endpoint.db-router.changed.nova_database tracer: set flag endpoint.db-router.changed.nova_hostname tracer: set flag endpoint.db-router.changed.nova_username tracer: set flag endpoint.db-router.changed.novaapi_database tracer: set flag endpoint.db-router.changed.novaapi_hostname tracer: set flag endpoint.db-router.changed.novaapi_username tracer: set flag endpoint.db-router.changed.novacell0_database tracer: set flag endpoint.db-router.changed.novacell0_hostname tracer: set flag endpoint.db-router.changed.novacell0_username tracer: set flag endpoint.db-router.changed.placement_database tracer: set flag endpoint.db-router.changed.placement_hostname tracer: set flag endpoint.db-router.changed.placement_username tracer: set flag endpoint.db-router.changed.private-address tracer: set flag endpoint.db-router.joined tracer: set flag leadership.is_leader tracer: set flag leadership.set.cluster-created tracer: set flag leadership.set.cluster-instance-clustered-252-49-102-64 tracer: set flag leadership.set.cluster-instance-clustered-252-49-107-157 tracer: set flag leadership.set.cluster-instance-clustered-252-49-94-42 tracer: set flag leadership.set.cluster-instance-configured-252-49-102-64 tracer: set flag leadership.set.cluster-instance-configured-252-49-107-157 tracer: set flag leadership.set.cluster-instance-configured-252-49-94-42 tracer: set flag leadership.set.cluster-instances-clustered tracer: set flag leadership.set.cluster-instances-configured tracer: set flag leadership.set.cluster-password tracer: set flag leadership.set.coordinator tracer: set flag leadership.set.coordinator-released-locks-counts tracer: set flag leadership.set.mysql-glance.passwd tracer: set flag leadership.set.mysql-heat.passwd tracer: set flag leadership.set.mysql-horizon.passwd tracer: set flag leadership.set.mysql-keystone.passwd tracer: set flag leadership.set.mysql-mysqlrouteruser.passwd tracer: set flag leadership.set.mysql-neutron.passwd tracer: set flag leadership.set.mysql-nova.passwd tracer: set flag leadership.set.mysql-placement.passwd tracer: set flag leadership.set.mysql.passwd tracer: set flag local.cluster.all-users-created tracer: set flag local.cluster.quorum-reached tracer: set flag local.cluster.user-created tracer: set flag mysql-innodb-cluster-installed tracer: set flag snap.installed.core tracer: set flag snap.installed.mysql-shell tracer: set flag snap.refresh.set 2024-11-07 02:53:12 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: hooks phase, 1 handlers queued tracer: ++ queue handler reactive/layer_openstack.py:64:default_update_status 2024-11-07 02:53:12 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:64:default_update_status 2024-11-07 02:53:12 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag run-default-update-status 2024-11-07 02:53:12 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer: set flag is-update-status-hook 2024-11-07 02:53:12 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/layer_openstack.py:82:check_really_is_update_status tracer: ++ queue handler reactive/layer_openstack.py:93:run_default_update_status tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 02:53:12 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:82:check_really_is_update_status 2024-11-07 02:53:12 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/layer_openstack.py:93:run_default_update_status 2024-11-07 02:53:12 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: cleared flag run-default-update-status tracer: -- dequeue handler reactive/layer_openstack.py:93:run_default_update_status 2024-11-07 02:53:12 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 02:53:12 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Found peers: 252.49.107.157,252.49.94.42 2024-11-07 02:53:12 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Expect 2 peers 2024-11-07 02:53:12 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Reached quorum 2024-11-07 02:53:12 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster 2024-11-07 02:53:12 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster 2024-11-07 02:53:12 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/mysql-router/provides.py:47:joined:db-router 2024-11-07 02:53:13 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2024-11-07 02:53:13 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Running _assess_status() 2024-11-07 02:53:14 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 DEPRECATION WARNING: Function _ows_check_services_running is being removed on/around 2022-05 : use ows_check_services_running() instead 2024-11-07 02:53:14 DEBUG unit.mysql-innodb-cluster/1.update-status logger.go:60 active 2024-11-07 02:53:14 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Opening db connection for root@localhost 2024-11-07 02:53:14 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Checking cluster status. 2024-11-07 02:53:15 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 Opening db connection for root@None 2024-11-07 02:53:15 DEBUG unit.mysql-innodb-cluster/1.juju-log server.go:316 tracer> tracer: cleared flag is-update-status-hook tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:69:joined:cluster tracer: ++ queue handler hooks/relations/mysql-innodb-cluster/peers.py:75:changed:cluster tracer: ++ queue handler hooks/relations/mysql-router/provides.py:47:joined:db-router tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/mysql_innodb_cluster_handlers.py:138:check_quorum 2024-11-07 02:53:15 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Leader handling coordinator requests 2024-11-07 02:53:15 INFO unit.mysql-innodb-cluster/1.juju-log server.go:316 coordinator.DelayedActionCoordinator Publishing state 2024-11-07 02:53:16 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2024-11-07 02:53:16 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for mysql-innodb-cluster/1 2024-11-07 02:53:16 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2024-11-07 02:53:16 DEBUG juju.machinelock machinelock.go:186 machine lock released for mysql-innodb-cluster/1 uniter (run update-status hook) 2024-11-07 02:53:16 DEBUG juju.worker.uniter.operation executor.go:121 lock released for mysql-innodb-cluster/1 2024-11-07 02:53:16 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2024-11-07 02:53:16 DEBUG juju.worker.uniter.relation resolver.go:285 unit "nova-mysql-router/0" already joined relation 39 2024-11-07 02:53:16 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 4 2024-11-07 02:53:16 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 4 2024-11-07 02:53:16 DEBUG juju.worker.uniter.relation resolver.go:285 unit "glance-mysql-router/0" already joined relation 37 2024-11-07 02:53:16 DEBUG juju.worker.uniter.relation resolver.go:285 unit "dashboard-mysql-router/0" already joined relation 43 2024-11-07 02:53:16 DEBUG juju.worker.uniter.relation resolver.go:285 unit "keystone-mysql-router/0" already joined relation 35 2024-11-07 02:53:16 DEBUG juju.worker.uniter.relation resolver.go:285 unit "neutron-mysql-router/0" already joined relation 41 2024-11-07 02:53:16 DEBUG juju.worker.uniter.relation resolver.go:285 unit "placement-mysql-router/0" already joined relation 47 2024-11-07 02:53:16 DEBUG juju.worker.uniter.relation resolver.go:285 unit "heat-mysql-router/0" already joined relation 45 2024-11-07 02:53:16 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/0" already joined relation 3 2024-11-07 02:53:16 DEBUG juju.worker.uniter.relation resolver.go:285 unit "mysql-innodb-cluster/2" already joined relation 3