2025-04-18 04:56:16 INFO juju unit_agent.go:289 Starting unit workers for "kubeapi-load-balancer/0" 2025-04-18 04:56:16 INFO juju.worker.apicaller connect.go:163 [6a3603] "unit-kubeapi-load-balancer-0" successfully connected to "252.48.0.1:17070" 2025-04-18 04:56:16 INFO juju.worker.apicaller connect.go:260 [6a3603] password changed for "unit-kubeapi-load-balancer-0" 2025-04-18 04:56:16 INFO juju.worker.apicaller connect.go:163 [6a3603] "unit-kubeapi-load-balancer-0" successfully connected to "10.0.0.48:17070" 2025-04-18 04:56:16 INFO juju.worker.migrationminion worker.go:142 migration phase is now: NONE 2025-04-18 04:56:16 INFO juju.worker.logger logger.go:120 logger worker started 2025-04-18 04:56:16 DEBUG juju.worker.dependency engine.go:580 "metric-sender" manifold worker started at 2025-04-18 04:56:16.648176315 +0000 UTC 2025-04-18 04:56:16 INFO juju.worker.upgrader upgrader.go:216 no waiter, upgrader is done 2025-04-18 04:56:16 DEBUG juju.worker.dependency engine.go:603 "upgrader" manifold worker completed successfully 2025-04-18 04:56:16 DEBUG juju.worker.dependency engine.go:580 "uniter" manifold worker started at 2025-04-18 04:56:16.651627359 +0000 UTC 2025-04-18 04:56:16 DEBUG juju.worker.apiaddressupdater apiaddressupdater.go:98 updating API hostPorts to [[10.0.0.48:17070 252.48.0.1:17070 127.0.0.1:17070 [::1]:17070]] 2025-04-18 04:56:16 DEBUG juju.worker.meterstatus connected.go:93 got meter status change signal from watcher 2025-04-18 04:56:16 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for meterstatus (meter-status-changed) 2025-04-18 04:56:16 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for meterstatus (meter-status-changed) 2025-04-18 04:56:16 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-kubeapi-load-balancer-0/agent.socket } 2025-04-18 04:56:16 ERROR juju.worker.meterstatus runner.go:93 error running "meter-status-changed": charm missing from disk 2025-04-18 04:56:16 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2025-04-18 04:56:16 DEBUG juju.machinelock machinelock.go:186 machine lock released for meterstatus (meter-status-changed) 2025-04-18 04:56:16 DEBUG juju.worker.uniter uniter.go:883 starting local juju-run listener on {unix /var/lib/juju/agents/unit-kubeapi-load-balancer-0/run.socket } 2025-04-18 04:56:16 INFO juju.worker.uniter uniter.go:335 unit "kubeapi-load-balancer/0" started 2025-04-18 04:56:16 DEBUG juju.worker.uniter runlistener.go:117 juju-run listener running 2025-04-18 04:56:16 INFO juju.worker.uniter uniter.go:651 resuming charm install 2025-04-18 04:56:16 DEBUG juju.worker.uniter.operation executor.go:85 running operation install ch:amd64/focal/kubeapi-load-balancer-73 for kubeapi-load-balancer/0 2025-04-18 04:56:16 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "install ch:amd64/focal/kubeapi-load-balancer-73" for kubeapi-load-balancer/0 2025-04-18 04:56:16 INFO juju.worker.uniter.charm bundles.go:81 downloading ch:amd64/focal/kubeapi-load-balancer-73 from API server 2025-04-18 04:56:16 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "install ch:amd64/focal/kubeapi-load-balancer-73" for kubeapi-load-balancer/0 2025-04-18 04:56:16 DEBUG juju.worker.uniter.charm manifest_deployer.go:143 preparing to deploy charm "ch:amd64/focal/kubeapi-load-balancer-73" 2025-04-18 04:56:16 DEBUG juju.worker.uniter.charm manifest_deployer.go:132 deploying charm "ch:amd64/focal/kubeapi-load-balancer-73" 2025-04-18 04:56:17 DEBUG juju.worker.uniter.charm manifest_deployer.go:164 finishing deploy of charm "ch:amd64/focal/kubeapi-load-balancer-73" 2025-04-18 04:56:17 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "install ch:amd64/focal/kubeapi-load-balancer-73" for kubeapi-load-balancer/0 2025-04-18 04:56:17 INFO juju.worker.uniter uniter.go:361 hooks are retried true 2025-04-18 04:56:18 DEBUG juju.worker.uniter.remotestate watcher.go:623 got update status interval change for kubeapi-load-balancer/0: ok=true 2025-04-18 04:56:18 DEBUG juju.worker.uniter.remotestate watcher.go:613 got storage change for kubeapi-load-balancer/0: [] ok=true 2025-04-18 04:56:18 DEBUG juju.worker.uniter.remotestate watcher.go:574 got address change for kubeapi-load-balancer/0: ok=true, hashes=[2a050008c5cbaebedee830bac87a4c0144d0a6be438c83a6b8ebefdc74bb2b13] 2025-04-18 04:56:18 DEBUG juju.worker.uniter.remotestate watcher.go:603 got relations change for kubeapi-load-balancer/0: ok=true 2025-04-18 04:56:18 DEBUG juju.worker.uniter.remotestate watcher.go:595 got action change for kubeapi-load-balancer/0: [] ok=true 2025-04-18 04:56:18 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for kubeapi-load-balancer/0: ok=true 2025-04-18 04:56:18 DEBUG juju.worker.uniter.remotestate watcher.go:542 got config change for kubeapi-load-balancer/0: ok=true, hashes=[12fc74c30f7cef5a9d6d6ff7e11923d21284ce06f81915ae53af1465c0e4d873] 2025-04-18 04:56:18 DEBUG juju.worker.uniter.remotestate watcher.go:553 got trust config change for kubeapi-load-balancer/0: ok=true, hashes=[150f1995470e763f3e7f15a35bfa1cadcab7c5725810c3259886c7b8a418e71c] 2025-04-18 04:56:18 DEBUG juju.worker.uniter.remotestate watcher.go:564 got upgrade series change 2025-04-18 04:56:18 DEBUG juju.worker.uniter.remotestate watcher.go:714 no upgrade series in progress, reinitializing local upgrade series state 2025-04-18 04:56:18 DEBUG juju.worker.uniter.remotestate watcher.go:489 got unit change for kubeapi-load-balancer/0 2025-04-18 04:56:18 DEBUG juju.worker.uniter.remotestate watcher.go:499 got application change for kubeapi-load-balancer/0 2025-04-18 04:56:18 INFO juju.worker.uniter.storage resolver.go:126 initial storage attachments ready 2025-04-18 04:56:18 INFO juju.worker.uniter resolver.go:159 found queued "install" hook 2025-04-18 04:56:18 DEBUG juju.worker.uniter.operation executor.go:85 running operation run install hook for kubeapi-load-balancer/0 2025-04-18 04:56:18 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for kubeapi-load-balancer/0 uniter (run install hook) 2025-04-18 04:57:02 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for kubeapi-load-balancer/0 uniter (run install hook) 2025-04-18 04:57:02 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run install hook" for kubeapi-load-balancer/0 2025-04-18 04:57:02 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run install hook" for kubeapi-load-balancer/0 2025-04-18 04:57:02 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running install hook 2025-04-18 04:57:02 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-kubeapi-load-balancer-0/agent.socket } 2025-04-18 04:57:02 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Reading package lists... 2025-04-18 04:57:02 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Building dependency tree... 2025-04-18 04:57:02 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Reading state information... 2025-04-18 04:57:02 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 python3-dev is already the newest version (3.8.2-0ubuntu2). 2025-04-18 04:57:02 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 python3-setuptools is already the newest version (45.2.0-1ubuntu0.2). 2025-04-18 04:57:02 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 python3-yaml is already the newest version (5.3.1-1ubuntu0.1). 2025-04-18 04:57:02 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 python3-pip is already the newest version (20.0.2-5ubuntu1.11). 2025-04-18 04:57:02 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 python3-wheel is already the newest version (0.34.2-1ubuntu0.1). 2025-04-18 04:57:02 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 build-essential is already the newest version (12.8ubuntu1.1). 2025-04-18 04:57:02 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 0 upgraded, 0 newly installed, 0 to remove and 10 not upgraded. 2025-04-18 04:57:02 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Reading package lists... 2025-04-18 04:57:03 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Building dependency tree... 2025-04-18 04:57:03 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Reading state information... 2025-04-18 04:57:03 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 0 upgraded, 0 newly installed, 0 to remove and 10 not upgraded. 2025-04-18 04:57:03 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Reading package lists... 2025-04-18 04:57:03 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Building dependency tree... 2025-04-18 04:57:03 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Reading state information... 2025-04-18 04:57:03 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 virtualenv is already the newest version (20.0.17-1ubuntu0.4). 2025-04-18 04:57:03 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 0 upgraded, 0 newly installed, 0 to remove and 10 not upgraded. 2025-04-18 04:57:04 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 created virtual environment CPython3.8.10.final.0-64 in 81ms 2025-04-18 04:57:04 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 creator CPython3Posix(dest=/var/lib/juju/agents/unit-kubeapi-load-balancer-0/.venv, clear=False, global=False) 2025-04-18 04:57:04 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 seeder FromAppData(download=False, pip=latest, setuptools=latest, wheel=latest, pkg_resources=latest, via=copy, app_data_dir=/root/.local/share/virtualenv/seed-app-data/v1.0.1.debian.1) 2025-04-18 04:57:04 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 activators BashActivator,CShellActivator,FishActivator,PowerShellActivator,PythonActivator,XonshActivator 2025-04-18 04:57:04 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for kubeapi-load-balancer/0 : {12 {map[easyrsa/0:{0}] map[] []}} 2025-04-18 04:57:05 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Looking in links: wheelhouse 2025-04-18 04:57:05 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Requirement already up-to-date: pip in /var/lib/juju/agents/unit-kubeapi-load-balancer-0/.venv/lib/python3.8/site-packages (20.0.2) 2025-04-18 04:57:06 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Looking in links: wheelhouse 2025-04-18 04:57:06 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Requirement already up-to-date: setuptools in /var/lib/juju/agents/unit-kubeapi-load-balancer-0/.venv/lib/python3.8/site-packages (44.0.0) 2025-04-18 04:57:07 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Looking in links: wheelhouse 2025-04-18 04:57:07 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Processing ./wheelhouse/setuptools_scm-1.17.0.tar.gz 2025-04-18 04:57:08 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Building wheels for collected packages: setuptools-scm 2025-04-18 04:57:08 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Building wheel for setuptools-scm (setup.py): started 2025-04-18 04:57:08 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Building wheel for setuptools-scm (setup.py): finished with status 'done' 2025-04-18 04:57:08 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Created wheel for setuptools-scm: filename=setuptools_scm-1.17.0-py2.py3-none-any.whl size=17696 sha256=c8776154d93549efaa2a0fec9c53a28b97476149d22a696d32c9c93f33390216 2025-04-18 04:57:08 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Stored in directory: /root/.cache/pip/wheels/1a/e3/20/9813490b9032e681a59835d252a5e73cf56c15f4e75745c2ea 2025-04-18 04:57:08 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Successfully built setuptools-scm 2025-04-18 04:57:08 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Installing collected packages: setuptools-scm 2025-04-18 04:57:08 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Successfully installed setuptools-scm-1.17.0 2025-04-18 04:57:09 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Looking in links: wheelhouse 2025-04-18 04:57:09 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Processing ./wheelhouse/MarkupSafe-2.0.1.tar.gz 2025-04-18 04:57:09 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Processing ./wheelhouse/wheel-0.33.6.tar.gz 2025-04-18 04:57:09 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Building wheels for collected packages: MarkupSafe, wheel 2025-04-18 04:57:09 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Building wheel for MarkupSafe (setup.py): started 2025-04-18 04:57:09 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Building wheel for MarkupSafe (setup.py): finished with status 'done' 2025-04-18 04:57:09 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Created wheel for MarkupSafe: filename=MarkupSafe-2.0.1-cp38-cp38-linux_x86_64.whl size=30815 sha256=7188b5ae2b261e629cfd7beab5c861e161530c321777da3730028f3c8c87f421 2025-04-18 04:57:09 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-r05psfce/wheels/1d/aa/0c/91bee1f1fa484023111160669fd8175bbe13d89e9a0ad5fc53 2025-04-18 04:57:09 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Building wheel for wheel (setup.py): started 2025-04-18 04:57:10 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Building wheel for wheel (setup.py): finished with status 'done' 2025-04-18 04:57:10 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Created wheel for wheel: filename=wheel-0.33.6-py2.py3-none-any.whl size=21555 sha256=08e0852870d44408aba169c9bee19efa5f2dbd2921881f084e90b024f59fed8b 2025-04-18 04:57:10 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-r05psfce/wheels/ca/93/8c/d4a29a7c11e02122a600e627f92718c15b8777774a780e9a61 2025-04-18 04:57:10 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Successfully built MarkupSafe wheel 2025-04-18 04:57:10 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Installing collected packages: MarkupSafe, wheel 2025-04-18 04:57:10 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Attempting uninstall: wheel 2025-04-18 04:57:10 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Found existing installation: wheel 0.34.2 2025-04-18 04:57:10 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Uninstalling wheel-0.34.2: 2025-04-18 04:57:10 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Successfully uninstalled wheel-0.34.2 2025-04-18 04:57:10 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Successfully installed MarkupSafe-2.0.1 wheel-0.33.6 2025-04-18 04:57:11 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Looking in links: wheelhouse 2025-04-18 04:57:11 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Processing ./wheelhouse/pyaml-21.10.1.tar.gz 2025-04-18 04:57:11 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Processing ./wheelhouse/netaddr-0.7.19.tar.gz 2025-04-18 04:57:11 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Processing ./wheelhouse/charmhelpers-1.2.1.tar.gz 2025-04-18 04:57:13 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Processing ./wheelhouse/ops-1.5.5.tar.gz 2025-04-18 04:57:13 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Installing build dependencies: started 2025-04-18 04:57:15 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Installing build dependencies: finished with status 'done' 2025-04-18 04:57:15 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Getting requirements to build wheel: started 2025-04-18 04:57:15 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Getting requirements to build wheel: finished with status 'done' 2025-04-18 04:57:15 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Preparing wheel metadata: started 2025-04-18 04:57:16 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Preparing wheel metadata: finished with status 'done' 2025-04-18 04:57:16 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Processing ./wheelhouse/toml-0.10.2.tar.gz 2025-04-18 04:57:16 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Processing ./wheelhouse/pbr-5.11.1.tar.gz 2025-04-18 04:57:16 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Processing ./wheelhouse/marshmallow-3.14.1.tar.gz 2025-04-18 04:57:16 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Installing build dependencies: started 2025-04-18 04:57:17 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Installing build dependencies: finished with status 'done' 2025-04-18 04:57:17 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Getting requirements to build wheel: started 2025-04-18 04:57:18 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Getting requirements to build wheel: finished with status 'done' 2025-04-18 04:57:18 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Preparing wheel metadata: started 2025-04-18 04:57:18 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Preparing wheel metadata: finished with status 'done' 2025-04-18 04:57:18 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Processing ./wheelhouse/cached-property-1.5.2.tar.gz 2025-04-18 04:57:18 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Processing ./wheelhouse/marshmallow-enum-1.5.1.tar.gz 2025-04-18 04:57:18 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Processing ./wheelhouse/loadbalancer_interface-1.2.0.tar.gz 2025-04-18 04:57:18 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Processing ./wheelhouse/PyYAML-5.3.1.tar.gz 2025-04-18 04:57:19 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Processing ./wheelhouse/Jinja2-3.0.3.tar.gz 2025-04-18 04:57:19 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Processing ./wheelhouse/ops_reactive_interface-1.0.1.tar.gz 2025-04-18 04:57:19 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Processing ./wheelhouse/charms.reactive-1.5.2.tar.gz 2025-04-18 04:57:19 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Processing ./wheelhouse/MarkupSafe-2.0.1.tar.gz 2025-04-18 04:57:19 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Building wheels for collected packages: pyaml, netaddr, charmhelpers, ops, toml, pbr, marshmallow, cached-property, marshmallow-enum, loadbalancer-interface, PyYAML, Jinja2, ops-reactive-interface, charms.reactive, MarkupSafe 2025-04-18 04:57:19 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Building wheel for pyaml (setup.py): started 2025-04-18 04:57:20 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Building wheel for pyaml (setup.py): finished with status 'done' 2025-04-18 04:57:20 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Created wheel for pyaml: filename=pyaml-21.10.1-py2.py3-none-any.whl size=17626 sha256=21dc5816a3a12b4e058fec645656c8d3079b5551d6701d82f3731dc7d6ab19a0 2025-04-18 04:57:20 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-wtpgw0rs/wheels/09/b1/57/549524577380328a7644a4e6c9da4ee9775007f97dfba086f0 2025-04-18 04:57:20 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Building wheel for netaddr (setup.py): started 2025-04-18 04:57:20 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Building wheel for netaddr (setup.py): finished with status 'done' 2025-04-18 04:57:20 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Created wheel for netaddr: filename=netaddr-0.7.19-py3-none-any.whl size=1627892 sha256=c07fd18fdbe110e2cde29bb8584c1ea5246cbf08a2ef4313204410cf4c394114 2025-04-18 04:57:20 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-wtpgw0rs/wheels/36/31/c5/4ce2eedf4f1ce180ccd89414c4b657186b1d6bd3c38aef006a 2025-04-18 04:57:20 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Building wheel for charmhelpers (setup.py): started 2025-04-18 04:57:21 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Building wheel for charmhelpers (setup.py): finished with status 'done' 2025-04-18 04:57:21 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Created wheel for charmhelpers: filename=charmhelpers-1.2.1-py3-none-any.whl size=411703 sha256=7c36448c0b90dfb4099cbcf75c32e455d21d01c0d99073c4e47fa83e9ac3404f 2025-04-18 04:57:21 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-wtpgw0rs/wheels/d7/7c/bf/c6933e5547343e3b51952d46762dbcafdef324f92ef6d00882 2025-04-18 04:57:21 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Building wheel for ops (PEP 517): started 2025-04-18 04:57:21 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Building wheel for ops (PEP 517): finished with status 'done' 2025-04-18 04:57:21 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Created wheel for ops: filename=ops-1.5.5-py3-none-any.whl size=159202 sha256=2bd756fc43195adfbd0042ec8cc6c7708de6a3116992204da371be32c820239a 2025-04-18 04:57:21 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-wtpgw0rs/wheels/2a/1b/9e/5337dda788fc9e8c5e13ab680acc2cdc29ea087531ba5ee02b 2025-04-18 04:57:21 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Building wheel for toml (setup.py): started 2025-04-18 04:57:21 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Building wheel for toml (setup.py): finished with status 'done' 2025-04-18 04:57:21 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Created wheel for toml: filename=toml-0.10.2-py2.py3-none-any.whl size=16587 sha256=2285fd2121d25c418ef0276b43dbf30b9516dd4f9dde661d12ae655e2c21007e 2025-04-18 04:57:21 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-wtpgw0rs/wheels/79/87/8c/eb2c7a25ed4821d1e38672eafd2316ccf39ff1c71da199bbb6 2025-04-18 04:57:21 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Building wheel for pbr (setup.py): started 2025-04-18 04:57:21 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Building wheel for pbr (setup.py): finished with status 'done' 2025-04-18 04:57:21 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Created wheel for pbr: filename=pbr-5.11.1-py2.py3-none-any.whl size=112680 sha256=760f1aa679c6b89d2b0166959f276964ec17eb14dff6ca63654af1ea6e05542e 2025-04-18 04:57:21 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-wtpgw0rs/wheels/24/11/93/eb71cb42b9bb677e209ba27012de0faacf261ed097c47ca988 2025-04-18 04:57:21 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Building wheel for marshmallow (PEP 517): started 2025-04-18 04:57:22 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Building wheel for marshmallow (PEP 517): finished with status 'done' 2025-04-18 04:57:22 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Created wheel for marshmallow: filename=marshmallow-3.14.1-py3-none-any.whl size=47572 sha256=561fe5c8db7d677a5594b5b60d3c780bd9f6eefcbe54d331b8f21375beb56c54 2025-04-18 04:57:22 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-wtpgw0rs/wheels/a6/b7/cd/14594ff8b08684a8f40e9d97b6fbedad63f33f00fa7cb6c7af 2025-04-18 04:57:22 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Building wheel for cached-property (setup.py): started 2025-04-18 04:57:22 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Building wheel for cached-property (setup.py): finished with status 'done' 2025-04-18 04:57:22 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Created wheel for cached-property: filename=cached_property-1.5.2-py2.py3-none-any.whl size=7574 sha256=4e61bb7d2ce17df401f38fb9cab09f48cdc7dc4768f29427c14a5fbef333700b 2025-04-18 04:57:22 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-wtpgw0rs/wheels/35/c0/49/051acf0ec4af55a2852a91cb5c6eebe5784e1f3165be700e84 2025-04-18 04:57:22 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Building wheel for marshmallow-enum (setup.py): started 2025-04-18 04:57:22 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Building wheel for marshmallow-enum (setup.py): finished with status 'done' 2025-04-18 04:57:22 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Created wheel for marshmallow-enum: filename=marshmallow_enum-1.5.1-py2.py3-none-any.whl size=4186 sha256=bd7e27cb76660b3786e970578d5758daa64bc9cd1ac8c6b8b8bfd2042ba971b4 2025-04-18 04:57:22 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-wtpgw0rs/wheels/47/35/1c/81e1205b3fb39abc226e4eab1873acb2adefb0c29d3f38ffba 2025-04-18 04:57:22 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Building wheel for loadbalancer-interface (setup.py): started 2025-04-18 04:57:22 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Building wheel for loadbalancer-interface (setup.py): finished with status 'done' 2025-04-18 04:57:22 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Created wheel for loadbalancer-interface: filename=loadbalancer_interface-1.2.0-py3-none-any.whl size=24384 sha256=400f4299e780cb06a30329aeae88fc5a408a98bad5cc98a009a8b6ae363a85e4 2025-04-18 04:57:22 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-wtpgw0rs/wheels/5b/5b/21/d4f4dbf2585212230fd91e083e02819307e72ac08c601cca60 2025-04-18 04:57:22 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Building wheel for PyYAML (setup.py): started 2025-04-18 04:57:22 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Building wheel for PyYAML (setup.py): finished with status 'done' 2025-04-18 04:57:22 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Created wheel for PyYAML: filename=PyYAML-5.3.1-cp38-cp38-linux_x86_64.whl size=44617 sha256=fe1829733881690c82a9095dc84841da2c130acfd0cae32ef895f8fc60c1bd99 2025-04-18 04:57:22 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-wtpgw0rs/wheels/64/c4/e6/388b15f83607de7aec92e573647c97a300b038faf081645b57 2025-04-18 04:57:22 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Building wheel for Jinja2 (setup.py): started 2025-04-18 04:57:23 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Building wheel for Jinja2 (setup.py): finished with status 'done' 2025-04-18 04:57:23 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Created wheel for Jinja2: filename=Jinja2-3.0.3-py3-none-any.whl size=133612 sha256=44fa5f7ee78cb79f2d087b9f17c8fba939a2556e2c8254cb8537195367688cb4 2025-04-18 04:57:23 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-wtpgw0rs/wheels/e5/62/73/c8391f9eec69050ed1cc26d2d51e0b74f0df3f0eeae96cb9ce 2025-04-18 04:57:23 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Building wheel for ops-reactive-interface (setup.py): started 2025-04-18 04:57:23 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Building wheel for ops-reactive-interface (setup.py): finished with status 'done' 2025-04-18 04:57:23 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Created wheel for ops-reactive-interface: filename=ops_reactive_interface-1.0.1-py3-none-any.whl size=4172 sha256=6293be66b4cc97ef876a8bde114ae7df010d3556ec5528edf766210fa84b3c1f 2025-04-18 04:57:23 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-wtpgw0rs/wheels/27/16/8b/475587258a77f07ea7f8bbeff29be852e2ca92711c6b280b43 2025-04-18 04:57:23 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Building wheel for charms.reactive (setup.py): started 2025-04-18 04:57:23 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Building wheel for charms.reactive (setup.py): finished with status 'done' 2025-04-18 04:57:23 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Created wheel for charms.reactive: filename=charms.reactive-1.5.2-py3-none-any.whl size=48373 sha256=4391e4820b48c225f59035012a36c713eea0f3658082399257f0114328beaf93 2025-04-18 04:57:23 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-wtpgw0rs/wheels/be/aa/74/63feccd1cc3014754b29dccfa43ed0e34a2dcc8041705c95fa 2025-04-18 04:57:23 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Building wheel for MarkupSafe (setup.py): started 2025-04-18 04:57:24 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Building wheel for MarkupSafe (setup.py): finished with status 'done' 2025-04-18 04:57:24 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Created wheel for MarkupSafe: filename=MarkupSafe-2.0.1-cp38-cp38-linux_x86_64.whl size=30809 sha256=f0d71da24baca28a7cc6cbd3e5a7d099a60074875c6589902a7dc5ffc9ac012d 2025-04-18 04:57:24 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-wtpgw0rs/wheels/1d/aa/0c/91bee1f1fa484023111160669fd8175bbe13d89e9a0ad5fc53 2025-04-18 04:57:24 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Successfully built pyaml netaddr charmhelpers ops toml pbr marshmallow cached-property marshmallow-enum loadbalancer-interface PyYAML Jinja2 ops-reactive-interface charms.reactive MarkupSafe 2025-04-18 04:57:24 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Installing collected packages: PyYAML, pyaml, netaddr, MarkupSafe, Jinja2, pbr, charmhelpers, ops, toml, marshmallow, cached-property, marshmallow-enum, ops-reactive-interface, loadbalancer-interface, charms.reactive 2025-04-18 04:57:24 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Attempting uninstall: MarkupSafe 2025-04-18 04:57:24 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Found existing installation: MarkupSafe 2.0.1 2025-04-18 04:57:24 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Uninstalling MarkupSafe-2.0.1: 2025-04-18 04:57:24 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Successfully uninstalled MarkupSafe-2.0.1 2025-04-18 04:57:24 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Successfully installed Jinja2-3.0.3 MarkupSafe-2.0.1 PyYAML-5.3.1 cached-property-1.5.2 charmhelpers-1.2.1 charms.reactive-1.5.2 loadbalancer-interface-1.2.0 marshmallow-3.14.1 marshmallow-enum-1.5.1 netaddr-0.7.19 ops-1.5.5 ops-reactive-interface-1.0.1 pbr-5.11.1 pyaml-21.10.1 toml-0.10.2 2025-04-18 04:57:25 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Reactive main running for hook install 2025-04-18 04:57:25 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.changed 2025-04-18 04:57:25 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.changed.nagios_context 2025-04-18 04:57:25 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.set.nagios_context 2025-04-18 04:57:25 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.nagios_context 2025-04-18 04:57:25 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.changed.nagios_servicegroups 2025-04-18 04:57:25 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2025-04-18 04:57:25 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.changed.extra_packages 2025-04-18 04:57:25 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.extra_packages 2025-04-18 04:57:25 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.changed.package_status 2025-04-18 04:57:25 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.set.package_status 2025-04-18 04:57:25 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.package_status 2025-04-18 04:57:25 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.changed.install_sources 2025-04-18 04:57:25 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.install_sources 2025-04-18 04:57:25 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.changed.install_keys 2025-04-18 04:57:25 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.install_keys 2025-04-18 04:57:25 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.changed.port 2025-04-18 04:57:25 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.set.port 2025-04-18 04:57:25 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.port 2025-04-18 04:57:25 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.changed.host 2025-04-18 04:57:25 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.set.host 2025-04-18 04:57:25 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.host 2025-04-18 04:57:25 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.changed.ha-cluster-vip 2025-04-18 04:57:25 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.ha-cluster-vip 2025-04-18 04:57:25 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.changed.ha-cluster-dns 2025-04-18 04:57:25 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.ha-cluster-dns 2025-04-18 04:57:25 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.changed.extra_sans 2025-04-18 04:57:25 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.extra_sans 2025-04-18 04:57:25 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.changed.proxy_read_timeout 2025-04-18 04:57:25 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.set.proxy_read_timeout 2025-04-18 04:57:25 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.proxy_read_timeout 2025-04-18 04:57:25 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.changed.loadbalancer-ips 2025-04-18 04:57:25 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.loadbalancer-ips 2025-04-18 04:57:25 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Initializing Leadership Layer (is leader) 2025-04-18 04:57:25 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag leadership.is_leader 2025-04-18 04:57:25 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Initializing Apt Layer 2025-04-18 04:57:25 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag apt.needs_update 2025-04-18 04:57:25 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag apt.queued_installs 2025-04-18 04:57:25 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer> tracer: starting handler dispatch, 35 flags set tracer: set flag apt.needs_update tracer: set flag apt.queued_installs tracer: set flag config.changed tracer: set flag config.changed.extra_packages tracer: set flag config.changed.extra_sans tracer: set flag config.changed.ha-cluster-dns tracer: set flag config.changed.ha-cluster-vip tracer: set flag config.changed.host tracer: set flag config.changed.install_keys tracer: set flag config.changed.install_sources tracer: set flag config.changed.loadbalancer-ips tracer: set flag config.changed.nagios_context tracer: set flag config.changed.nagios_servicegroups tracer: set flag config.changed.package_status tracer: set flag config.changed.port tracer: set flag config.changed.proxy_read_timeout tracer: set flag config.default.extra_packages tracer: set flag config.default.extra_sans tracer: set flag config.default.ha-cluster-dns tracer: set flag config.default.ha-cluster-vip tracer: set flag config.default.host tracer: set flag config.default.install_keys tracer: set flag config.default.install_sources tracer: set flag config.default.loadbalancer-ips tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.package_status tracer: set flag config.default.port tracer: set flag config.default.proxy_read_timeout tracer: set flag config.set.host tracer: set flag config.set.nagios_context tracer: set flag config.set.package_status tracer: set flag config.set.port tracer: set flag config.set.proxy_read_timeout tracer: set flag leadership.is_leader 2025-04-18 04:57:25 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2025-04-18 04:57:25 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer> tracer: main dispatch loop, 5 handlers queued tracer: ++ queue handler hooks/relations/http/provides.py:15:broken:website tracer: ++ queue handler hooks/relations/http/requires.py:15:broken:apiserver tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/apt.py:39:update tracer: ++ queue handler reactive/load_balancer.py:130:close_old_port 2025-04-18 04:57:25 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/apt.py:39:update 2025-04-18 04:57:25 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 status-set: maintenance: Updating apt cache 2025-04-18 04:57:25 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Hit:1 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal InRelease 2025-04-18 04:57:25 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Hit:2 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security InRelease 2025-04-18 04:57:25 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Hit:3 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-updates InRelease 2025-04-18 04:57:25 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Hit:4 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-proposed InRelease 2025-04-18 04:57:25 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Hit:5 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-backports InRelease 2025-04-18 04:57:27 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Reading package lists... 2025-04-18 04:57:27 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer> tracer: cleared flag apt.needs_update tracer: ++ queue handler reactive/apt.py:44:install_queued tracer: -- dequeue handler reactive/apt.py:39:update 2025-04-18 04:57:27 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/load_balancer.py:130:close_old_port 2025-04-18 04:57:27 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/http/requires.py:15:broken:apiserver 2025-04-18 04:57:27 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/http/provides.py:15:broken:website 2025-04-18 04:57:27 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2025-04-18 04:57:27 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/apt.py:44:install_queued 2025-04-18 04:57:27 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 status-set: maintenance: Installing nginx-full 2025-04-18 04:57:27 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Installing ['nginx-full'] with options: ['--option=Dpkg::Options::=--force-confold'] 2025-04-18 04:57:27 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Reading package lists... 2025-04-18 04:57:27 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Building dependency tree... 2025-04-18 04:57:27 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Reading state information... 2025-04-18 04:57:27 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 The following additional packages will be installed: 2025-04-18 04:57:27 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 fontconfig-config fonts-dejavu-core geoip-database libfontconfig1 libgd3 2025-04-18 04:57:27 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 libgeoip1 libjbig0 libjpeg-turbo8 libjpeg8 libnginx-mod-http-auth-pam 2025-04-18 04:57:27 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 libnginx-mod-http-dav-ext libnginx-mod-http-echo libnginx-mod-http-geoip 2025-04-18 04:57:27 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 libnginx-mod-http-geoip2 libnginx-mod-http-image-filter 2025-04-18 04:57:27 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 libnginx-mod-http-subs-filter libnginx-mod-http-upstream-fair 2025-04-18 04:57:27 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 libnginx-mod-http-xslt-filter libnginx-mod-mail libnginx-mod-stream libtiff5 2025-04-18 04:57:27 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 libwebp6 libxpm4 nginx-common 2025-04-18 04:57:27 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Suggested packages: 2025-04-18 04:57:27 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 libgd-tools geoip-bin fcgiwrap nginx-doc ssl-cert 2025-04-18 04:57:27 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 The following NEW packages will be installed: 2025-04-18 04:57:27 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 fontconfig-config fonts-dejavu-core geoip-database libfontconfig1 libgd3 2025-04-18 04:57:27 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 libgeoip1 libjbig0 libjpeg-turbo8 libjpeg8 libnginx-mod-http-auth-pam 2025-04-18 04:57:27 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 libnginx-mod-http-dav-ext libnginx-mod-http-echo libnginx-mod-http-geoip 2025-04-18 04:57:27 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 libnginx-mod-http-geoip2 libnginx-mod-http-image-filter 2025-04-18 04:57:27 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 libnginx-mod-http-subs-filter libnginx-mod-http-upstream-fair 2025-04-18 04:57:27 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 libnginx-mod-http-xslt-filter libnginx-mod-mail libnginx-mod-stream libtiff5 2025-04-18 04:57:27 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 libwebp6 libxpm4 nginx-common nginx-full 2025-04-18 04:57:27 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 0 upgraded, 25 newly installed, 0 to remove and 10 not upgraded. 2025-04-18 04:57:27 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Need to get 5627 kB of archives. 2025-04-18 04:57:27 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 After this operation, 19.0 MB of additional disk space will be used. 2025-04-18 04:57:27 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Get:1 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal/main amd64 fonts-dejavu-core all 2.37-1 [1041 kB] 2025-04-18 04:57:27 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Get:2 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal/main amd64 fontconfig-config all 2.13.1-2ubuntu3 [28.8 kB] 2025-04-18 04:57:27 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Get:3 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal/universe amd64 geoip-database all 20191224-2 [3029 kB] 2025-04-18 04:57:27 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Get:4 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal/main amd64 libfontconfig1 amd64 2.13.1-2ubuntu3 [114 kB] 2025-04-18 04:57:27 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Get:5 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security/main amd64 libjpeg-turbo8 amd64 2.0.3-0ubuntu1.20.04.3 [118 kB] 2025-04-18 04:57:27 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Get:6 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal/main amd64 libjpeg8 amd64 8c-2ubuntu8 [2194 B] 2025-04-18 04:57:27 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Get:7 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security/main amd64 libjbig0 amd64 2.1-3.1ubuntu0.20.04.1 [27.3 kB] 2025-04-18 04:57:27 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Get:8 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security/main amd64 libwebp6 amd64 0.6.1-2ubuntu0.20.04.3 [185 kB] 2025-04-18 04:57:27 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Get:9 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security/main amd64 libtiff5 amd64 4.1.0+git191117-2ubuntu0.20.04.14 [164 kB] 2025-04-18 04:57:27 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Get:10 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security/main amd64 libxpm4 amd64 1:3.5.12-1ubuntu0.20.04.2 [34.9 kB] 2025-04-18 04:57:27 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Get:11 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security/main amd64 libgd3 amd64 2.2.5-5.2ubuntu2.4 [118 kB] 2025-04-18 04:57:27 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Get:12 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal/universe amd64 libgeoip1 amd64 1.6.12-6build1 [70.5 kB] 2025-04-18 04:57:27 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Get:13 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security/main amd64 nginx-common all 1.18.0-0ubuntu1.7 [37.8 kB] 2025-04-18 04:57:27 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Get:14 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security/universe amd64 libnginx-mod-http-auth-pam amd64 1.18.0-0ubuntu1.7 [10.0 kB] 2025-04-18 04:57:27 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Get:15 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security/universe amd64 libnginx-mod-http-dav-ext amd64 1.18.0-0ubuntu1.7 [11.9 kB] 2025-04-18 04:57:27 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Get:16 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security/universe amd64 libnginx-mod-http-echo amd64 1.18.0-0ubuntu1.7 [21.5 kB] 2025-04-18 04:57:27 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Get:17 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security/universe amd64 libnginx-mod-http-geoip amd64 1.18.0-0ubuntu1.7 [11.3 kB] 2025-04-18 04:57:27 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Get:18 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security/universe amd64 libnginx-mod-http-geoip2 amd64 1.18.0-0ubuntu1.7 [11.8 kB] 2025-04-18 04:57:27 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Get:19 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security/main amd64 libnginx-mod-http-image-filter amd64 1.18.0-0ubuntu1.7 [14.8 kB] 2025-04-18 04:57:27 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Get:20 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security/universe amd64 libnginx-mod-http-subs-filter amd64 1.18.0-0ubuntu1.7 [13.1 kB] 2025-04-18 04:57:27 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Get:21 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security/universe amd64 libnginx-mod-http-upstream-fair amd64 1.18.0-0ubuntu1.7 [13.3 kB] 2025-04-18 04:57:27 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Get:22 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security/main amd64 libnginx-mod-http-xslt-filter amd64 1.18.0-0ubuntu1.7 [13.1 kB] 2025-04-18 04:57:27 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Get:23 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security/main amd64 libnginx-mod-mail amd64 1.18.0-0ubuntu1.7 [43.0 kB] 2025-04-18 04:57:27 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Get:24 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security/main amd64 libnginx-mod-stream amd64 1.18.0-0ubuntu1.7 [67.3 kB] 2025-04-18 04:57:27 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Get:25 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security/universe amd64 nginx-full amd64 1.18.0-0ubuntu1.7 [425 kB] 2025-04-18 04:57:28 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Preconfiguring packages ... 2025-04-18 04:57:28 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Fetched 5627 kB in 0s (60.9 MB/s) 2025-04-18 04:57:28 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Selecting previously unselected package fonts-dejavu-core. 2025-04-18 04:57:28 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 70995 files and directories currently installed.) 2025-04-18 04:57:28 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Preparing to unpack .../00-fonts-dejavu-core_2.37-1_all.deb ... 2025-04-18 04:57:28 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Unpacking fonts-dejavu-core (2.37-1) ... 2025-04-18 04:57:28 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Selecting previously unselected package fontconfig-config. 2025-04-18 04:57:28 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Preparing to unpack .../01-fontconfig-config_2.13.1-2ubuntu3_all.deb ... 2025-04-18 04:57:28 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Unpacking fontconfig-config (2.13.1-2ubuntu3) ... 2025-04-18 04:57:28 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Selecting previously unselected package geoip-database. 2025-04-18 04:57:28 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Preparing to unpack .../02-geoip-database_20191224-2_all.deb ... 2025-04-18 04:57:28 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Unpacking geoip-database (20191224-2) ... 2025-04-18 04:57:28 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Selecting previously unselected package libfontconfig1:amd64. 2025-04-18 04:57:28 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Preparing to unpack .../03-libfontconfig1_2.13.1-2ubuntu3_amd64.deb ... 2025-04-18 04:57:28 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Unpacking libfontconfig1:amd64 (2.13.1-2ubuntu3) ... 2025-04-18 04:57:28 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Selecting previously unselected package libjpeg-turbo8:amd64. 2025-04-18 04:57:28 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Preparing to unpack .../04-libjpeg-turbo8_2.0.3-0ubuntu1.20.04.3_amd64.deb ... 2025-04-18 04:57:28 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Unpacking libjpeg-turbo8:amd64 (2.0.3-0ubuntu1.20.04.3) ... 2025-04-18 04:57:29 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Selecting previously unselected package libjpeg8:amd64. 2025-04-18 04:57:29 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Preparing to unpack .../05-libjpeg8_8c-2ubuntu8_amd64.deb ... 2025-04-18 04:57:29 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Unpacking libjpeg8:amd64 (8c-2ubuntu8) ... 2025-04-18 04:57:29 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Selecting previously unselected package libjbig0:amd64. 2025-04-18 04:57:29 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Preparing to unpack .../06-libjbig0_2.1-3.1ubuntu0.20.04.1_amd64.deb ... 2025-04-18 04:57:29 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Unpacking libjbig0:amd64 (2.1-3.1ubuntu0.20.04.1) ... 2025-04-18 04:57:29 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Selecting previously unselected package libwebp6:amd64. 2025-04-18 04:57:29 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Preparing to unpack .../07-libwebp6_0.6.1-2ubuntu0.20.04.3_amd64.deb ... 2025-04-18 04:57:29 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Unpacking libwebp6:amd64 (0.6.1-2ubuntu0.20.04.3) ... 2025-04-18 04:57:29 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Selecting previously unselected package libtiff5:amd64. 2025-04-18 04:57:29 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Preparing to unpack .../08-libtiff5_4.1.0+git191117-2ubuntu0.20.04.14_amd64.deb ... 2025-04-18 04:57:29 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Unpacking libtiff5:amd64 (4.1.0+git191117-2ubuntu0.20.04.14) ... 2025-04-18 04:57:29 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Selecting previously unselected package libxpm4:amd64. 2025-04-18 04:57:29 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Preparing to unpack .../09-libxpm4_1%3a3.5.12-1ubuntu0.20.04.2_amd64.deb ... 2025-04-18 04:57:29 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Unpacking libxpm4:amd64 (1:3.5.12-1ubuntu0.20.04.2) ... 2025-04-18 04:57:29 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Selecting previously unselected package libgd3:amd64. 2025-04-18 04:57:29 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Preparing to unpack .../10-libgd3_2.2.5-5.2ubuntu2.4_amd64.deb ... 2025-04-18 04:57:29 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Unpacking libgd3:amd64 (2.2.5-5.2ubuntu2.4) ... 2025-04-18 04:57:29 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Selecting previously unselected package libgeoip1:amd64. 2025-04-18 04:57:29 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Preparing to unpack .../11-libgeoip1_1.6.12-6build1_amd64.deb ... 2025-04-18 04:57:29 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Unpacking libgeoip1:amd64 (1.6.12-6build1) ... 2025-04-18 04:57:29 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Selecting previously unselected package nginx-common. 2025-04-18 04:57:29 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Preparing to unpack .../12-nginx-common_1.18.0-0ubuntu1.7_all.deb ... 2025-04-18 04:57:29 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Unpacking nginx-common (1.18.0-0ubuntu1.7) ... 2025-04-18 04:57:29 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Selecting previously unselected package libnginx-mod-http-auth-pam. 2025-04-18 04:57:29 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Preparing to unpack .../13-libnginx-mod-http-auth-pam_1.18.0-0ubuntu1.7_amd64.deb ... 2025-04-18 04:57:29 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Unpacking libnginx-mod-http-auth-pam (1.18.0-0ubuntu1.7) ... 2025-04-18 04:57:29 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Selecting previously unselected package libnginx-mod-http-dav-ext. 2025-04-18 04:57:29 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Preparing to unpack .../14-libnginx-mod-http-dav-ext_1.18.0-0ubuntu1.7_amd64.deb ... 2025-04-18 04:57:29 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Unpacking libnginx-mod-http-dav-ext (1.18.0-0ubuntu1.7) ... 2025-04-18 04:57:29 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Selecting previously unselected package libnginx-mod-http-echo. 2025-04-18 04:57:29 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Preparing to unpack .../15-libnginx-mod-http-echo_1.18.0-0ubuntu1.7_amd64.deb ... 2025-04-18 04:57:29 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Unpacking libnginx-mod-http-echo (1.18.0-0ubuntu1.7) ... 2025-04-18 04:57:29 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Selecting previously unselected package libnginx-mod-http-geoip. 2025-04-18 04:57:29 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Preparing to unpack .../16-libnginx-mod-http-geoip_1.18.0-0ubuntu1.7_amd64.deb ... 2025-04-18 04:57:29 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Unpacking libnginx-mod-http-geoip (1.18.0-0ubuntu1.7) ... 2025-04-18 04:57:29 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Selecting previously unselected package libnginx-mod-http-geoip2. 2025-04-18 04:57:29 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Preparing to unpack .../17-libnginx-mod-http-geoip2_1.18.0-0ubuntu1.7_amd64.deb ... 2025-04-18 04:57:29 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Unpacking libnginx-mod-http-geoip2 (1.18.0-0ubuntu1.7) ... 2025-04-18 04:57:29 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Selecting previously unselected package libnginx-mod-http-image-filter. 2025-04-18 04:57:29 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Preparing to unpack .../18-libnginx-mod-http-image-filter_1.18.0-0ubuntu1.7_amd64.deb ... 2025-04-18 04:57:29 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Unpacking libnginx-mod-http-image-filter (1.18.0-0ubuntu1.7) ... 2025-04-18 04:57:29 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Selecting previously unselected package libnginx-mod-http-subs-filter. 2025-04-18 04:57:29 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Preparing to unpack .../19-libnginx-mod-http-subs-filter_1.18.0-0ubuntu1.7_amd64.deb ... 2025-04-18 04:57:29 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Unpacking libnginx-mod-http-subs-filter (1.18.0-0ubuntu1.7) ... 2025-04-18 04:57:29 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Selecting previously unselected package libnginx-mod-http-upstream-fair. 2025-04-18 04:57:29 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Preparing to unpack .../20-libnginx-mod-http-upstream-fair_1.18.0-0ubuntu1.7_amd64.deb ... 2025-04-18 04:57:29 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Unpacking libnginx-mod-http-upstream-fair (1.18.0-0ubuntu1.7) ... 2025-04-18 04:57:29 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Selecting previously unselected package libnginx-mod-http-xslt-filter. 2025-04-18 04:57:29 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Preparing to unpack .../21-libnginx-mod-http-xslt-filter_1.18.0-0ubuntu1.7_amd64.deb ... 2025-04-18 04:57:29 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Unpacking libnginx-mod-http-xslt-filter (1.18.0-0ubuntu1.7) ... 2025-04-18 04:57:29 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Selecting previously unselected package libnginx-mod-mail. 2025-04-18 04:57:30 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Preparing to unpack .../22-libnginx-mod-mail_1.18.0-0ubuntu1.7_amd64.deb ... 2025-04-18 04:57:30 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Unpacking libnginx-mod-mail (1.18.0-0ubuntu1.7) ... 2025-04-18 04:57:30 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Selecting previously unselected package libnginx-mod-stream. 2025-04-18 04:57:30 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Preparing to unpack .../23-libnginx-mod-stream_1.18.0-0ubuntu1.7_amd64.deb ... 2025-04-18 04:57:30 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Unpacking libnginx-mod-stream (1.18.0-0ubuntu1.7) ... 2025-04-18 04:57:30 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Selecting previously unselected package nginx-full. 2025-04-18 04:57:30 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Preparing to unpack .../24-nginx-full_1.18.0-0ubuntu1.7_amd64.deb ... 2025-04-18 04:57:30 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Unpacking nginx-full (1.18.0-0ubuntu1.7) ... 2025-04-18 04:57:30 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Setting up libxpm4:amd64 (1:3.5.12-1ubuntu0.20.04.2) ... 2025-04-18 04:57:30 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Setting up nginx-common (1.18.0-0ubuntu1.7) ... 2025-04-18 04:57:30 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Created symlink /etc/systemd/system/multi-user.target.wants/nginx.service → /lib/systemd/system/nginx.service. 2025-04-18 04:57:31 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Setting up libjbig0:amd64 (2.1-3.1ubuntu0.20.04.1) ... 2025-04-18 04:57:31 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Setting up libnginx-mod-http-xslt-filter (1.18.0-0ubuntu1.7) ... 2025-04-18 04:57:31 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Setting up libnginx-mod-http-auth-pam (1.18.0-0ubuntu1.7) ... 2025-04-18 04:57:31 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Setting up libwebp6:amd64 (0.6.1-2ubuntu0.20.04.3) ... 2025-04-18 04:57:31 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Setting up fonts-dejavu-core (2.37-1) ... 2025-04-18 04:57:31 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Setting up libjpeg-turbo8:amd64 (2.0.3-0ubuntu1.20.04.3) ... 2025-04-18 04:57:31 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Setting up libnginx-mod-http-echo (1.18.0-0ubuntu1.7) ... 2025-04-18 04:57:31 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Setting up libnginx-mod-http-subs-filter (1.18.0-0ubuntu1.7) ... 2025-04-18 04:57:31 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Setting up libgeoip1:amd64 (1.6.12-6build1) ... 2025-04-18 04:57:31 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Setting up geoip-database (20191224-2) ... 2025-04-18 04:57:31 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Setting up libnginx-mod-http-geoip2 (1.18.0-0ubuntu1.7) ... 2025-04-18 04:57:31 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Setting up libjpeg8:amd64 (8c-2ubuntu8) ... 2025-04-18 04:57:31 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Setting up libnginx-mod-http-dav-ext (1.18.0-0ubuntu1.7) ... 2025-04-18 04:57:31 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Setting up libnginx-mod-mail (1.18.0-0ubuntu1.7) ... 2025-04-18 04:57:31 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Setting up fontconfig-config (2.13.1-2ubuntu3) ... 2025-04-18 04:57:31 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Setting up libnginx-mod-stream (1.18.0-0ubuntu1.7) ... 2025-04-18 04:57:31 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Setting up libnginx-mod-http-upstream-fair (1.18.0-0ubuntu1.7) ... 2025-04-18 04:57:31 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Setting up libnginx-mod-http-geoip (1.18.0-0ubuntu1.7) ... 2025-04-18 04:57:31 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Setting up libtiff5:amd64 (4.1.0+git191117-2ubuntu0.20.04.14) ... 2025-04-18 04:57:31 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Setting up libfontconfig1:amd64 (2.13.1-2ubuntu3) ... 2025-04-18 04:57:31 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Setting up libgd3:amd64 (2.2.5-5.2ubuntu2.4) ... 2025-04-18 04:57:31 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Setting up libnginx-mod-http-image-filter (1.18.0-0ubuntu1.7) ... 2025-04-18 04:57:31 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Setting up nginx-full (1.18.0-0ubuntu1.7) ... 2025-04-18 04:57:32 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Processing triggers for libc-bin (2.31-0ubuntu9.17) ... 2025-04-18 04:57:32 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Processing triggers for ufw (0.36-6ubuntu1.1) ... 2025-04-18 04:57:32 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Processing triggers for systemd (245.4-4ubuntu3.24) ... 2025-04-18 04:57:32 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Processing triggers for man-db (2.9.1-1) ... 2025-04-18 04:57:34 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag apt.installed.nginx-full 2025-04-18 04:57:34 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer> tracer: cleared flag apt.queued_installs tracer: -- dequeue handler reactive/apt.py:44:install_queued 2025-04-18 04:57:34 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/apt.py:50:ensure_package_status 2025-04-18 04:57:34 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Unholding packages nginx-full 2025-04-18 04:57:34 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Marking {'nginx-full'} as unhold 2025-04-18 04:57:34 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 nginx-full was already not hold. 2025-04-18 04:57:34 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/nginx.py:15:nginx_ready 2025-04-18 04:57:34 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer> tracer: set flag nginx.available tracer: -- dequeue handler reactive/nginx.py:15:nginx_ready 2025-04-18 04:57:34 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/load_balancer.py:230:set_nginx_version 2025-04-18 04:57:34 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 status-set: active: NGINX is ready 2025-04-18 04:57:34 INFO juju.worker.uniter.operation runhook.go:159 ran "install" hook (via explicit, bespoke hook script) 2025-04-18 04:57:34 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run install hook" for kubeapi-load-balancer/0 2025-04-18 04:57:34 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2025-04-18 04:57:34 DEBUG juju.machinelock machinelock.go:186 machine lock released for kubeapi-load-balancer/0 uniter (run install hook) 2025-04-18 04:57:34 DEBUG juju.worker.uniter.operation executor.go:121 lock released for kubeapi-load-balancer/0 2025-04-18 04:57:34 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "kubeapi-load-balancer/0" (leader=true) entered scope for relation "kubeapi-load-balancer:certificates easyrsa:client" 2025-04-18 04:57:34 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "kubeapi-load-balancer/0" (leader=true) entered scope for relation "kubernetes-control-plane:loadbalancer-external kubeapi-load-balancer:lb-consumers" 2025-04-18 04:57:34 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "kubeapi-load-balancer/0" (leader=true) entered scope for relation "kubernetes-control-plane:loadbalancer-internal kubeapi-load-balancer:lb-consumers" 2025-04-18 04:57:34 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-created (12; app: easyrsa) hook for kubeapi-load-balancer/0 2025-04-18 04:57:34 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for kubeapi-load-balancer/0 uniter (run relation-created (12; app: easyrsa) hook) 2025-04-18 05:00:39 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for kubeapi-load-balancer/0 uniter (run relation-created (12; app: easyrsa) hook) 2025-04-18 05:00:39 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-created (12; app: easyrsa) hook" for kubeapi-load-balancer/0 2025-04-18 05:00:39 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-created (12; app: easyrsa) hook" for kubeapi-load-balancer/0 2025-04-18 05:00:39 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running certificates-relation-created hook 2025-04-18 05:00:39 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-kubeapi-load-balancer-0/agent.socket } 2025-04-18 05:00:39 INFO juju.worker.uniter.operation runhook.go:162 skipped "certificates-relation-created" hook (missing) 2025-04-18 05:00:39 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-created (12; app: easyrsa) hook" for kubeapi-load-balancer/0 2025-04-18 05:00:39 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2025-04-18 05:00:39 DEBUG juju.machinelock machinelock.go:186 machine lock released for kubeapi-load-balancer/0 uniter (run relation-created (12; app: easyrsa) hook) 2025-04-18 05:00:39 DEBUG juju.worker.uniter.operation executor.go:121 lock released for kubeapi-load-balancer/0 2025-04-18 05:00:39 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-created (6; app: kubernetes-control-plane) hook for kubeapi-load-balancer/0 2025-04-18 05:00:39 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for kubeapi-load-balancer/0 uniter (run relation-created (6; app: kubernetes-control-plane) hook) 2025-04-18 05:00:40 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for kubeapi-load-balancer/0 : {5 {map[kubernetes-control-plane/0:{0}] map[] []}} 2025-04-18 05:00:40 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for kubeapi-load-balancer/0 : {6 {map[kubernetes-control-plane/0:{0}] map[] []}} 2025-04-18 05:00:49 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for kubeapi-load-balancer/0 uniter (run relation-created (6; app: kubernetes-control-plane) hook) 2025-04-18 05:00:49 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-created (6; app: kubernetes-control-plane) hook" for kubeapi-load-balancer/0 2025-04-18 05:00:49 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-created (6; app: kubernetes-control-plane) hook" for kubeapi-load-balancer/0 2025-04-18 05:00:49 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running lb-consumers-relation-created hook 2025-04-18 05:00:49 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-kubeapi-load-balancer-0/agent.socket } 2025-04-18 05:00:49 INFO juju.worker.uniter.operation runhook.go:162 skipped "lb-consumers-relation-created" hook (missing) 2025-04-18 05:00:49 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-created (6; app: kubernetes-control-plane) hook" for kubeapi-load-balancer/0 2025-04-18 05:00:49 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2025-04-18 05:00:49 DEBUG juju.machinelock machinelock.go:186 machine lock released for kubeapi-load-balancer/0 uniter (run relation-created (6; app: kubernetes-control-plane) hook) 2025-04-18 05:00:49 DEBUG juju.worker.uniter.operation executor.go:121 lock released for kubeapi-load-balancer/0 2025-04-18 05:00:49 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-created (5; app: kubernetes-control-plane) hook for kubeapi-load-balancer/0 2025-04-18 05:00:49 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for kubeapi-load-balancer/0 uniter (run relation-created (5; app: kubernetes-control-plane) hook) 2025-04-18 05:00:49 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for kubeapi-load-balancer/0 : {5 {map[] map[kubernetes-control-plane:1] []}} 2025-04-18 05:00:49 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for kubeapi-load-balancer/0 : {6 {map[] map[kubernetes-control-plane:1] []}} 2025-04-18 05:01:45 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for kubeapi-load-balancer/0 2025-04-18 05:01:57 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for kubeapi-load-balancer/0 uniter (run relation-created (5; app: kubernetes-control-plane) hook) 2025-04-18 05:01:57 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-created (5; app: kubernetes-control-plane) hook" for kubeapi-load-balancer/0 2025-04-18 05:01:57 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-created (5; app: kubernetes-control-plane) hook" for kubeapi-load-balancer/0 2025-04-18 05:01:57 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-kubeapi-load-balancer-0/agent.socket } 2025-04-18 05:01:57 INFO juju.worker.uniter.operation runhook.go:162 skipped "lb-consumers-relation-created" hook (missing) 2025-04-18 05:01:57 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-created (5; app: kubernetes-control-plane) hook" for kubeapi-load-balancer/0 2025-04-18 05:01:57 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2025-04-18 05:01:57 DEBUG juju.machinelock machinelock.go:186 machine lock released for kubeapi-load-balancer/0 uniter (run relation-created (5; app: kubernetes-control-plane) hook) 2025-04-18 05:01:57 DEBUG juju.worker.uniter.operation executor.go:121 lock released for kubeapi-load-balancer/0 2025-04-18 05:01:57 DEBUG juju.worker.uniter.operation executor.go:85 running operation accept leadership for kubeapi-load-balancer/0 2025-04-18 05:01:57 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "accept leadership" for kubeapi-load-balancer/0 2025-04-18 05:01:57 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "accept leadership" for kubeapi-load-balancer/0 2025-04-18 05:01:57 INFO juju.worker.uniter resolver.go:159 found queued "leader-elected" hook 2025-04-18 05:01:57 DEBUG juju.worker.uniter.operation executor.go:85 running operation run leader-elected hook for kubeapi-load-balancer/0 2025-04-18 05:01:57 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for kubeapi-load-balancer/0 uniter (run leader-elected hook) 2025-04-18 05:02:08 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for kubeapi-load-balancer/0 uniter (run leader-elected hook) 2025-04-18 05:02:08 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run leader-elected hook" for kubeapi-load-balancer/0 2025-04-18 05:02:08 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run leader-elected hook" for kubeapi-load-balancer/0 2025-04-18 05:02:08 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running leader-elected hook 2025-04-18 05:02:08 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-kubeapi-load-balancer-0/agent.socket } 2025-04-18 05:02:08 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Reactive main running for hook leader-elected 2025-04-18 05:02:08 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer> tracer: set flag endpoint.lb-consumers.created tracer: ++ queue handler hooks/relations/http/provides.py:15:broken:website tracer: ++ queue handler hooks/relations/http/requires.py:15:broken:apiserver tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/apt.py:50:ensure_package_status tracer: ++ queue handler reactive/load_balancer.py:230:set_nginx_version 2025-04-18 05:02:08 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.set.nagios_context 2025-04-18 05:02:08 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.nagios_context 2025-04-18 05:02:08 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2025-04-18 05:02:08 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.extra_packages 2025-04-18 05:02:08 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.set.package_status 2025-04-18 05:02:08 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.package_status 2025-04-18 05:02:08 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.install_sources 2025-04-18 05:02:08 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.install_keys 2025-04-18 05:02:08 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.set.port 2025-04-18 05:02:08 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.port 2025-04-18 05:02:08 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.set.host 2025-04-18 05:02:08 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.host 2025-04-18 05:02:08 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.ha-cluster-vip 2025-04-18 05:02:08 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.ha-cluster-dns 2025-04-18 05:02:08 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.extra_sans 2025-04-18 05:02:08 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.set.proxy_read_timeout 2025-04-18 05:02:08 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.proxy_read_timeout 2025-04-18 05:02:08 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.loadbalancer-ips 2025-04-18 05:02:08 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Initializing Leadership Layer (is leader) 2025-04-18 05:02:08 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Initializing Apt Layer 2025-04-18 05:02:08 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer> tracer: starting handler dispatch, 22 flags set tracer: set flag apt.installed.nginx-full tracer: set flag config.default.extra_packages tracer: set flag config.default.extra_sans tracer: set flag config.default.ha-cluster-dns tracer: set flag config.default.ha-cluster-vip tracer: set flag config.default.host tracer: set flag config.default.install_keys tracer: set flag config.default.install_sources tracer: set flag config.default.loadbalancer-ips tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.package_status tracer: set flag config.default.port tracer: set flag config.default.proxy_read_timeout tracer: set flag config.set.host tracer: set flag config.set.nagios_context tracer: set flag config.set.package_status tracer: set flag config.set.port tracer: set flag config.set.proxy_read_timeout tracer: set flag endpoint.lb-consumers.created tracer: set flag leadership.is_leader tracer: set flag nginx.available 2025-04-18 05:02:08 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2025-04-18 05:02:08 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer> tracer: main dispatch loop, 5 handlers queued tracer: ++ queue handler hooks/relations/http/provides.py:15:broken:website tracer: ++ queue handler hooks/relations/http/requires.py:15:broken:apiserver tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/apt.py:50:ensure_package_status tracer: ++ queue handler reactive/load_balancer.py:230:set_nginx_version 2025-04-18 05:02:08 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/apt.py:50:ensure_package_status 2025-04-18 05:02:08 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/load_balancer.py:230:set_nginx_version 2025-04-18 05:02:08 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/http/requires.py:15:broken:apiserver 2025-04-18 05:02:08 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/http/provides.py:15:broken:website 2025-04-18 05:02:08 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2025-04-18 05:02:09 INFO juju.worker.uniter.operation runhook.go:159 ran "leader-elected" hook (via explicit, bespoke hook script) 2025-04-18 05:02:09 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run leader-elected hook" for kubeapi-load-balancer/0 2025-04-18 05:02:09 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2025-04-18 05:02:09 DEBUG juju.machinelock machinelock.go:186 machine lock released for kubeapi-load-balancer/0 uniter (run leader-elected hook) 2025-04-18 05:02:09 DEBUG juju.worker.uniter.operation executor.go:121 lock released for kubeapi-load-balancer/0 2025-04-18 05:02:09 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2025-04-18 05:02:09 DEBUG juju.worker.uniter.operation executor.go:85 running operation run config-changed hook for kubeapi-load-balancer/0 2025-04-18 05:02:09 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for kubeapi-load-balancer/0 uniter (run config-changed hook) 2025-04-18 05:02:19 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for kubeapi-load-balancer/0 uniter (run config-changed hook) 2025-04-18 05:02:19 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run config-changed hook" for kubeapi-load-balancer/0 2025-04-18 05:02:19 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run config-changed hook" for kubeapi-load-balancer/0 2025-04-18 05:02:19 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running config-changed hook 2025-04-18 05:02:19 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-kubeapi-load-balancer-0/agent.socket } 2025-04-18 05:02:19 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Reactive main running for hook config-changed 2025-04-18 05:02:19 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer> tracer: set flag endpoint.lb-consumers.changed tracer: ++ queue handler hooks/relations/http/provides.py:15:broken:website tracer: ++ queue handler hooks/relations/http/requires.py:15:broken:apiserver tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/apt.py:50:ensure_package_status tracer: ++ queue handler reactive/load_balancer.py:230:set_nginx_version 2025-04-18 05:02:19 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag endpoint.lb-consumers.requests_changed 2025-04-18 05:02:19 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.set.nagios_context 2025-04-18 05:02:19 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.nagios_context 2025-04-18 05:02:19 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2025-04-18 05:02:19 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.extra_packages 2025-04-18 05:02:19 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.set.package_status 2025-04-18 05:02:19 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.package_status 2025-04-18 05:02:19 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.install_sources 2025-04-18 05:02:19 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.install_keys 2025-04-18 05:02:19 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.set.port 2025-04-18 05:02:19 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.port 2025-04-18 05:02:19 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.set.host 2025-04-18 05:02:19 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.host 2025-04-18 05:02:19 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.ha-cluster-vip 2025-04-18 05:02:19 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.ha-cluster-dns 2025-04-18 05:02:19 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.extra_sans 2025-04-18 05:02:19 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.set.proxy_read_timeout 2025-04-18 05:02:19 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.proxy_read_timeout 2025-04-18 05:02:19 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.loadbalancer-ips 2025-04-18 05:02:19 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Initializing Leadership Layer (is leader) 2025-04-18 05:02:19 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Initializing Apt Layer 2025-04-18 05:02:19 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer> tracer: starting handler dispatch, 24 flags set tracer: set flag apt.installed.nginx-full tracer: set flag config.default.extra_packages tracer: set flag config.default.extra_sans tracer: set flag config.default.ha-cluster-dns tracer: set flag config.default.ha-cluster-vip tracer: set flag config.default.host tracer: set flag config.default.install_keys tracer: set flag config.default.install_sources tracer: set flag config.default.loadbalancer-ips tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.package_status tracer: set flag config.default.port tracer: set flag config.default.proxy_read_timeout tracer: set flag config.set.host tracer: set flag config.set.nagios_context tracer: set flag config.set.package_status tracer: set flag config.set.port tracer: set flag config.set.proxy_read_timeout tracer: set flag endpoint.lb-consumers.changed tracer: set flag endpoint.lb-consumers.created tracer: set flag endpoint.lb-consumers.requests_changed tracer: set flag leadership.is_leader tracer: set flag nginx.available 2025-04-18 05:02:19 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2025-04-18 05:02:19 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer> tracer: main dispatch loop, 5 handlers queued tracer: ++ queue handler hooks/relations/http/provides.py:15:broken:website tracer: ++ queue handler hooks/relations/http/requires.py:15:broken:apiserver tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/apt.py:50:ensure_package_status tracer: ++ queue handler reactive/load_balancer.py:230:set_nginx_version 2025-04-18 05:02:19 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/apt.py:50:ensure_package_status 2025-04-18 05:02:19 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/load_balancer.py:230:set_nginx_version 2025-04-18 05:02:19 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/http/requires.py:15:broken:apiserver 2025-04-18 05:02:19 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/http/provides.py:15:broken:website 2025-04-18 05:02:19 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2025-04-18 05:02:20 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for kubeapi-load-balancer/0 : {5 {map[] map[kubernetes-control-plane:2] []}} 2025-04-18 05:02:20 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for kubeapi-load-balancer/0 : {6 {map[] map[kubernetes-control-plane:2] []}} 2025-04-18 05:02:20 INFO juju.worker.uniter.operation runhook.go:159 ran "config-changed" hook (via explicit, bespoke hook script) 2025-04-18 05:02:20 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run config-changed hook" for kubeapi-load-balancer/0 2025-04-18 05:02:20 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2025-04-18 05:02:20 DEBUG juju.machinelock machinelock.go:186 machine lock released for kubeapi-load-balancer/0 uniter (run config-changed hook) 2025-04-18 05:02:20 DEBUG juju.worker.uniter.operation executor.go:121 lock released for kubeapi-load-balancer/0 2025-04-18 05:02:20 INFO juju.worker.uniter resolver.go:159 found queued "start" hook 2025-04-18 05:02:20 DEBUG juju.worker.uniter.operation executor.go:85 running operation run start hook for kubeapi-load-balancer/0 2025-04-18 05:02:20 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for kubeapi-load-balancer/0 uniter (run start hook) 2025-04-18 05:02:30 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for kubeapi-load-balancer/0 uniter (run start hook) 2025-04-18 05:02:30 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run start hook" for kubeapi-load-balancer/0 2025-04-18 05:02:30 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run start hook" for kubeapi-load-balancer/0 2025-04-18 05:02:30 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running start hook 2025-04-18 05:02:30 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-kubeapi-load-balancer-0/agent.socket } 2025-04-18 05:02:30 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Reactive main running for hook start 2025-04-18 05:02:30 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/http/provides.py:15:broken:website tracer: ++ queue handler hooks/relations/http/requires.py:15:broken:apiserver tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/apt.py:50:ensure_package_status tracer: ++ queue handler reactive/load_balancer.py:230:set_nginx_version 2025-04-18 05:02:30 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.nagios_context 2025-04-18 05:02:30 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2025-04-18 05:02:30 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.extra_packages 2025-04-18 05:02:30 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.set.package_status 2025-04-18 05:02:30 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.package_status 2025-04-18 05:02:30 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.install_sources 2025-04-18 05:02:30 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.install_keys 2025-04-18 05:02:30 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.set.port 2025-04-18 05:02:30 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.port 2025-04-18 05:02:30 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.set.host 2025-04-18 05:02:30 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.host 2025-04-18 05:02:30 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.ha-cluster-vip 2025-04-18 05:02:30 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.ha-cluster-dns 2025-04-18 05:02:30 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.extra_sans 2025-04-18 05:02:30 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.set.proxy_read_timeout 2025-04-18 05:02:30 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.proxy_read_timeout 2025-04-18 05:02:30 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.loadbalancer-ips 2025-04-18 05:02:30 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Initializing Leadership Layer (is leader) 2025-04-18 05:02:30 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Initializing Apt Layer 2025-04-18 05:02:30 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer> tracer: starting handler dispatch, 24 flags set tracer: set flag apt.installed.nginx-full tracer: set flag config.default.extra_packages tracer: set flag config.default.extra_sans tracer: set flag config.default.ha-cluster-dns tracer: set flag config.default.ha-cluster-vip tracer: set flag config.default.host tracer: set flag config.default.install_keys tracer: set flag config.default.install_sources tracer: set flag config.default.loadbalancer-ips tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.package_status tracer: set flag config.default.port tracer: set flag config.default.proxy_read_timeout tracer: set flag config.set.host tracer: set flag config.set.nagios_context tracer: set flag config.set.package_status tracer: set flag config.set.port tracer: set flag config.set.proxy_read_timeout tracer: set flag endpoint.lb-consumers.changed tracer: set flag endpoint.lb-consumers.created tracer: set flag endpoint.lb-consumers.requests_changed tracer: set flag leadership.is_leader tracer: set flag nginx.available 2025-04-18 05:02:30 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2025-04-18 05:02:30 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer> tracer: main dispatch loop, 5 handlers queued tracer: ++ queue handler hooks/relations/http/provides.py:15:broken:website tracer: ++ queue handler hooks/relations/http/requires.py:15:broken:apiserver tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/apt.py:50:ensure_package_status tracer: ++ queue handler reactive/load_balancer.py:230:set_nginx_version 2025-04-18 05:02:30 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/apt.py:50:ensure_package_status 2025-04-18 05:02:30 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/load_balancer.py:230:set_nginx_version 2025-04-18 05:02:31 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/http/requires.py:15:broken:apiserver 2025-04-18 05:02:31 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/http/provides.py:15:broken:website 2025-04-18 05:02:31 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2025-04-18 05:02:31 INFO juju.worker.uniter.operation runhook.go:159 ran "start" hook (via explicit, bespoke hook script) 2025-04-18 05:02:31 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run start hook" for kubeapi-load-balancer/0 2025-04-18 05:02:31 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2025-04-18 05:02:31 DEBUG juju.machinelock machinelock.go:186 machine lock released for kubeapi-load-balancer/0 uniter (run start hook) 2025-04-18 05:02:31 DEBUG juju.worker.uniter.operation executor.go:121 lock released for kubeapi-load-balancer/0 2025-04-18 05:02:31 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2025-04-18 05:02:31 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (5; app: kubernetes-control-plane) hook for kubeapi-load-balancer/0 2025-04-18 05:02:31 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for kubeapi-load-balancer/0 uniter (run relation-changed (5; app: kubernetes-control-plane) hook) 2025-04-18 05:02:31 DEBUG juju.worker.dependency engine.go:580 "metric-collect" manifold worker started at 2025-04-18 05:02:31.311577955 +0000 UTC 2025-04-18 05:02:31 DEBUG juju.worker.metrics.collect manifold.go:293 recording metrics 2025-04-18 05:02:31 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-kubeapi-load-balancer-0/metrics-collect-agent.socket } 2025-04-18 05:02:31 DEBUG juju.worker.meterstatus connected.go:93 got meter status change signal from watcher 2025-04-18 05:02:31 WARNING unit.unit-kubeapi-load-balancer-0.collect-metrics logger.go:60 /var/lib/juju/agents/unit-kubeapi-load-balancer-0/charm/hooks/collect-metrics:43: YAMLLoadWarning: calling yaml.load() without Loader=... is deprecated, as the default Loader is unsafe. Please read https://msg.pyyaml.org/load for full details. 2025-04-18 05:02:31 WARNING unit.unit-kubeapi-load-balancer-0.collect-metrics logger.go:60 doc = yaml.load(f) 2025-04-18 05:02:31 DEBUG juju.worker.metrics.collect manifold.go:316 ran "collect-metrics" hook (via explicit, bespoke hook script) 2025-04-18 05:02:40 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for kubeapi-load-balancer/0 uniter (run relation-changed (5; app: kubernetes-control-plane) hook) 2025-04-18 05:02:40 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (5; app: kubernetes-control-plane) hook" for kubeapi-load-balancer/0 2025-04-18 05:02:40 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (5; app: kubernetes-control-plane) hook" for kubeapi-load-balancer/0 2025-04-18 05:02:40 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running lb-consumers-relation-changed hook 2025-04-18 05:02:40 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-kubeapi-load-balancer-0/agent.socket } 2025-04-18 05:02:41 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: Reactive main running for hook lb-consumers-relation-changed 2025-04-18 05:02:41 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/http/provides.py:15:broken:website tracer: ++ queue handler hooks/relations/http/requires.py:15:broken:apiserver tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/apt.py:50:ensure_package_status tracer: ++ queue handler reactive/load_balancer.py:230:set_nginx_version 2025-04-18 05:02:41 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.default.nagios_context 2025-04-18 05:02:41 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.default.nagios_servicegroups 2025-04-18 05:02:41 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.default.extra_packages 2025-04-18 05:02:41 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.set.package_status 2025-04-18 05:02:41 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.default.package_status 2025-04-18 05:02:41 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.default.install_sources 2025-04-18 05:02:41 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.default.install_keys 2025-04-18 05:02:41 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.set.port 2025-04-18 05:02:41 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.default.port 2025-04-18 05:02:41 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.set.host 2025-04-18 05:02:41 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.default.host 2025-04-18 05:02:41 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.default.ha-cluster-vip 2025-04-18 05:02:41 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.default.ha-cluster-dns 2025-04-18 05:02:41 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.default.extra_sans 2025-04-18 05:02:41 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.set.proxy_read_timeout 2025-04-18 05:02:41 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.default.proxy_read_timeout 2025-04-18 05:02:41 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.default.loadbalancer-ips 2025-04-18 05:02:41 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: Initializing Leadership Layer (is leader) 2025-04-18 05:02:41 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: Initializing Apt Layer 2025-04-18 05:02:41 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer> tracer: starting handler dispatch, 24 flags set tracer: set flag apt.installed.nginx-full tracer: set flag config.default.extra_packages tracer: set flag config.default.extra_sans tracer: set flag config.default.ha-cluster-dns tracer: set flag config.default.ha-cluster-vip tracer: set flag config.default.host tracer: set flag config.default.install_keys tracer: set flag config.default.install_sources tracer: set flag config.default.loadbalancer-ips tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.package_status tracer: set flag config.default.port tracer: set flag config.default.proxy_read_timeout tracer: set flag config.set.host tracer: set flag config.set.nagios_context tracer: set flag config.set.package_status tracer: set flag config.set.port tracer: set flag config.set.proxy_read_timeout tracer: set flag endpoint.lb-consumers.changed tracer: set flag endpoint.lb-consumers.created tracer: set flag endpoint.lb-consumers.requests_changed tracer: set flag leadership.is_leader tracer: set flag nginx.available 2025-04-18 05:02:41 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: hooks phase, 0 handlers queued 2025-04-18 05:02:41 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer> tracer: main dispatch loop, 5 handlers queued tracer: ++ queue handler hooks/relations/http/provides.py:15:broken:website tracer: ++ queue handler hooks/relations/http/requires.py:15:broken:apiserver tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/apt.py:50:ensure_package_status tracer: ++ queue handler reactive/load_balancer.py:230:set_nginx_version 2025-04-18 05:02:41 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: Invoking reactive handler: reactive/apt.py:50:ensure_package_status 2025-04-18 05:02:41 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: Invoking reactive handler: reactive/load_balancer.py:230:set_nginx_version 2025-04-18 05:02:41 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: Invoking reactive handler: hooks/relations/http/requires.py:15:broken:apiserver 2025-04-18 05:02:41 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: Invoking reactive handler: hooks/relations/http/provides.py:15:broken:website 2025-04-18 05:02:41 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2025-04-18 05:02:41 INFO juju.worker.uniter.operation runhook.go:159 ran "lb-consumers-relation-changed" hook (via explicit, bespoke hook script) 2025-04-18 05:02:41 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (5; app: kubernetes-control-plane) hook" for kubeapi-load-balancer/0 2025-04-18 05:02:41 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2025-04-18 05:02:41 DEBUG juju.machinelock machinelock.go:186 machine lock released for kubeapi-load-balancer/0 uniter (run relation-changed (5; app: kubernetes-control-plane) hook) 2025-04-18 05:02:41 DEBUG juju.worker.uniter.operation executor.go:121 lock released for kubeapi-load-balancer/0 2025-04-18 05:02:41 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2025-04-18 05:02:41 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-joined (5; unit: kubernetes-control-plane/0) hook for kubeapi-load-balancer/0 2025-04-18 05:02:41 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for kubeapi-load-balancer/0 uniter (run relation-joined (5; unit: kubernetes-control-plane/0) hook) 2025-04-18 05:02:52 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for kubeapi-load-balancer/0 uniter (run relation-joined (5; unit: kubernetes-control-plane/0) hook) 2025-04-18 05:02:52 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-joined (5; unit: kubernetes-control-plane/0) hook" for kubeapi-load-balancer/0 2025-04-18 05:02:52 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-joined (5; unit: kubernetes-control-plane/0) hook" for kubeapi-load-balancer/0 2025-04-18 05:02:52 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running lb-consumers-relation-joined hook for kubernetes-control-plane/0 2025-04-18 05:02:52 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-kubeapi-load-balancer-0/agent.socket } 2025-04-18 05:02:53 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: Reactive main running for hook lb-consumers-relation-joined 2025-04-18 05:02:53 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer> tracer: set flag endpoint.lb-consumers.joined tracer: ++ queue handler hooks/relations/http/provides.py:15:broken:website tracer: ++ queue handler hooks/relations/http/requires.py:15:broken:apiserver tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/apt.py:50:ensure_package_status tracer: ++ queue handler reactive/load_balancer.py:230:set_nginx_version tracer: ++ queue handler reactive/load_balancer.py:276:provide_lb_consumers 2025-04-18 05:02:53 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.set.nagios_context 2025-04-18 05:02:53 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.default.nagios_context 2025-04-18 05:02:53 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.default.nagios_servicegroups 2025-04-18 05:02:53 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.default.extra_packages 2025-04-18 05:02:53 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.set.package_status 2025-04-18 05:02:53 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.default.package_status 2025-04-18 05:02:53 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.default.install_sources 2025-04-18 05:02:53 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.default.install_keys 2025-04-18 05:02:53 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.set.port 2025-04-18 05:02:53 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.default.port 2025-04-18 05:02:53 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.set.host 2025-04-18 05:02:53 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.default.host 2025-04-18 05:02:53 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.default.ha-cluster-vip 2025-04-18 05:02:53 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.default.ha-cluster-dns 2025-04-18 05:02:53 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.default.extra_sans 2025-04-18 05:02:53 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.set.proxy_read_timeout 2025-04-18 05:02:53 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.default.proxy_read_timeout 2025-04-18 05:02:53 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.default.loadbalancer-ips 2025-04-18 05:02:53 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: Initializing Leadership Layer (is leader) 2025-04-18 05:02:53 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: Initializing Apt Layer 2025-04-18 05:02:53 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer> tracer: starting handler dispatch, 25 flags set tracer: set flag apt.installed.nginx-full tracer: set flag config.default.extra_packages tracer: set flag config.default.extra_sans tracer: set flag config.default.ha-cluster-dns tracer: set flag config.default.ha-cluster-vip tracer: set flag config.default.host tracer: set flag config.default.install_keys tracer: set flag config.default.install_sources tracer: set flag config.default.loadbalancer-ips tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.package_status tracer: set flag config.default.port tracer: set flag config.default.proxy_read_timeout tracer: set flag config.set.host tracer: set flag config.set.nagios_context tracer: set flag config.set.package_status tracer: set flag config.set.port tracer: set flag config.set.proxy_read_timeout tracer: set flag endpoint.lb-consumers.changed tracer: set flag endpoint.lb-consumers.created tracer: set flag endpoint.lb-consumers.joined tracer: set flag endpoint.lb-consumers.requests_changed tracer: set flag leadership.is_leader tracer: set flag nginx.available 2025-04-18 05:02:53 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: hooks phase, 0 handlers queued 2025-04-18 05:02:53 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer> tracer: main dispatch loop, 6 handlers queued tracer: ++ queue handler hooks/relations/http/provides.py:15:broken:website tracer: ++ queue handler hooks/relations/http/requires.py:15:broken:apiserver tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/apt.py:50:ensure_package_status tracer: ++ queue handler reactive/load_balancer.py:230:set_nginx_version tracer: ++ queue handler reactive/load_balancer.py:276:provide_lb_consumers 2025-04-18 05:02:53 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: Invoking reactive handler: reactive/apt.py:50:ensure_package_status 2025-04-18 05:02:53 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: Invoking reactive handler: reactive/load_balancer.py:230:set_nginx_version 2025-04-18 05:02:53 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: Invoking reactive handler: reactive/load_balancer.py:276:provide_lb_consumers 2025-04-18 05:02:53 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: cleared flag endpoint.lb-consumers.requests_changed 2025-04-18 05:02:53 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: Invoking reactive handler: hooks/relations/http/requires.py:15:broken:apiserver 2025-04-18 05:02:53 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: Invoking reactive handler: hooks/relations/http/provides.py:15:broken:website 2025-04-18 05:02:53 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2025-04-18 05:02:53 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for kubeapi-load-balancer/0 : {12 {map[easyrsa/0:{1}] map[] []}} 2025-04-18 05:02:53 INFO juju.worker.uniter.operation runhook.go:159 ran "lb-consumers-relation-joined" hook (via explicit, bespoke hook script) 2025-04-18 05:02:53 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-joined (5; unit: kubernetes-control-plane/0) hook" for kubeapi-load-balancer/0 2025-04-18 05:02:53 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2025-04-18 05:02:53 DEBUG juju.machinelock machinelock.go:186 machine lock released for kubeapi-load-balancer/0 uniter (run relation-joined (5; unit: kubernetes-control-plane/0) hook) 2025-04-18 05:02:53 DEBUG juju.worker.uniter.operation executor.go:121 lock released for kubeapi-load-balancer/0 2025-04-18 05:02:53 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2025-04-18 05:02:53 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-joined (12; unit: easyrsa/0) hook for kubeapi-load-balancer/0 2025-04-18 05:02:53 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for kubeapi-load-balancer/0 uniter (run relation-joined (12; unit: easyrsa/0) hook) 2025-04-18 05:03:05 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for kubeapi-load-balancer/0 uniter (run relation-joined (12; unit: easyrsa/0) hook) 2025-04-18 05:03:05 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-joined (12; unit: easyrsa/0) hook" for kubeapi-load-balancer/0 2025-04-18 05:03:05 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-joined (12; unit: easyrsa/0) hook" for kubeapi-load-balancer/0 2025-04-18 05:03:05 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running certificates-relation-joined hook for easyrsa/0 2025-04-18 05:03:05 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-kubeapi-load-balancer-0/agent.socket } 2025-04-18 05:03:06 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Reactive main running for hook certificates-relation-joined 2025-04-18 05:03:06 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer> tracer: cleared flag endpoint.lb-consumers.changed tracer: ++ queue handler hooks/relations/http/provides.py:15:broken:website tracer: ++ queue handler hooks/relations/http/requires.py:15:broken:apiserver tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/apt.py:50:ensure_package_status tracer: ++ queue handler reactive/load_balancer.py:230:set_nginx_version tracer: ++ queue handler reactive/load_balancer.py:276:provide_lb_consumers 2025-04-18 05:03:06 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer> tracer: set flag endpoint.certificates.joined tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: -- dequeue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates 2025-04-18 05:03:06 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag endpoint.certificates.changed 2025-04-18 05:03:06 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag endpoint.certificates.changed.ca 2025-04-18 05:03:06 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag endpoint.certificates.changed.client.cert 2025-04-18 05:03:06 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag endpoint.certificates.changed.client.key 2025-04-18 05:03:06 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag endpoint.certificates.changed.egress-subnets 2025-04-18 05:03:06 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag endpoint.certificates.changed.ingress-address 2025-04-18 05:03:06 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag endpoint.certificates.changed.private-address 2025-04-18 05:03:06 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.set.nagios_context 2025-04-18 05:03:06 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.nagios_context 2025-04-18 05:03:06 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.nagios_servicegroups 2025-04-18 05:03:06 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.extra_packages 2025-04-18 05:03:06 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.set.package_status 2025-04-18 05:03:06 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.package_status 2025-04-18 05:03:06 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.install_sources 2025-04-18 05:03:06 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.install_keys 2025-04-18 05:03:06 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.set.port 2025-04-18 05:03:06 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.port 2025-04-18 05:03:06 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.set.host 2025-04-18 05:03:06 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.host 2025-04-18 05:03:06 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.ha-cluster-vip 2025-04-18 05:03:06 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.ha-cluster-dns 2025-04-18 05:03:06 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.extra_sans 2025-04-18 05:03:06 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.set.proxy_read_timeout 2025-04-18 05:03:06 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.proxy_read_timeout 2025-04-18 05:03:06 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.loadbalancer-ips 2025-04-18 05:03:06 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Initializing Leadership Layer (is leader) 2025-04-18 05:03:06 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Initializing Apt Layer 2025-04-18 05:03:06 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer> tracer: starting handler dispatch, 31 flags set tracer: set flag apt.installed.nginx-full tracer: set flag config.default.extra_packages tracer: set flag config.default.extra_sans tracer: set flag config.default.ha-cluster-dns tracer: set flag config.default.ha-cluster-vip tracer: set flag config.default.host tracer: set flag config.default.install_keys tracer: set flag config.default.install_sources tracer: set flag config.default.loadbalancer-ips tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.package_status tracer: set flag config.default.port tracer: set flag config.default.proxy_read_timeout tracer: set flag config.set.host tracer: set flag config.set.nagios_context tracer: set flag config.set.package_status tracer: set flag config.set.port tracer: set flag config.set.proxy_read_timeout tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag endpoint.lb-consumers.created tracer: set flag endpoint.lb-consumers.joined tracer: set flag leadership.is_leader tracer: set flag nginx.available 2025-04-18 05:03:06 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: hooks phase, 0 handlers queued 2025-04-18 05:03:06 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer> tracer: main dispatch loop, 6 handlers queued tracer: ++ queue handler hooks/relations/http/provides.py:15:broken:website tracer: ++ queue handler hooks/relations/http/requires.py:15:broken:apiserver tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/apt.py:50:ensure_package_status tracer: ++ queue handler reactive/load_balancer.py:230:set_nginx_version tracer: ++ queue handler reactive/load_balancer.py:276:provide_lb_consumers 2025-04-18 05:03:06 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Invoking reactive handler: reactive/apt.py:50:ensure_package_status 2025-04-18 05:03:06 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Invoking reactive handler: reactive/load_balancer.py:230:set_nginx_version 2025-04-18 05:03:06 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Invoking reactive handler: reactive/load_balancer.py:276:provide_lb_consumers 2025-04-18 05:03:06 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Invoking reactive handler: hooks/relations/http/requires.py:15:broken:apiserver 2025-04-18 05:03:06 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Invoking reactive handler: hooks/relations/http/provides.py:15:broken:website 2025-04-18 05:03:06 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2025-04-18 05:03:06 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer> tracer: set flag certificates.available tracer: ++ queue handler reactive/load_balancer.py:76:request_server_certificates 2025-04-18 05:03:06 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer> tracer: set flag certificates.ca.available tracer: ++ queue handler reactive/tls_client.py:18:store_ca 2025-04-18 05:03:06 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag certificates.ca.changed 2025-04-18 05:03:06 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer> tracer: set flag certificates.client.cert.available tracer: ++ queue handler reactive/tls_client.py:71:store_client 2025-04-18 05:03:06 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Invoking reactive handler: reactive/load_balancer.py:76:request_server_certificates 2025-04-18 05:03:06 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Invoking reactive handler: reactive/tls_client.py:18:store_ca 2025-04-18 05:03:06 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Writing CA certificate to /srv/kubernetes/ca.crt 2025-04-18 05:03:06 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag tls_client.ca.written 2025-04-18 05:03:06 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag tls_client.ca.saved 2025-04-18 05:03:06 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Writing CA certificate to /usr/local/share/ca-certificates/kubeapi-load-balancer.crt 2025-04-18 05:03:06 DEBUG unit.kubeapi-load-balancer/0.certificates-relation-joined logger.go:60 Updating certificates in /etc/ssl/certs... 2025-04-18 05:03:07 WARNING unit.kubeapi-load-balancer/0.certificates-relation-joined logger.go:60 rehash: warning: skipping duplicate certificate in kubeapi-load-balancer.pem 2025-04-18 05:03:07 WARNING unit.kubeapi-load-balancer/0.certificates-relation-joined logger.go:60 rehash: warning: skipping ca-certificates.crt,it does not contain exactly one certificate or CRL 2025-04-18 05:03:07 DEBUG unit.kubeapi-load-balancer/0.certificates-relation-joined logger.go:60 1 added, 0 removed; done. 2025-04-18 05:03:07 DEBUG unit.kubeapi-load-balancer/0.certificates-relation-joined logger.go:60 Running hooks in /etc/ca-certificates/update.d... 2025-04-18 05:03:07 DEBUG unit.kubeapi-load-balancer/0.certificates-relation-joined logger.go:60 done. 2025-04-18 05:03:07 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Generated ca-certificates.crt for kubeapi-load-balancer 2025-04-18 05:03:07 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag tls_client.ca_installed 2025-04-18 05:03:07 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Invoking reactive handler: reactive/tls_client.py:71:store_client 2025-04-18 05:03:07 INFO juju.worker.uniter.operation runhook.go:159 ran "certificates-relation-joined" hook (via explicit, bespoke hook script) 2025-04-18 05:03:07 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-joined (12; unit: easyrsa/0) hook" for kubeapi-load-balancer/0 2025-04-18 05:03:07 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2025-04-18 05:03:07 DEBUG juju.machinelock machinelock.go:186 machine lock released for kubeapi-load-balancer/0 uniter (run relation-joined (12; unit: easyrsa/0) hook) 2025-04-18 05:03:07 DEBUG juju.worker.uniter.operation executor.go:121 lock released for kubeapi-load-balancer/0 2025-04-18 05:03:07 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2025-04-18 05:03:07 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (12; unit: easyrsa/0) hook for kubeapi-load-balancer/0 2025-04-18 05:03:07 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for kubeapi-load-balancer/0 uniter (run relation-changed (12; unit: easyrsa/0) hook) 2025-04-18 05:03:18 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for kubeapi-load-balancer/0 uniter (run relation-changed (12; unit: easyrsa/0) hook) 2025-04-18 05:03:18 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (12; unit: easyrsa/0) hook" for kubeapi-load-balancer/0 2025-04-18 05:03:18 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (12; unit: easyrsa/0) hook" for kubeapi-load-balancer/0 2025-04-18 05:03:18 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running certificates-relation-changed hook for easyrsa/0 2025-04-18 05:03:18 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-kubeapi-load-balancer-0/agent.socket } 2025-04-18 05:03:18 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for kubeapi-load-balancer/0 : {12 {map[easyrsa/0:{2}] map[] []}} 2025-04-18 05:03:18 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Reactive main running for hook certificates-relation-changed 2025-04-18 05:03:18 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer> tracer: set flag endpoint.certificates.changed.kubeapi-load-balancer_0.server.cert tracer: ++ queue handler hooks/relations/http/provides.py:15:broken:website tracer: ++ queue handler hooks/relations/http/requires.py:15:broken:apiserver tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/apt.py:50:ensure_package_status tracer: ++ queue handler reactive/load_balancer.py:230:set_nginx_version tracer: ++ queue handler reactive/load_balancer.py:276:provide_lb_consumers tracer: ++ queue handler reactive/load_balancer.py:76:request_server_certificates tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:71:store_client 2025-04-18 05:03:18 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag endpoint.certificates.changed.kubeapi-load-balancer_0.server.key 2025-04-18 05:03:19 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.set.nagios_context 2025-04-18 05:03:19 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.nagios_context 2025-04-18 05:03:19 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.nagios_servicegroups 2025-04-18 05:03:19 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.extra_packages 2025-04-18 05:03:19 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.set.package_status 2025-04-18 05:03:19 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.package_status 2025-04-18 05:03:19 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.install_sources 2025-04-18 05:03:19 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.install_keys 2025-04-18 05:03:19 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.set.port 2025-04-18 05:03:19 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.port 2025-04-18 05:03:19 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.set.host 2025-04-18 05:03:19 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.host 2025-04-18 05:03:19 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.ha-cluster-vip 2025-04-18 05:03:19 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.ha-cluster-dns 2025-04-18 05:03:19 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.extra_sans 2025-04-18 05:03:19 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.set.proxy_read_timeout 2025-04-18 05:03:19 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.proxy_read_timeout 2025-04-18 05:03:19 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.loadbalancer-ips 2025-04-18 05:03:19 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Initializing Leadership Layer (is leader) 2025-04-18 05:03:19 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Initializing Apt Layer 2025-04-18 05:03:19 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer> tracer: starting handler dispatch, 40 flags set tracer: set flag apt.installed.nginx-full tracer: set flag certificates.available tracer: set flag certificates.ca.available tracer: set flag certificates.ca.changed tracer: set flag certificates.client.cert.available tracer: set flag config.default.extra_packages tracer: set flag config.default.extra_sans tracer: set flag config.default.ha-cluster-dns tracer: set flag config.default.ha-cluster-vip tracer: set flag config.default.host tracer: set flag config.default.install_keys tracer: set flag config.default.install_sources tracer: set flag config.default.loadbalancer-ips tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.package_status tracer: set flag config.default.port tracer: set flag config.default.proxy_read_timeout tracer: set flag config.set.host tracer: set flag config.set.nagios_context tracer: set flag config.set.package_status tracer: set flag config.set.port tracer: set flag config.set.proxy_read_timeout tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.kubeapi-load-balancer_0.server.cert tracer: set flag endpoint.certificates.changed.kubeapi-load-balancer_0.server.key tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag endpoint.lb-consumers.created tracer: set flag endpoint.lb-consumers.joined tracer: set flag leadership.is_leader tracer: set flag nginx.available tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca.written tracer: set flag tls_client.ca_installed 2025-04-18 05:03:19 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: hooks phase, 0 handlers queued 2025-04-18 05:03:19 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer> tracer: main dispatch loop, 9 handlers queued tracer: ++ queue handler hooks/relations/http/provides.py:15:broken:website tracer: ++ queue handler hooks/relations/http/requires.py:15:broken:apiserver tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/apt.py:50:ensure_package_status tracer: ++ queue handler reactive/load_balancer.py:230:set_nginx_version tracer: ++ queue handler reactive/load_balancer.py:276:provide_lb_consumers tracer: ++ queue handler reactive/load_balancer.py:76:request_server_certificates tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:71:store_client 2025-04-18 05:03:19 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Invoking reactive handler: reactive/apt.py:50:ensure_package_status 2025-04-18 05:03:19 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Invoking reactive handler: reactive/load_balancer.py:76:request_server_certificates 2025-04-18 05:03:19 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Invoking reactive handler: reactive/load_balancer.py:230:set_nginx_version 2025-04-18 05:03:19 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Invoking reactive handler: reactive/load_balancer.py:276:provide_lb_consumers 2025-04-18 05:03:19 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Invoking reactive handler: reactive/tls_client.py:18:store_ca 2025-04-18 05:03:19 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Invoking reactive handler: reactive/tls_client.py:71:store_client 2025-04-18 05:03:19 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Invoking reactive handler: hooks/relations/http/requires.py:15:broken:apiserver 2025-04-18 05:03:19 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Invoking reactive handler: hooks/relations/http/provides.py:15:broken:website 2025-04-18 05:03:19 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2025-04-18 05:03:19 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: cleared flag certificates.ca.changed 2025-04-18 05:03:19 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag certificates.server.certs.available 2025-04-18 05:03:19 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag certificates.server.certs.changed 2025-04-18 05:03:19 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag certificates.certs.available 2025-04-18 05:03:19 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer> tracer: set flag certificates.certs.changed tracer: ++ queue handler reactive/tls_client.py:98:update_certs 2025-04-18 05:03:19 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer> tracer: set flag certificates.server.cert.available tracer: ++ queue handler reactive/load_balancer.py:120:kick_nginx tracer: ++ queue handler reactive/tls_client.py:44:store_server 2025-04-18 05:03:19 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag certificates.batch.cert.available 2025-04-18 05:03:19 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Invoking reactive handler: reactive/load_balancer.py:120:kick_nginx 2025-04-18 05:03:19 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Certificate information changed, sending SIGHUP to nginx 2025-04-18 05:03:19 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer> tracer: cleared flag tls_client.ca.written tracer: -- dequeue handler reactive/load_balancer.py:120:kick_nginx 2025-04-18 05:03:19 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Invoking reactive handler: reactive/tls_client.py:44:store_server 2025-04-18 05:03:19 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Invoking reactive handler: reactive/tls_client.py:98:update_certs 2025-04-18 05:03:19 WARNING unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: No client certs found using maps. Checking for global client certificates. 2025-04-18 05:03:19 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag tls_client.server.certs.changed 2025-04-18 05:03:19 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag tls_client.server.cert.10.0.0.48.changed 2025-04-18 05:03:19 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag tls_client.certs.saved 2025-04-18 05:03:19 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer> tracer: set flag tls_client.certs.changed tracer: ++ queue handler reactive/load_balancer.py:120:kick_nginx 2025-04-18 05:03:19 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer> tracer: cleared flag certificates.certs.changed tracer: -- dequeue handler reactive/tls_client.py:98:update_certs 2025-04-18 05:03:19 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Invoking reactive handler: reactive/load_balancer.py:120:kick_nginx 2025-04-18 05:03:19 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Certificate information changed, sending SIGHUP to nginx 2025-04-18 05:03:19 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer> tracer: cleared flag tls_client.certs.changed tracer: -- dequeue handler reactive/load_balancer.py:120:kick_nginx 2025-04-18 05:03:19 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Invoking reactive handler: reactive/load_balancer.py:156:install_load_balancer 2025-04-18 05:03:19 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: status-set: maintenance: Configuring site apilb 2025-04-18 05:03:19 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Writing file /etc/nginx/sites-available/apilb root:root 444 2025-04-18 05:03:19 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Wrote vhost config {'host': '127.0.0.1', 'port': 443, 'servers': {443: {('10.0.0.48', 6443)}, 6443: set()}, 'server_certificate': '/srv/kubernetes/server.crt', 'server_key': '/srv/kubernetes/server.key', 'proxy_read_timeout': 600} to apilb.conf 2025-04-18 05:03:19 WARNING unit.kubeapi-load-balancer/0.certificates-relation-changed logger.go:60 Job for nginx.service failed. 2025-04-18 05:03:19 WARNING unit.kubeapi-load-balancer/0.certificates-relation-changed logger.go:60 See "systemctl status nginx.service" and "journalctl -xe" for details. 2025-04-18 05:03:19 WARNING unit.kubeapi-load-balancer/0.certificates-relation-changed logger.go:60 Job for nginx.service failed because the control process exited with error code. 2025-04-18 05:03:19 WARNING unit.kubeapi-load-balancer/0.certificates-relation-changed logger.go:60 See "systemctl status nginx.service" and "journalctl -xe" for details. 2025-04-18 05:03:19 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: status-set: active: Loadbalancer ready. 2025-04-18 05:03:20 INFO juju.worker.uniter.operation runhook.go:159 ran "certificates-relation-changed" hook (via explicit, bespoke hook script) 2025-04-18 05:03:20 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (12; unit: easyrsa/0) hook" for kubeapi-load-balancer/0 2025-04-18 05:03:20 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2025-04-18 05:03:20 DEBUG juju.machinelock machinelock.go:186 machine lock released for kubeapi-load-balancer/0 uniter (run relation-changed (12; unit: easyrsa/0) hook) 2025-04-18 05:03:20 DEBUG juju.worker.uniter.operation executor.go:121 lock released for kubeapi-load-balancer/0 2025-04-18 05:03:20 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2025-04-18 05:03:20 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (6; app: kubernetes-control-plane) hook for kubeapi-load-balancer/0 2025-04-18 05:03:20 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for kubeapi-load-balancer/0 uniter (run relation-changed (6; app: kubernetes-control-plane) hook) 2025-04-18 05:03:30 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for kubeapi-load-balancer/0 uniter (run relation-changed (6; app: kubernetes-control-plane) hook) 2025-04-18 05:03:30 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (6; app: kubernetes-control-plane) hook" for kubeapi-load-balancer/0 2025-04-18 05:03:30 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (6; app: kubernetes-control-plane) hook" for kubeapi-load-balancer/0 2025-04-18 05:03:30 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running lb-consumers-relation-changed hook 2025-04-18 05:03:30 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-kubeapi-load-balancer-0/agent.socket } 2025-04-18 05:03:30 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Reactive main running for hook lb-consumers-relation-changed 2025-04-18 05:03:30 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/http/provides.py:15:broken:website tracer: ++ queue handler hooks/relations/http/requires.py:15:broken:apiserver tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/apt.py:50:ensure_package_status tracer: ++ queue handler reactive/load_balancer.py:156:install_load_balancer tracer: ++ queue handler reactive/load_balancer.py:230:set_nginx_version tracer: ++ queue handler reactive/load_balancer.py:276:provide_lb_consumers tracer: ++ queue handler reactive/load_balancer.py:76:request_server_certificates tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2025-04-18 05:03:30 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.default.nagios_context 2025-04-18 05:03:30 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.default.nagios_servicegroups 2025-04-18 05:03:30 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.default.extra_packages 2025-04-18 05:03:30 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.set.package_status 2025-04-18 05:03:30 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.default.package_status 2025-04-18 05:03:30 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.default.install_sources 2025-04-18 05:03:30 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.default.install_keys 2025-04-18 05:03:30 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.set.port 2025-04-18 05:03:30 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.default.port 2025-04-18 05:03:30 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.set.host 2025-04-18 05:03:30 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.default.host 2025-04-18 05:03:30 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.default.ha-cluster-vip 2025-04-18 05:03:30 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.default.ha-cluster-dns 2025-04-18 05:03:30 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.default.extra_sans 2025-04-18 05:03:30 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.set.proxy_read_timeout 2025-04-18 05:03:30 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.default.proxy_read_timeout 2025-04-18 05:03:30 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.default.loadbalancer-ips 2025-04-18 05:03:30 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Initializing Leadership Layer (is leader) 2025-04-18 05:03:30 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Initializing Apt Layer 2025-04-18 05:03:30 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer> tracer: starting handler dispatch, 46 flags set tracer: set flag apt.installed.nginx-full tracer: set flag certificates.available tracer: set flag certificates.batch.cert.available tracer: set flag certificates.ca.available tracer: set flag certificates.certs.available tracer: set flag certificates.client.cert.available tracer: set flag certificates.server.cert.available tracer: set flag certificates.server.certs.available tracer: set flag certificates.server.certs.changed tracer: set flag config.default.extra_packages tracer: set flag config.default.extra_sans tracer: set flag config.default.ha-cluster-dns tracer: set flag config.default.ha-cluster-vip tracer: set flag config.default.host tracer: set flag config.default.install_keys tracer: set flag config.default.install_sources tracer: set flag config.default.loadbalancer-ips tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.package_status tracer: set flag config.default.port tracer: set flag config.default.proxy_read_timeout tracer: set flag config.set.host tracer: set flag config.set.nagios_context tracer: set flag config.set.package_status tracer: set flag config.set.port tracer: set flag config.set.proxy_read_timeout tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.kubeapi-load-balancer_0.server.cert tracer: set flag endpoint.certificates.changed.kubeapi-load-balancer_0.server.key tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag endpoint.lb-consumers.created tracer: set flag endpoint.lb-consumers.joined tracer: set flag leadership.is_leader tracer: set flag nginx.available tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca_installed tracer: set flag tls_client.certs.saved tracer: set flag tls_client.server.cert.10.0.0.48.changed tracer: set flag tls_client.server.certs.changed 2025-04-18 05:03:30 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: hooks phase, 0 handlers queued 2025-04-18 05:03:30 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer> tracer: main dispatch loop, 11 handlers queued tracer: ++ queue handler hooks/relations/http/provides.py:15:broken:website tracer: ++ queue handler hooks/relations/http/requires.py:15:broken:apiserver tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/apt.py:50:ensure_package_status tracer: ++ queue handler reactive/load_balancer.py:156:install_load_balancer tracer: ++ queue handler reactive/load_balancer.py:230:set_nginx_version tracer: ++ queue handler reactive/load_balancer.py:276:provide_lb_consumers tracer: ++ queue handler reactive/load_balancer.py:76:request_server_certificates tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2025-04-18 05:03:30 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Invoking reactive handler: reactive/apt.py:50:ensure_package_status 2025-04-18 05:03:30 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Invoking reactive handler: reactive/load_balancer.py:76:request_server_certificates 2025-04-18 05:03:31 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Invoking reactive handler: reactive/load_balancer.py:156:install_load_balancer 2025-04-18 05:03:31 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: status-set: maintenance: Configuring site apilb 2025-04-18 05:03:31 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Writing file /etc/nginx/sites-available/apilb root:root 444 2025-04-18 05:03:31 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Wrote vhost config {'host': '127.0.0.1', 'port': 443, 'servers': {443: {('10.0.0.48', 6443)}, 6443: set()}, 'server_certificate': '/srv/kubernetes/server.crt', 'server_key': '/srv/kubernetes/server.key', 'proxy_read_timeout': 600} to apilb.conf 2025-04-18 05:03:31 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-changed logger.go:60 nginx.service is not active, cannot reload. 2025-04-18 05:03:31 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-changed logger.go:60 Job for nginx.service failed because the control process exited with error code. 2025-04-18 05:03:31 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-changed logger.go:60 See "systemctl status nginx.service" and "journalctl -xe" for details. 2025-04-18 05:03:31 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Invoking reactive handler: reactive/load_balancer.py:230:set_nginx_version 2025-04-18 05:03:31 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Invoking reactive handler: reactive/load_balancer.py:276:provide_lb_consumers 2025-04-18 05:03:31 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Invoking reactive handler: reactive/tls_client.py:18:store_ca 2025-04-18 05:03:31 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Invoking reactive handler: reactive/tls_client.py:44:store_server 2025-04-18 05:03:31 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Invoking reactive handler: reactive/tls_client.py:71:store_client 2025-04-18 05:03:31 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Invoking reactive handler: hooks/relations/http/requires.py:15:broken:apiserver 2025-04-18 05:03:31 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Invoking reactive handler: hooks/relations/http/provides.py:15:broken:website 2025-04-18 05:03:31 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2025-04-18 05:03:31 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: cleared flag certificates.server.certs.changed 2025-04-18 05:03:31 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: status-set: active: Loadbalancer ready. 2025-04-18 05:03:31 INFO juju.worker.uniter.operation runhook.go:159 ran "lb-consumers-relation-changed" hook (via explicit, bespoke hook script) 2025-04-18 05:03:31 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (6; app: kubernetes-control-plane) hook" for kubeapi-load-balancer/0 2025-04-18 05:03:31 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2025-04-18 05:03:31 DEBUG juju.machinelock machinelock.go:186 machine lock released for kubeapi-load-balancer/0 uniter (run relation-changed (6; app: kubernetes-control-plane) hook) 2025-04-18 05:03:31 DEBUG juju.worker.uniter.operation executor.go:121 lock released for kubeapi-load-balancer/0 2025-04-18 05:03:31 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2025-04-18 05:03:31 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 12 2025-04-18 05:03:31 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (12; unit: easyrsa/0) hook for kubeapi-load-balancer/0 2025-04-18 05:03:31 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for kubeapi-load-balancer/0 uniter (run relation-changed (12; unit: easyrsa/0) hook) 2025-04-18 05:03:40 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for kubeapi-load-balancer/0 uniter (run relation-changed (12; unit: easyrsa/0) hook) 2025-04-18 05:03:40 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (12; unit: easyrsa/0) hook" for kubeapi-load-balancer/0 2025-04-18 05:03:40 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (12; unit: easyrsa/0) hook" for kubeapi-load-balancer/0 2025-04-18 05:03:40 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running certificates-relation-changed hook for easyrsa/0 2025-04-18 05:03:40 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-kubeapi-load-balancer-0/agent.socket } 2025-04-18 05:03:41 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Reactive main running for hook certificates-relation-changed 2025-04-18 05:03:41 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/http/provides.py:15:broken:website tracer: ++ queue handler hooks/relations/http/requires.py:15:broken:apiserver tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/apt.py:50:ensure_package_status tracer: ++ queue handler reactive/load_balancer.py:156:install_load_balancer tracer: ++ queue handler reactive/load_balancer.py:230:set_nginx_version tracer: ++ queue handler reactive/load_balancer.py:276:provide_lb_consumers tracer: ++ queue handler reactive/load_balancer.py:76:request_server_certificates tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2025-04-18 05:03:41 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.nagios_context 2025-04-18 05:03:41 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.nagios_servicegroups 2025-04-18 05:03:41 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.extra_packages 2025-04-18 05:03:41 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.set.package_status 2025-04-18 05:03:41 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.package_status 2025-04-18 05:03:41 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.install_sources 2025-04-18 05:03:41 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.install_keys 2025-04-18 05:03:41 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.set.port 2025-04-18 05:03:41 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.port 2025-04-18 05:03:41 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.set.host 2025-04-18 05:03:41 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.host 2025-04-18 05:03:41 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.ha-cluster-vip 2025-04-18 05:03:41 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.ha-cluster-dns 2025-04-18 05:03:41 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.extra_sans 2025-04-18 05:03:41 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.set.proxy_read_timeout 2025-04-18 05:03:41 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.proxy_read_timeout 2025-04-18 05:03:41 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.loadbalancer-ips 2025-04-18 05:03:41 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Initializing Leadership Layer (is leader) 2025-04-18 05:03:41 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Initializing Apt Layer 2025-04-18 05:03:41 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer> tracer: starting handler dispatch, 45 flags set tracer: set flag apt.installed.nginx-full tracer: set flag certificates.available tracer: set flag certificates.batch.cert.available tracer: set flag certificates.ca.available tracer: set flag certificates.certs.available tracer: set flag certificates.client.cert.available tracer: set flag certificates.server.cert.available tracer: set flag certificates.server.certs.available tracer: set flag config.default.extra_packages tracer: set flag config.default.extra_sans tracer: set flag config.default.ha-cluster-dns tracer: set flag config.default.ha-cluster-vip tracer: set flag config.default.host tracer: set flag config.default.install_keys tracer: set flag config.default.install_sources tracer: set flag config.default.loadbalancer-ips tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.package_status tracer: set flag config.default.port tracer: set flag config.default.proxy_read_timeout tracer: set flag config.set.host tracer: set flag config.set.nagios_context tracer: set flag config.set.package_status tracer: set flag config.set.port tracer: set flag config.set.proxy_read_timeout tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.kubeapi-load-balancer_0.server.cert tracer: set flag endpoint.certificates.changed.kubeapi-load-balancer_0.server.key tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag endpoint.lb-consumers.created tracer: set flag endpoint.lb-consumers.joined tracer: set flag leadership.is_leader tracer: set flag nginx.available tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca_installed tracer: set flag tls_client.certs.saved tracer: set flag tls_client.server.cert.10.0.0.48.changed tracer: set flag tls_client.server.certs.changed 2025-04-18 05:03:41 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: hooks phase, 0 handlers queued 2025-04-18 05:03:41 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer> tracer: main dispatch loop, 11 handlers queued tracer: ++ queue handler hooks/relations/http/provides.py:15:broken:website tracer: ++ queue handler hooks/relations/http/requires.py:15:broken:apiserver tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/apt.py:50:ensure_package_status tracer: ++ queue handler reactive/load_balancer.py:156:install_load_balancer tracer: ++ queue handler reactive/load_balancer.py:230:set_nginx_version tracer: ++ queue handler reactive/load_balancer.py:276:provide_lb_consumers tracer: ++ queue handler reactive/load_balancer.py:76:request_server_certificates tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2025-04-18 05:03:41 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Invoking reactive handler: reactive/apt.py:50:ensure_package_status 2025-04-18 05:03:41 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Invoking reactive handler: reactive/load_balancer.py:76:request_server_certificates 2025-04-18 05:03:41 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Invoking reactive handler: reactive/load_balancer.py:156:install_load_balancer 2025-04-18 05:03:41 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: status-set: maintenance: Configuring site apilb 2025-04-18 05:03:41 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Writing file /etc/nginx/sites-available/apilb root:root 444 2025-04-18 05:03:41 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Wrote vhost config {'host': '127.0.0.1', 'port': 443, 'servers': {443: {('10.0.0.48', 6443)}, 6443: set()}, 'server_certificate': '/srv/kubernetes/server.crt', 'server_key': '/srv/kubernetes/server.key', 'proxy_read_timeout': 600} to apilb.conf 2025-04-18 05:03:41 WARNING unit.kubeapi-load-balancer/0.certificates-relation-changed logger.go:60 nginx.service is not active, cannot reload. 2025-04-18 05:03:41 WARNING unit.kubeapi-load-balancer/0.certificates-relation-changed logger.go:60 Job for nginx.service failed because the control process exited with error code. 2025-04-18 05:03:41 WARNING unit.kubeapi-load-balancer/0.certificates-relation-changed logger.go:60 See "systemctl status nginx.service" and "journalctl -xe" for details. 2025-04-18 05:03:41 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Invoking reactive handler: reactive/load_balancer.py:230:set_nginx_version 2025-04-18 05:03:41 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Invoking reactive handler: reactive/load_balancer.py:276:provide_lb_consumers 2025-04-18 05:03:41 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Invoking reactive handler: reactive/tls_client.py:18:store_ca 2025-04-18 05:03:41 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Invoking reactive handler: reactive/tls_client.py:44:store_server 2025-04-18 05:03:41 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Invoking reactive handler: reactive/tls_client.py:71:store_client 2025-04-18 05:03:41 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Invoking reactive handler: hooks/relations/http/requires.py:15:broken:apiserver 2025-04-18 05:03:41 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Invoking reactive handler: hooks/relations/http/provides.py:15:broken:website 2025-04-18 05:03:41 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2025-04-18 05:03:41 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: status-set: active: Loadbalancer ready. 2025-04-18 05:03:42 INFO juju.worker.uniter.operation runhook.go:159 ran "certificates-relation-changed" hook (via explicit, bespoke hook script) 2025-04-18 05:03:42 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (12; unit: easyrsa/0) hook" for kubeapi-load-balancer/0 2025-04-18 05:03:42 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2025-04-18 05:03:42 DEBUG juju.machinelock machinelock.go:186 machine lock released for kubeapi-load-balancer/0 uniter (run relation-changed (12; unit: easyrsa/0) hook) 2025-04-18 05:03:42 DEBUG juju.worker.uniter.operation executor.go:121 lock released for kubeapi-load-balancer/0 2025-04-18 05:03:42 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2025-04-18 05:03:42 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-joined (6; unit: kubernetes-control-plane/0) hook for kubeapi-load-balancer/0 2025-04-18 05:03:42 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for kubeapi-load-balancer/0 uniter (run relation-joined (6; unit: kubernetes-control-plane/0) hook) 2025-04-18 05:03:49 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for kubeapi-load-balancer/0 uniter (run relation-joined (6; unit: kubernetes-control-plane/0) hook) 2025-04-18 05:03:49 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-joined (6; unit: kubernetes-control-plane/0) hook" for kubeapi-load-balancer/0 2025-04-18 05:03:49 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-joined (6; unit: kubernetes-control-plane/0) hook" for kubeapi-load-balancer/0 2025-04-18 05:03:49 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running lb-consumers-relation-joined hook for kubernetes-control-plane/0 2025-04-18 05:03:50 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-kubeapi-load-balancer-0/agent.socket } 2025-04-18 05:03:50 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Reactive main running for hook lb-consumers-relation-joined 2025-04-18 05:03:50 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer> tracer: set flag endpoint.lb-consumers.changed tracer: ++ queue handler hooks/relations/http/provides.py:15:broken:website tracer: ++ queue handler hooks/relations/http/requires.py:15:broken:apiserver tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/apt.py:50:ensure_package_status tracer: ++ queue handler reactive/load_balancer.py:156:install_load_balancer tracer: ++ queue handler reactive/load_balancer.py:230:set_nginx_version tracer: ++ queue handler reactive/load_balancer.py:276:provide_lb_consumers tracer: ++ queue handler reactive/load_balancer.py:76:request_server_certificates tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2025-04-18 05:03:50 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag endpoint.lb-consumers.requests_changed 2025-04-18 05:03:50 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.set.nagios_context 2025-04-18 05:03:50 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.default.nagios_context 2025-04-18 05:03:50 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.default.nagios_servicegroups 2025-04-18 05:03:50 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.default.extra_packages 2025-04-18 05:03:50 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.set.package_status 2025-04-18 05:03:50 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.default.package_status 2025-04-18 05:03:50 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.default.install_sources 2025-04-18 05:03:50 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.default.install_keys 2025-04-18 05:03:50 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.set.port 2025-04-18 05:03:50 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.default.port 2025-04-18 05:03:50 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.set.host 2025-04-18 05:03:50 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.default.host 2025-04-18 05:03:50 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.default.ha-cluster-vip 2025-04-18 05:03:50 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.default.ha-cluster-dns 2025-04-18 05:03:50 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.default.extra_sans 2025-04-18 05:03:50 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.set.proxy_read_timeout 2025-04-18 05:03:50 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.default.proxy_read_timeout 2025-04-18 05:03:50 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.default.loadbalancer-ips 2025-04-18 05:03:50 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Initializing Leadership Layer (is leader) 2025-04-18 05:03:50 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Initializing Apt Layer 2025-04-18 05:03:50 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer> tracer: starting handler dispatch, 47 flags set tracer: set flag apt.installed.nginx-full tracer: set flag certificates.available tracer: set flag certificates.batch.cert.available tracer: set flag certificates.ca.available tracer: set flag certificates.certs.available tracer: set flag certificates.client.cert.available tracer: set flag certificates.server.cert.available tracer: set flag certificates.server.certs.available tracer: set flag config.default.extra_packages tracer: set flag config.default.extra_sans tracer: set flag config.default.ha-cluster-dns tracer: set flag config.default.ha-cluster-vip tracer: set flag config.default.host tracer: set flag config.default.install_keys tracer: set flag config.default.install_sources tracer: set flag config.default.loadbalancer-ips tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.package_status tracer: set flag config.default.port tracer: set flag config.default.proxy_read_timeout tracer: set flag config.set.host tracer: set flag config.set.nagios_context tracer: set flag config.set.package_status tracer: set flag config.set.port tracer: set flag config.set.proxy_read_timeout tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.kubeapi-load-balancer_0.server.cert tracer: set flag endpoint.certificates.changed.kubeapi-load-balancer_0.server.key tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag endpoint.lb-consumers.changed tracer: set flag endpoint.lb-consumers.created tracer: set flag endpoint.lb-consumers.joined tracer: set flag endpoint.lb-consumers.requests_changed tracer: set flag leadership.is_leader tracer: set flag nginx.available tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca_installed tracer: set flag tls_client.certs.saved tracer: set flag tls_client.server.cert.10.0.0.48.changed tracer: set flag tls_client.server.certs.changed 2025-04-18 05:03:50 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: hooks phase, 0 handlers queued 2025-04-18 05:03:50 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer> tracer: main dispatch loop, 11 handlers queued tracer: ++ queue handler hooks/relations/http/provides.py:15:broken:website tracer: ++ queue handler hooks/relations/http/requires.py:15:broken:apiserver tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/apt.py:50:ensure_package_status tracer: ++ queue handler reactive/load_balancer.py:156:install_load_balancer tracer: ++ queue handler reactive/load_balancer.py:230:set_nginx_version tracer: ++ queue handler reactive/load_balancer.py:276:provide_lb_consumers tracer: ++ queue handler reactive/load_balancer.py:76:request_server_certificates tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2025-04-18 05:03:50 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Invoking reactive handler: reactive/apt.py:50:ensure_package_status 2025-04-18 05:03:50 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Invoking reactive handler: reactive/load_balancer.py:76:request_server_certificates 2025-04-18 05:03:50 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Invoking reactive handler: reactive/load_balancer.py:156:install_load_balancer 2025-04-18 05:03:50 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: status-set: maintenance: Configuring site apilb 2025-04-18 05:03:50 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Writing file /etc/nginx/sites-available/apilb root:root 444 2025-04-18 05:03:50 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Wrote vhost config {'host': '127.0.0.1', 'port': 443, 'servers': {443: {('10.0.0.48', 6443)}, 6443: {('10.0.0.48', 6443)}}, 'server_certificate': '/srv/kubernetes/server.crt', 'server_key': '/srv/kubernetes/server.key', 'proxy_read_timeout': 600} to apilb.conf 2025-04-18 05:03:50 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-joined logger.go:60 nginx.service is not active, cannot reload. 2025-04-18 05:03:50 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Invoking reactive handler: reactive/load_balancer.py:230:set_nginx_version 2025-04-18 05:03:50 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Invoking reactive handler: reactive/load_balancer.py:276:provide_lb_consumers 2025-04-18 05:03:50 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: cleared flag endpoint.lb-consumers.requests_changed 2025-04-18 05:03:50 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Invoking reactive handler: reactive/tls_client.py:18:store_ca 2025-04-18 05:03:51 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Invoking reactive handler: reactive/tls_client.py:44:store_server 2025-04-18 05:03:51 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Invoking reactive handler: reactive/tls_client.py:71:store_client 2025-04-18 05:03:51 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Invoking reactive handler: hooks/relations/http/requires.py:15:broken:apiserver 2025-04-18 05:03:51 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Invoking reactive handler: hooks/relations/http/provides.py:15:broken:website 2025-04-18 05:03:51 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2025-04-18 05:03:51 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: status-set: active: Loadbalancer ready. 2025-04-18 05:03:51 INFO juju.worker.uniter.operation runhook.go:159 ran "lb-consumers-relation-joined" hook (via explicit, bespoke hook script) 2025-04-18 05:03:51 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-joined (6; unit: kubernetes-control-plane/0) hook" for kubeapi-load-balancer/0 2025-04-18 05:03:51 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2025-04-18 05:03:51 DEBUG juju.machinelock machinelock.go:186 machine lock released for kubeapi-load-balancer/0 uniter (run relation-joined (6; unit: kubernetes-control-plane/0) hook) 2025-04-18 05:03:51 DEBUG juju.worker.uniter.operation executor.go:121 lock released for kubeapi-load-balancer/0 2025-04-18 05:03:51 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2025-04-18 05:03:51 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (5; unit: kubernetes-control-plane/0) hook for kubeapi-load-balancer/0 2025-04-18 05:03:51 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for kubeapi-load-balancer/0 uniter (run relation-changed (5; unit: kubernetes-control-plane/0) hook) 2025-04-18 05:04:00 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for kubeapi-load-balancer/0 uniter (run relation-changed (5; unit: kubernetes-control-plane/0) hook) 2025-04-18 05:04:00 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (5; unit: kubernetes-control-plane/0) hook" for kubeapi-load-balancer/0 2025-04-18 05:04:00 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (5; unit: kubernetes-control-plane/0) hook" for kubeapi-load-balancer/0 2025-04-18 05:04:00 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running lb-consumers-relation-changed hook for kubernetes-control-plane/0 2025-04-18 05:04:00 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-kubeapi-load-balancer-0/agent.socket } 2025-04-18 05:04:01 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: Reactive main running for hook lb-consumers-relation-changed 2025-04-18 05:04:01 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer> tracer: cleared flag endpoint.lb-consumers.changed tracer: ++ queue handler hooks/relations/http/provides.py:15:broken:website tracer: ++ queue handler hooks/relations/http/requires.py:15:broken:apiserver tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/apt.py:50:ensure_package_status tracer: ++ queue handler reactive/load_balancer.py:156:install_load_balancer tracer: ++ queue handler reactive/load_balancer.py:230:set_nginx_version tracer: ++ queue handler reactive/load_balancer.py:276:provide_lb_consumers tracer: ++ queue handler reactive/load_balancer.py:76:request_server_certificates tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2025-04-18 05:04:01 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.set.nagios_context 2025-04-18 05:04:01 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.default.nagios_context 2025-04-18 05:04:01 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.default.nagios_servicegroups 2025-04-18 05:04:01 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.default.extra_packages 2025-04-18 05:04:01 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.set.package_status 2025-04-18 05:04:01 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.default.package_status 2025-04-18 05:04:01 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.default.install_sources 2025-04-18 05:04:01 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.default.install_keys 2025-04-18 05:04:01 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.set.port 2025-04-18 05:04:01 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.default.port 2025-04-18 05:04:01 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.set.host 2025-04-18 05:04:01 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.default.host 2025-04-18 05:04:01 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.default.ha-cluster-vip 2025-04-18 05:04:01 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.default.ha-cluster-dns 2025-04-18 05:04:01 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.default.extra_sans 2025-04-18 05:04:01 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.set.proxy_read_timeout 2025-04-18 05:04:01 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.default.proxy_read_timeout 2025-04-18 05:04:01 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.default.loadbalancer-ips 2025-04-18 05:04:01 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: Initializing Leadership Layer (is leader) 2025-04-18 05:04:01 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: Initializing Apt Layer 2025-04-18 05:04:01 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer> tracer: starting handler dispatch, 45 flags set tracer: set flag apt.installed.nginx-full tracer: set flag certificates.available tracer: set flag certificates.batch.cert.available tracer: set flag certificates.ca.available tracer: set flag certificates.certs.available tracer: set flag certificates.client.cert.available tracer: set flag certificates.server.cert.available tracer: set flag certificates.server.certs.available tracer: set flag config.default.extra_packages tracer: set flag config.default.extra_sans tracer: set flag config.default.ha-cluster-dns tracer: set flag config.default.ha-cluster-vip tracer: set flag config.default.host tracer: set flag config.default.install_keys tracer: set flag config.default.install_sources tracer: set flag config.default.loadbalancer-ips tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.package_status tracer: set flag config.default.port tracer: set flag config.default.proxy_read_timeout tracer: set flag config.set.host tracer: set flag config.set.nagios_context tracer: set flag config.set.package_status tracer: set flag config.set.port tracer: set flag config.set.proxy_read_timeout tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.kubeapi-load-balancer_0.server.cert tracer: set flag endpoint.certificates.changed.kubeapi-load-balancer_0.server.key tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag endpoint.lb-consumers.created tracer: set flag endpoint.lb-consumers.joined tracer: set flag leadership.is_leader tracer: set flag nginx.available tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca_installed tracer: set flag tls_client.certs.saved tracer: set flag tls_client.server.cert.10.0.0.48.changed tracer: set flag tls_client.server.certs.changed 2025-04-18 05:04:01 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: hooks phase, 0 handlers queued 2025-04-18 05:04:01 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer> tracer: main dispatch loop, 11 handlers queued tracer: ++ queue handler hooks/relations/http/provides.py:15:broken:website tracer: ++ queue handler hooks/relations/http/requires.py:15:broken:apiserver tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/apt.py:50:ensure_package_status tracer: ++ queue handler reactive/load_balancer.py:156:install_load_balancer tracer: ++ queue handler reactive/load_balancer.py:230:set_nginx_version tracer: ++ queue handler reactive/load_balancer.py:276:provide_lb_consumers tracer: ++ queue handler reactive/load_balancer.py:76:request_server_certificates tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2025-04-18 05:04:01 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: Invoking reactive handler: reactive/apt.py:50:ensure_package_status 2025-04-18 05:04:01 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: Invoking reactive handler: reactive/load_balancer.py:76:request_server_certificates 2025-04-18 05:04:01 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: Invoking reactive handler: reactive/load_balancer.py:156:install_load_balancer 2025-04-18 05:04:01 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: status-set: maintenance: Configuring site apilb 2025-04-18 05:04:01 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: Writing file /etc/nginx/sites-available/apilb root:root 444 2025-04-18 05:04:01 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: Wrote vhost config {'host': '127.0.0.1', 'port': 443, 'servers': {443: {('10.0.0.48', 6443)}, 6443: {('10.0.0.48', 6443)}}, 'server_certificate': '/srv/kubernetes/server.crt', 'server_key': '/srv/kubernetes/server.key', 'proxy_read_timeout': 600} to apilb.conf 2025-04-18 05:04:01 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: Invoking reactive handler: reactive/load_balancer.py:230:set_nginx_version 2025-04-18 05:04:01 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: Invoking reactive handler: reactive/load_balancer.py:276:provide_lb_consumers 2025-04-18 05:04:01 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: Invoking reactive handler: reactive/tls_client.py:18:store_ca 2025-04-18 05:04:01 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: Invoking reactive handler: reactive/tls_client.py:44:store_server 2025-04-18 05:04:01 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: Invoking reactive handler: reactive/tls_client.py:71:store_client 2025-04-18 05:04:01 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: Invoking reactive handler: hooks/relations/http/requires.py:15:broken:apiserver 2025-04-18 05:04:01 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: Invoking reactive handler: hooks/relations/http/provides.py:15:broken:website 2025-04-18 05:04:01 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2025-04-18 05:04:01 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: status-set: active: Loadbalancer ready. 2025-04-18 05:04:02 INFO juju.worker.uniter.operation runhook.go:159 ran "lb-consumers-relation-changed" hook (via explicit, bespoke hook script) 2025-04-18 05:04:02 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (5; unit: kubernetes-control-plane/0) hook" for kubeapi-load-balancer/0 2025-04-18 05:04:02 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2025-04-18 05:04:02 DEBUG juju.machinelock machinelock.go:186 machine lock released for kubeapi-load-balancer/0 uniter (run relation-changed (5; unit: kubernetes-control-plane/0) hook) 2025-04-18 05:04:02 DEBUG juju.worker.uniter.operation executor.go:121 lock released for kubeapi-load-balancer/0 2025-04-18 05:04:02 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2025-04-18 05:04:02 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-control-plane/0" already joined relation 5 2025-04-18 05:04:02 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (6; unit: kubernetes-control-plane/0) hook for kubeapi-load-balancer/0 2025-04-18 05:04:02 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for kubeapi-load-balancer/0 uniter (run relation-changed (6; unit: kubernetes-control-plane/0) hook) 2025-04-18 05:04:13 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for kubeapi-load-balancer/0 uniter (run relation-changed (6; unit: kubernetes-control-plane/0) hook) 2025-04-18 05:04:13 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (6; unit: kubernetes-control-plane/0) hook" for kubeapi-load-balancer/0 2025-04-18 05:04:13 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (6; unit: kubernetes-control-plane/0) hook" for kubeapi-load-balancer/0 2025-04-18 05:04:13 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-kubeapi-load-balancer-0/agent.socket } 2025-04-18 05:04:13 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Reactive main running for hook lb-consumers-relation-changed 2025-04-18 05:04:13 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/http/provides.py:15:broken:website tracer: ++ queue handler hooks/relations/http/requires.py:15:broken:apiserver tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/apt.py:50:ensure_package_status tracer: ++ queue handler reactive/load_balancer.py:156:install_load_balancer tracer: ++ queue handler reactive/load_balancer.py:230:set_nginx_version tracer: ++ queue handler reactive/load_balancer.py:276:provide_lb_consumers tracer: ++ queue handler reactive/load_balancer.py:76:request_server_certificates tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2025-04-18 05:04:13 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.default.nagios_context 2025-04-18 05:04:13 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.default.nagios_servicegroups 2025-04-18 05:04:13 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.default.extra_packages 2025-04-18 05:04:13 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.set.package_status 2025-04-18 05:04:13 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.default.package_status 2025-04-18 05:04:13 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.default.install_sources 2025-04-18 05:04:13 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.default.install_keys 2025-04-18 05:04:13 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.set.port 2025-04-18 05:04:13 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.default.port 2025-04-18 05:04:13 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.set.host 2025-04-18 05:04:13 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.default.host 2025-04-18 05:04:13 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.default.ha-cluster-vip 2025-04-18 05:04:13 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.default.ha-cluster-dns 2025-04-18 05:04:13 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.default.extra_sans 2025-04-18 05:04:13 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.set.proxy_read_timeout 2025-04-18 05:04:13 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.default.proxy_read_timeout 2025-04-18 05:04:13 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.default.loadbalancer-ips 2025-04-18 05:04:13 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Initializing Leadership Layer (is leader) 2025-04-18 05:04:13 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Initializing Apt Layer 2025-04-18 05:04:13 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer> tracer: starting handler dispatch, 45 flags set tracer: set flag apt.installed.nginx-full tracer: set flag certificates.available tracer: set flag certificates.batch.cert.available tracer: set flag certificates.ca.available tracer: set flag certificates.certs.available tracer: set flag certificates.client.cert.available tracer: set flag certificates.server.cert.available tracer: set flag certificates.server.certs.available tracer: set flag config.default.extra_packages tracer: set flag config.default.extra_sans tracer: set flag config.default.ha-cluster-dns tracer: set flag config.default.ha-cluster-vip tracer: set flag config.default.host tracer: set flag config.default.install_keys tracer: set flag config.default.install_sources tracer: set flag config.default.loadbalancer-ips tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.package_status tracer: set flag config.default.port tracer: set flag config.default.proxy_read_timeout tracer: set flag config.set.host tracer: set flag config.set.nagios_context tracer: set flag config.set.package_status tracer: set flag config.set.port tracer: set flag config.set.proxy_read_timeout tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.kubeapi-load-balancer_0.server.cert tracer: set flag endpoint.certificates.changed.kubeapi-load-balancer_0.server.key tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag endpoint.lb-consumers.created tracer: set flag endpoint.lb-consumers.joined tracer: set flag leadership.is_leader tracer: set flag nginx.available tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca_installed tracer: set flag tls_client.certs.saved tracer: set flag tls_client.server.cert.10.0.0.48.changed tracer: set flag tls_client.server.certs.changed 2025-04-18 05:04:13 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: hooks phase, 0 handlers queued 2025-04-18 05:04:13 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer> tracer: main dispatch loop, 11 handlers queued tracer: ++ queue handler hooks/relations/http/provides.py:15:broken:website tracer: ++ queue handler hooks/relations/http/requires.py:15:broken:apiserver tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/apt.py:50:ensure_package_status tracer: ++ queue handler reactive/load_balancer.py:156:install_load_balancer tracer: ++ queue handler reactive/load_balancer.py:230:set_nginx_version tracer: ++ queue handler reactive/load_balancer.py:276:provide_lb_consumers tracer: ++ queue handler reactive/load_balancer.py:76:request_server_certificates tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2025-04-18 05:04:13 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Invoking reactive handler: reactive/apt.py:50:ensure_package_status 2025-04-18 05:04:13 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Invoking reactive handler: reactive/load_balancer.py:76:request_server_certificates 2025-04-18 05:04:13 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Invoking reactive handler: reactive/load_balancer.py:156:install_load_balancer 2025-04-18 05:04:13 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: status-set: maintenance: Configuring site apilb 2025-04-18 05:04:13 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Writing file /etc/nginx/sites-available/apilb root:root 444 2025-04-18 05:04:13 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Wrote vhost config {'host': '127.0.0.1', 'port': 443, 'servers': {443: {('10.0.0.48', 6443)}, 6443: {('10.0.0.48', 6443)}}, 'server_certificate': '/srv/kubernetes/server.crt', 'server_key': '/srv/kubernetes/server.key', 'proxy_read_timeout': 600} to apilb.conf 2025-04-18 05:04:14 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Invoking reactive handler: reactive/load_balancer.py:230:set_nginx_version 2025-04-18 05:04:14 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Invoking reactive handler: reactive/load_balancer.py:276:provide_lb_consumers 2025-04-18 05:04:14 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Invoking reactive handler: reactive/tls_client.py:18:store_ca 2025-04-18 05:04:14 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Invoking reactive handler: reactive/tls_client.py:44:store_server 2025-04-18 05:04:14 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Invoking reactive handler: reactive/tls_client.py:71:store_client 2025-04-18 05:04:14 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Invoking reactive handler: hooks/relations/http/requires.py:15:broken:apiserver 2025-04-18 05:04:14 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Invoking reactive handler: hooks/relations/http/provides.py:15:broken:website 2025-04-18 05:04:14 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2025-04-18 05:04:14 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: status-set: active: Loadbalancer ready. 2025-04-18 05:04:14 INFO juju.worker.uniter.operation runhook.go:159 ran "lb-consumers-relation-changed" hook (via explicit, bespoke hook script) 2025-04-18 05:04:14 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (6; unit: kubernetes-control-plane/0) hook" for kubeapi-load-balancer/0 2025-04-18 05:04:14 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2025-04-18 05:04:14 DEBUG juju.machinelock machinelock.go:186 machine lock released for kubeapi-load-balancer/0 uniter (run relation-changed (6; unit: kubernetes-control-plane/0) hook) 2025-04-18 05:04:14 DEBUG juju.worker.uniter.operation executor.go:121 lock released for kubeapi-load-balancer/0 2025-04-18 05:04:14 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2025-04-18 05:04:14 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 12 2025-04-18 05:04:14 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-control-plane/0" already joined relation 5 2025-04-18 05:04:14 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-control-plane/0" already joined relation 6 2025-04-18 05:04:14 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 2025-04-18 05:04:14 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2025-04-18 05:04:14 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-control-plane/0" already joined relation 6 2025-04-18 05:04:14 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 12 2025-04-18 05:04:14 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-control-plane/0" already joined relation 5 2025-04-18 05:06:20 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for kubeapi-load-balancer/0 2025-04-18 05:06:20 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2025-04-18 05:06:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-control-plane/0" already joined relation 5 2025-04-18 05:06:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-control-plane/0" already joined relation 6 2025-04-18 05:06:20 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 12 2025-04-18 05:06:20 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for kubeapi-load-balancer/0 2025-04-18 05:06:20 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for kubeapi-load-balancer/0 uniter (run update-status hook) 2025-04-18 05:06:21 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for kubeapi-load-balancer/0 uniter (run update-status hook) 2025-04-18 05:06:21 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for kubeapi-load-balancer/0 2025-04-18 05:06:21 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for kubeapi-load-balancer/0 2025-04-18 05:06:21 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-kubeapi-load-balancer-0/agent.socket } 2025-04-18 05:06:21 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Reactive main running for hook update-status 2025-04-18 05:06:21 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/http/provides.py:15:broken:website tracer: ++ queue handler hooks/relations/http/requires.py:15:broken:apiserver tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/apt.py:50:ensure_package_status tracer: ++ queue handler reactive/load_balancer.py:156:install_load_balancer tracer: ++ queue handler reactive/load_balancer.py:230:set_nginx_version tracer: ++ queue handler reactive/load_balancer.py:276:provide_lb_consumers tracer: ++ queue handler reactive/load_balancer.py:76:request_server_certificates tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2025-04-18 05:06:21 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.nagios_context 2025-04-18 05:06:21 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2025-04-18 05:06:21 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.extra_packages 2025-04-18 05:06:21 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.set.package_status 2025-04-18 05:06:21 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.package_status 2025-04-18 05:06:21 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.install_sources 2025-04-18 05:06:21 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.install_keys 2025-04-18 05:06:21 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.set.port 2025-04-18 05:06:21 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.port 2025-04-18 05:06:21 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.set.host 2025-04-18 05:06:21 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.host 2025-04-18 05:06:21 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.ha-cluster-vip 2025-04-18 05:06:21 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.ha-cluster-dns 2025-04-18 05:06:21 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.extra_sans 2025-04-18 05:06:21 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.set.proxy_read_timeout 2025-04-18 05:06:21 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.proxy_read_timeout 2025-04-18 05:06:21 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.loadbalancer-ips 2025-04-18 05:06:21 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Initializing Leadership Layer (is leader) 2025-04-18 05:06:21 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Initializing Apt Layer 2025-04-18 05:06:21 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer> tracer: starting handler dispatch, 45 flags set tracer: set flag apt.installed.nginx-full tracer: set flag certificates.available tracer: set flag certificates.batch.cert.available tracer: set flag certificates.ca.available tracer: set flag certificates.certs.available tracer: set flag certificates.client.cert.available tracer: set flag certificates.server.cert.available tracer: set flag certificates.server.certs.available tracer: set flag config.default.extra_packages tracer: set flag config.default.extra_sans tracer: set flag config.default.ha-cluster-dns tracer: set flag config.default.ha-cluster-vip tracer: set flag config.default.host tracer: set flag config.default.install_keys tracer: set flag config.default.install_sources tracer: set flag config.default.loadbalancer-ips tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.package_status tracer: set flag config.default.port tracer: set flag config.default.proxy_read_timeout tracer: set flag config.set.host tracer: set flag config.set.nagios_context tracer: set flag config.set.package_status tracer: set flag config.set.port tracer: set flag config.set.proxy_read_timeout tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.kubeapi-load-balancer_0.server.cert tracer: set flag endpoint.certificates.changed.kubeapi-load-balancer_0.server.key tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag endpoint.lb-consumers.created tracer: set flag endpoint.lb-consumers.joined tracer: set flag leadership.is_leader tracer: set flag nginx.available tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca_installed tracer: set flag tls_client.certs.saved tracer: set flag tls_client.server.cert.10.0.0.48.changed tracer: set flag tls_client.server.certs.changed 2025-04-18 05:06:21 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2025-04-18 05:06:21 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer> tracer: main dispatch loop, 11 handlers queued tracer: ++ queue handler hooks/relations/http/provides.py:15:broken:website tracer: ++ queue handler hooks/relations/http/requires.py:15:broken:apiserver tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/apt.py:50:ensure_package_status tracer: ++ queue handler reactive/load_balancer.py:156:install_load_balancer tracer: ++ queue handler reactive/load_balancer.py:230:set_nginx_version tracer: ++ queue handler reactive/load_balancer.py:276:provide_lb_consumers tracer: ++ queue handler reactive/load_balancer.py:76:request_server_certificates tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2025-04-18 05:06:21 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/apt.py:50:ensure_package_status 2025-04-18 05:06:21 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/load_balancer.py:76:request_server_certificates 2025-04-18 05:06:21 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/load_balancer.py:156:install_load_balancer 2025-04-18 05:06:21 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 status-set: maintenance: Configuring site apilb 2025-04-18 05:06:21 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 Writing file /etc/nginx/sites-available/apilb root:root 444 2025-04-18 05:06:21 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Wrote vhost config {'host': '127.0.0.1', 'port': 443, 'servers': {443: {('10.0.0.48', 6443)}, 6443: {('10.0.0.48', 6443)}}, 'server_certificate': '/srv/kubernetes/server.crt', 'server_key': '/srv/kubernetes/server.key', 'proxy_read_timeout': 600} to apilb.conf 2025-04-18 05:06:22 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/load_balancer.py:230:set_nginx_version 2025-04-18 05:06:22 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/load_balancer.py:276:provide_lb_consumers 2025-04-18 05:06:22 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:18:store_ca 2025-04-18 05:06:22 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:44:store_server 2025-04-18 05:06:22 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:71:store_client 2025-04-18 05:06:22 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/http/requires.py:15:broken:apiserver 2025-04-18 05:06:22 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/http/provides.py:15:broken:website 2025-04-18 05:06:22 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2025-04-18 05:06:22 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 status-set: active: Loadbalancer ready. 2025-04-18 05:06:22 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2025-04-18 05:06:22 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for kubeapi-load-balancer/0 2025-04-18 05:06:22 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2025-04-18 05:06:22 DEBUG juju.machinelock machinelock.go:186 machine lock released for kubeapi-load-balancer/0 uniter (run update-status hook) 2025-04-18 05:06:22 DEBUG juju.worker.uniter.operation executor.go:121 lock released for kubeapi-load-balancer/0 2025-04-18 05:06:22 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2025-04-18 05:06:22 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 12 2025-04-18 05:06:22 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-control-plane/0" already joined relation 5 2025-04-18 05:06:22 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-control-plane/0" already joined relation 6 2025-04-18 05:07:25 DEBUG juju.worker.metrics.collect manifold.go:293 recording metrics 2025-04-18 05:07:25 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-kubeapi-load-balancer-0/metrics-collect-agent.socket } 2025-04-18 05:07:25 WARNING unit.unit-kubeapi-load-balancer-0.collect-metrics logger.go:60 /var/lib/juju/agents/unit-kubeapi-load-balancer-0/charm/hooks/collect-metrics:43: YAMLLoadWarning: calling yaml.load() without Loader=... is deprecated, as the default Loader is unsafe. Please read https://msg.pyyaml.org/load for full details. 2025-04-18 05:07:25 WARNING unit.unit-kubeapi-load-balancer-0.collect-metrics logger.go:60 doc = yaml.load(f) 2025-04-18 05:07:25 DEBUG juju.worker.metrics.collect manifold.go:316 ran "collect-metrics" hook (via explicit, bespoke hook script) 2025-04-18 05:07:30 DEBUG juju.worker.meterstatus connected.go:93 got meter status change signal from watcher 2025-04-18 05:07:30 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for meterstatus (meter-status-changed) 2025-04-18 05:07:30 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for meterstatus (meter-status-changed) 2025-04-18 05:07:30 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-kubeapi-load-balancer-0/agent.socket } 2025-04-18 05:07:30 INFO juju.worker.meterstatus runner.go:89 skipped "meter-status-changed" hook (missing) 2025-04-18 05:07:30 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2025-04-18 05:07:30 DEBUG juju.machinelock machinelock.go:186 machine lock released for meterstatus (meter-status-changed) 2025-04-18 05:11:41 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for kubeapi-load-balancer/0 2025-04-18 05:11:41 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2025-04-18 05:11:41 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-control-plane/0" already joined relation 5 2025-04-18 05:11:41 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-control-plane/0" already joined relation 6 2025-04-18 05:11:41 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 12 2025-04-18 05:11:41 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for kubeapi-load-balancer/0 2025-04-18 05:11:41 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for kubeapi-load-balancer/0 uniter (run update-status hook) 2025-04-18 05:11:41 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for kubeapi-load-balancer/0 uniter (run update-status hook) 2025-04-18 05:11:41 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for kubeapi-load-balancer/0 2025-04-18 05:11:41 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for kubeapi-load-balancer/0 2025-04-18 05:11:41 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-kubeapi-load-balancer-0/agent.socket } 2025-04-18 05:11:41 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Reactive main running for hook update-status 2025-04-18 05:11:42 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/http/provides.py:15:broken:website tracer: ++ queue handler hooks/relations/http/requires.py:15:broken:apiserver tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/apt.py:50:ensure_package_status tracer: ++ queue handler reactive/load_balancer.py:156:install_load_balancer tracer: ++ queue handler reactive/load_balancer.py:230:set_nginx_version tracer: ++ queue handler reactive/load_balancer.py:276:provide_lb_consumers tracer: ++ queue handler reactive/load_balancer.py:76:request_server_certificates tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2025-04-18 05:11:42 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.nagios_context 2025-04-18 05:11:42 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2025-04-18 05:11:42 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.extra_packages 2025-04-18 05:11:42 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.set.package_status 2025-04-18 05:11:42 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.package_status 2025-04-18 05:11:42 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.install_sources 2025-04-18 05:11:42 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.install_keys 2025-04-18 05:11:42 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.set.port 2025-04-18 05:11:42 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.port 2025-04-18 05:11:42 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.set.host 2025-04-18 05:11:42 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.host 2025-04-18 05:11:42 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.ha-cluster-vip 2025-04-18 05:11:42 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.ha-cluster-dns 2025-04-18 05:11:42 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.extra_sans 2025-04-18 05:11:42 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.set.proxy_read_timeout 2025-04-18 05:11:42 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.proxy_read_timeout 2025-04-18 05:11:42 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.loadbalancer-ips 2025-04-18 05:11:42 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Initializing Leadership Layer (is leader) 2025-04-18 05:11:42 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Initializing Apt Layer 2025-04-18 05:11:42 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer> tracer: starting handler dispatch, 45 flags set tracer: set flag apt.installed.nginx-full tracer: set flag certificates.available tracer: set flag certificates.batch.cert.available tracer: set flag certificates.ca.available tracer: set flag certificates.certs.available tracer: set flag certificates.client.cert.available tracer: set flag certificates.server.cert.available tracer: set flag certificates.server.certs.available tracer: set flag config.default.extra_packages tracer: set flag config.default.extra_sans tracer: set flag config.default.ha-cluster-dns tracer: set flag config.default.ha-cluster-vip tracer: set flag config.default.host tracer: set flag config.default.install_keys tracer: set flag config.default.install_sources tracer: set flag config.default.loadbalancer-ips tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.package_status tracer: set flag config.default.port tracer: set flag config.default.proxy_read_timeout tracer: set flag config.set.host tracer: set flag config.set.nagios_context tracer: set flag config.set.package_status tracer: set flag config.set.port tracer: set flag config.set.proxy_read_timeout tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.kubeapi-load-balancer_0.server.cert tracer: set flag endpoint.certificates.changed.kubeapi-load-balancer_0.server.key tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag endpoint.lb-consumers.created tracer: set flag endpoint.lb-consumers.joined tracer: set flag leadership.is_leader tracer: set flag nginx.available tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca_installed tracer: set flag tls_client.certs.saved tracer: set flag tls_client.server.cert.10.0.0.48.changed tracer: set flag tls_client.server.certs.changed 2025-04-18 05:11:42 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2025-04-18 05:11:42 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer> tracer: main dispatch loop, 11 handlers queued tracer: ++ queue handler hooks/relations/http/provides.py:15:broken:website tracer: ++ queue handler hooks/relations/http/requires.py:15:broken:apiserver tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/apt.py:50:ensure_package_status tracer: ++ queue handler reactive/load_balancer.py:156:install_load_balancer tracer: ++ queue handler reactive/load_balancer.py:230:set_nginx_version tracer: ++ queue handler reactive/load_balancer.py:276:provide_lb_consumers tracer: ++ queue handler reactive/load_balancer.py:76:request_server_certificates tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2025-04-18 05:11:42 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/apt.py:50:ensure_package_status 2025-04-18 05:11:42 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/load_balancer.py:76:request_server_certificates 2025-04-18 05:11:42 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/load_balancer.py:156:install_load_balancer 2025-04-18 05:11:42 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 status-set: maintenance: Configuring site apilb 2025-04-18 05:11:42 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 Writing file /etc/nginx/sites-available/apilb root:root 444 2025-04-18 05:11:42 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Wrote vhost config {'host': '127.0.0.1', 'port': 443, 'servers': {443: {('10.0.0.48', 6443)}, 6443: {('10.0.0.48', 6443)}}, 'server_certificate': '/srv/kubernetes/server.crt', 'server_key': '/srv/kubernetes/server.key', 'proxy_read_timeout': 600} to apilb.conf 2025-04-18 05:11:42 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/load_balancer.py:230:set_nginx_version 2025-04-18 05:11:42 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/load_balancer.py:276:provide_lb_consumers 2025-04-18 05:11:42 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:18:store_ca 2025-04-18 05:11:42 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:44:store_server 2025-04-18 05:11:42 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:71:store_client 2025-04-18 05:11:42 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/http/requires.py:15:broken:apiserver 2025-04-18 05:11:42 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/http/provides.py:15:broken:website 2025-04-18 05:11:42 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2025-04-18 05:11:42 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 status-set: active: Loadbalancer ready. 2025-04-18 05:11:42 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2025-04-18 05:11:42 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for kubeapi-load-balancer/0 2025-04-18 05:11:42 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2025-04-18 05:11:42 DEBUG juju.machinelock machinelock.go:186 machine lock released for kubeapi-load-balancer/0 uniter (run update-status hook) 2025-04-18 05:11:42 DEBUG juju.worker.uniter.operation executor.go:121 lock released for kubeapi-load-balancer/0 2025-04-18 05:11:42 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2025-04-18 05:11:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-control-plane/0" already joined relation 6 2025-04-18 05:11:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 12 2025-04-18 05:11:42 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-control-plane/0" already joined relation 5 2025-04-18 05:12:48 DEBUG juju.worker.metrics.collect manifold.go:293 recording metrics 2025-04-18 05:12:48 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-kubeapi-load-balancer-0/metrics-collect-agent.socket } 2025-04-18 05:12:48 WARNING unit.unit-kubeapi-load-balancer-0.collect-metrics logger.go:60 /var/lib/juju/agents/unit-kubeapi-load-balancer-0/charm/hooks/collect-metrics:43: YAMLLoadWarning: calling yaml.load() without Loader=... is deprecated, as the default Loader is unsafe. Please read https://msg.pyyaml.org/load for full details. 2025-04-18 05:12:48 WARNING unit.unit-kubeapi-load-balancer-0.collect-metrics logger.go:60 doc = yaml.load(f) 2025-04-18 05:12:48 DEBUG juju.worker.metrics.collect manifold.go:316 ran "collect-metrics" hook (via explicit, bespoke hook script) 2025-04-18 05:17:09 DEBUG juju.worker.metrics.collect manifold.go:293 recording metrics 2025-04-18 05:17:09 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-kubeapi-load-balancer-0/metrics-collect-agent.socket } 2025-04-18 05:17:09 WARNING unit.unit-kubeapi-load-balancer-0.collect-metrics logger.go:60 /var/lib/juju/agents/unit-kubeapi-load-balancer-0/charm/hooks/collect-metrics:43: YAMLLoadWarning: calling yaml.load() without Loader=... is deprecated, as the default Loader is unsafe. Please read https://msg.pyyaml.org/load for full details. 2025-04-18 05:17:09 WARNING unit.unit-kubeapi-load-balancer-0.collect-metrics logger.go:60 doc = yaml.load(f) 2025-04-18 05:17:09 DEBUG juju.worker.metrics.collect manifold.go:316 ran "collect-metrics" hook (via explicit, bespoke hook script) 2025-04-18 05:17:17 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for kubeapi-load-balancer/0 2025-04-18 05:17:17 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2025-04-18 05:17:17 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-control-plane/0" already joined relation 6 2025-04-18 05:17:17 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 12 2025-04-18 05:17:17 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-control-plane/0" already joined relation 5 2025-04-18 05:17:17 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for kubeapi-load-balancer/0 2025-04-18 05:17:17 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for kubeapi-load-balancer/0 uniter (run update-status hook) 2025-04-18 05:17:17 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for kubeapi-load-balancer/0 uniter (run update-status hook) 2025-04-18 05:17:17 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for kubeapi-load-balancer/0 2025-04-18 05:17:17 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for kubeapi-load-balancer/0 2025-04-18 05:17:17 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-kubeapi-load-balancer-0/agent.socket } 2025-04-18 05:17:17 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Reactive main running for hook update-status 2025-04-18 05:17:17 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/http/provides.py:15:broken:website tracer: ++ queue handler hooks/relations/http/requires.py:15:broken:apiserver tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/apt.py:50:ensure_package_status tracer: ++ queue handler reactive/load_balancer.py:156:install_load_balancer tracer: ++ queue handler reactive/load_balancer.py:230:set_nginx_version tracer: ++ queue handler reactive/load_balancer.py:276:provide_lb_consumers tracer: ++ queue handler reactive/load_balancer.py:76:request_server_certificates tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2025-04-18 05:17:17 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.nagios_context 2025-04-18 05:17:17 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2025-04-18 05:17:17 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.extra_packages 2025-04-18 05:17:17 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.set.package_status 2025-04-18 05:17:17 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.package_status 2025-04-18 05:17:17 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.install_sources 2025-04-18 05:17:17 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.install_keys 2025-04-18 05:17:17 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.set.port 2025-04-18 05:17:17 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.port 2025-04-18 05:17:17 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.set.host 2025-04-18 05:17:17 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.host 2025-04-18 05:17:17 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.ha-cluster-vip 2025-04-18 05:17:17 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.ha-cluster-dns 2025-04-18 05:17:17 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.extra_sans 2025-04-18 05:17:17 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.set.proxy_read_timeout 2025-04-18 05:17:17 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.proxy_read_timeout 2025-04-18 05:17:17 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.loadbalancer-ips 2025-04-18 05:17:17 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Initializing Leadership Layer (is leader) 2025-04-18 05:17:17 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Initializing Apt Layer 2025-04-18 05:17:17 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer> tracer: starting handler dispatch, 45 flags set tracer: set flag apt.installed.nginx-full tracer: set flag certificates.available tracer: set flag certificates.batch.cert.available tracer: set flag certificates.ca.available tracer: set flag certificates.certs.available tracer: set flag certificates.client.cert.available tracer: set flag certificates.server.cert.available tracer: set flag certificates.server.certs.available tracer: set flag config.default.extra_packages tracer: set flag config.default.extra_sans tracer: set flag config.default.ha-cluster-dns tracer: set flag config.default.ha-cluster-vip tracer: set flag config.default.host tracer: set flag config.default.install_keys tracer: set flag config.default.install_sources tracer: set flag config.default.loadbalancer-ips tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.package_status tracer: set flag config.default.port tracer: set flag config.default.proxy_read_timeout tracer: set flag config.set.host tracer: set flag config.set.nagios_context tracer: set flag config.set.package_status tracer: set flag config.set.port tracer: set flag config.set.proxy_read_timeout tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.kubeapi-load-balancer_0.server.cert tracer: set flag endpoint.certificates.changed.kubeapi-load-balancer_0.server.key tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag endpoint.lb-consumers.created tracer: set flag endpoint.lb-consumers.joined tracer: set flag leadership.is_leader tracer: set flag nginx.available tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca_installed tracer: set flag tls_client.certs.saved tracer: set flag tls_client.server.cert.10.0.0.48.changed tracer: set flag tls_client.server.certs.changed 2025-04-18 05:17:17 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2025-04-18 05:17:17 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer> tracer: main dispatch loop, 11 handlers queued tracer: ++ queue handler hooks/relations/http/provides.py:15:broken:website tracer: ++ queue handler hooks/relations/http/requires.py:15:broken:apiserver tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/apt.py:50:ensure_package_status tracer: ++ queue handler reactive/load_balancer.py:156:install_load_balancer tracer: ++ queue handler reactive/load_balancer.py:230:set_nginx_version tracer: ++ queue handler reactive/load_balancer.py:276:provide_lb_consumers tracer: ++ queue handler reactive/load_balancer.py:76:request_server_certificates tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2025-04-18 05:17:17 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/apt.py:50:ensure_package_status 2025-04-18 05:17:17 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/load_balancer.py:76:request_server_certificates 2025-04-18 05:17:18 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/load_balancer.py:156:install_load_balancer 2025-04-18 05:17:18 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 status-set: maintenance: Configuring site apilb 2025-04-18 05:17:18 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 Writing file /etc/nginx/sites-available/apilb root:root 444 2025-04-18 05:17:18 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Wrote vhost config {'host': '127.0.0.1', 'port': 443, 'servers': {443: {('10.0.0.48', 6443)}, 6443: {('10.0.0.48', 6443)}}, 'server_certificate': '/srv/kubernetes/server.crt', 'server_key': '/srv/kubernetes/server.key', 'proxy_read_timeout': 600} to apilb.conf 2025-04-18 05:17:18 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/load_balancer.py:230:set_nginx_version 2025-04-18 05:17:18 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/load_balancer.py:276:provide_lb_consumers 2025-04-18 05:17:18 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:18:store_ca 2025-04-18 05:17:18 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:44:store_server 2025-04-18 05:17:18 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:71:store_client 2025-04-18 05:17:18 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/http/requires.py:15:broken:apiserver 2025-04-18 05:17:18 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/http/provides.py:15:broken:website 2025-04-18 05:17:18 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2025-04-18 05:17:18 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 status-set: active: Loadbalancer ready. 2025-04-18 05:17:18 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2025-04-18 05:17:18 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for kubeapi-load-balancer/0 2025-04-18 05:17:18 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2025-04-18 05:17:18 DEBUG juju.machinelock machinelock.go:186 machine lock released for kubeapi-load-balancer/0 uniter (run update-status hook) 2025-04-18 05:17:18 DEBUG juju.worker.uniter.operation executor.go:121 lock released for kubeapi-load-balancer/0 2025-04-18 05:17:18 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2025-04-18 05:17:18 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 12 2025-04-18 05:17:18 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-control-plane/0" already joined relation 5 2025-04-18 05:17:18 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-control-plane/0" already joined relation 6 2025-04-18 05:19:17 DEBUG juju.worker.uniter.remotestate watcher.go:623 got update status interval change for kubeapi-load-balancer/0: ok=true 2025-04-18 05:19:17 DEBUG juju.worker.retrystrategy worker.go:92 bouncing retrystrategy worker to get new values 2025-04-18 05:19:17 DEBUG juju.worker.dependency engine.go:621 "hook-retry-strategy" manifold worker stopped: restart immediately 2025-04-18 05:19:17 DEBUG juju.worker.uniter runlistener.go:130 juju-run listener stopping 2025-04-18 05:19:17 DEBUG juju.worker.uniter runlistener.go:149 juju-run listener stopped 2025-04-18 05:19:17 INFO juju.worker.uniter uniter.go:319 unit "kubeapi-load-balancer/0" shutting down: catacomb 0xc001a1e480 is dying 2025-04-18 05:19:17 DEBUG juju.worker.dependency engine.go:603 "uniter" manifold worker completed successfully 2025-04-18 05:19:17 DEBUG juju.worker.dependency engine.go:580 "hook-retry-strategy" manifold worker started at 2025-04-18 05:19:17.860613516 +0000 UTC 2025-04-18 05:19:17 DEBUG juju.worker.dependency engine.go:580 "uniter" manifold worker started at 2025-04-18 05:19:17.870848176 +0000 UTC 2025-04-18 05:19:17 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "kubeapi-load-balancer/0" (leader=true) entered scope for relation "kubeapi-load-balancer:certificates easyrsa:client" 2025-04-18 05:19:17 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "kubeapi-load-balancer/0" (leader=true) entered scope for relation "kubernetes-control-plane:loadbalancer-external kubeapi-load-balancer:lb-consumers" 2025-04-18 05:19:18 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "kubeapi-load-balancer/0" (leader=true) entered scope for relation "kubernetes-control-plane:loadbalancer-internal kubeapi-load-balancer:lb-consumers" 2025-04-18 05:19:18 DEBUG juju.worker.uniter uniter.go:883 starting local juju-run listener on {unix /var/lib/juju/agents/unit-kubeapi-load-balancer-0/run.socket } 2025-04-18 05:19:18 INFO juju.worker.uniter uniter.go:335 unit "kubeapi-load-balancer/0" started 2025-04-18 05:19:18 DEBUG juju.worker.uniter runlistener.go:117 juju-run listener running 2025-04-18 05:19:18 INFO juju.worker.uniter uniter.go:361 hooks are retried false 2025-04-18 05:19:18 DEBUG juju.worker.uniter.remotestate watcher.go:623 got update status interval change for kubeapi-load-balancer/0: ok=true 2025-04-18 05:19:18 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for kubeapi-load-balancer/0: ok=true 2025-04-18 05:19:18 DEBUG juju.worker.uniter.remotestate watcher.go:553 got trust config change for kubeapi-load-balancer/0: ok=true, hashes=[150f1995470e763f3e7f15a35bfa1cadcab7c5725810c3259886c7b8a418e71c] 2025-04-18 05:19:18 DEBUG juju.worker.uniter.remotestate watcher.go:603 got relations change for kubeapi-load-balancer/0: ok=true 2025-04-18 05:19:18 DEBUG juju.worker.uniter.remotestate watcher.go:499 got application change for kubeapi-load-balancer/0 2025-04-18 05:19:18 DEBUG juju.worker.uniter.remotestate watcher.go:613 got storage change for kubeapi-load-balancer/0: [] ok=true 2025-04-18 05:19:18 DEBUG juju.worker.uniter.remotestate watcher.go:564 got upgrade series change 2025-04-18 05:19:18 DEBUG juju.worker.uniter.remotestate watcher.go:714 no upgrade series in progress, reinitializing local upgrade series state 2025-04-18 05:19:18 DEBUG juju.worker.uniter.remotestate watcher.go:595 got action change for kubeapi-load-balancer/0: [] ok=true 2025-04-18 05:19:18 DEBUG juju.worker.uniter.remotestate watcher.go:542 got config change for kubeapi-load-balancer/0: ok=true, hashes=[12fc74c30f7cef5a9d6d6ff7e11923d21284ce06f81915ae53af1465c0e4d873] 2025-04-18 05:19:18 DEBUG juju.worker.uniter.remotestate watcher.go:574 got address change for kubeapi-load-balancer/0: ok=true, hashes=[2a050008c5cbaebedee830bac87a4c0144d0a6be438c83a6b8ebefdc74bb2b13] 2025-04-18 05:19:18 DEBUG juju.worker.uniter.remotestate watcher.go:489 got unit change for kubeapi-load-balancer/0 2025-04-18 05:19:18 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2025-04-18 05:19:18 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 12 2025-04-18 05:19:18 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-control-plane/0" already joined relation 5 2025-04-18 05:19:18 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-control-plane/0" already joined relation 6 2025-04-18 05:19:18 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 2025-04-18 05:21:38 DEBUG juju.worker.metrics.collect manifold.go:293 recording metrics 2025-04-18 05:21:38 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-kubeapi-load-balancer-0/metrics-collect-agent.socket } 2025-04-18 05:21:38 WARNING unit.unit-kubeapi-load-balancer-0.collect-metrics logger.go:60 /var/lib/juju/agents/unit-kubeapi-load-balancer-0/charm/hooks/collect-metrics:43: YAMLLoadWarning: calling yaml.load() without Loader=... is deprecated, as the default Loader is unsafe. Please read https://msg.pyyaml.org/load for full details. 2025-04-18 05:21:38 WARNING unit.unit-kubeapi-load-balancer-0.collect-metrics logger.go:60 doc = yaml.load(f) 2025-04-18 05:21:38 DEBUG juju.worker.metrics.collect manifold.go:316 ran "collect-metrics" hook (via explicit, bespoke hook script) 2025-04-18 05:23:55 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for kubeapi-load-balancer/0 2025-04-18 05:23:55 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2025-04-18 05:23:55 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 12 2025-04-18 05:23:55 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-control-plane/0" already joined relation 5 2025-04-18 05:23:55 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-control-plane/0" already joined relation 6 2025-04-18 05:23:55 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for kubeapi-load-balancer/0 2025-04-18 05:23:55 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for kubeapi-load-balancer/0 uniter (run update-status hook) 2025-04-18 05:24:17 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for kubeapi-load-balancer/0 uniter (run update-status hook) 2025-04-18 05:24:17 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for kubeapi-load-balancer/0 2025-04-18 05:24:17 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for kubeapi-load-balancer/0 2025-04-18 05:24:17 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-kubeapi-load-balancer-0/agent.socket } 2025-04-18 05:24:17 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Reactive main running for hook update-status 2025-04-18 05:24:18 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/http/provides.py:15:broken:website tracer: ++ queue handler hooks/relations/http/requires.py:15:broken:apiserver tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/apt.py:50:ensure_package_status tracer: ++ queue handler reactive/load_balancer.py:156:install_load_balancer tracer: ++ queue handler reactive/load_balancer.py:230:set_nginx_version tracer: ++ queue handler reactive/load_balancer.py:276:provide_lb_consumers tracer: ++ queue handler reactive/load_balancer.py:76:request_server_certificates tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2025-04-18 05:24:18 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.nagios_context 2025-04-18 05:24:18 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2025-04-18 05:24:18 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.extra_packages 2025-04-18 05:24:18 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.set.package_status 2025-04-18 05:24:18 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.package_status 2025-04-18 05:24:18 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.install_sources 2025-04-18 05:24:18 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.install_keys 2025-04-18 05:24:18 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.set.port 2025-04-18 05:24:18 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.port 2025-04-18 05:24:18 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.set.host 2025-04-18 05:24:18 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.host 2025-04-18 05:24:18 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.ha-cluster-vip 2025-04-18 05:24:18 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.ha-cluster-dns 2025-04-18 05:24:18 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.extra_sans 2025-04-18 05:24:18 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.set.proxy_read_timeout 2025-04-18 05:24:18 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.proxy_read_timeout 2025-04-18 05:24:18 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.loadbalancer-ips 2025-04-18 05:24:18 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Initializing Leadership Layer (is leader) 2025-04-18 05:24:18 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Initializing Apt Layer 2025-04-18 05:24:18 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer> tracer: starting handler dispatch, 45 flags set tracer: set flag apt.installed.nginx-full tracer: set flag certificates.available tracer: set flag certificates.batch.cert.available tracer: set flag certificates.ca.available tracer: set flag certificates.certs.available tracer: set flag certificates.client.cert.available tracer: set flag certificates.server.cert.available tracer: set flag certificates.server.certs.available tracer: set flag config.default.extra_packages tracer: set flag config.default.extra_sans tracer: set flag config.default.ha-cluster-dns tracer: set flag config.default.ha-cluster-vip tracer: set flag config.default.host tracer: set flag config.default.install_keys tracer: set flag config.default.install_sources tracer: set flag config.default.loadbalancer-ips tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.package_status tracer: set flag config.default.port tracer: set flag config.default.proxy_read_timeout tracer: set flag config.set.host tracer: set flag config.set.nagios_context tracer: set flag config.set.package_status tracer: set flag config.set.port tracer: set flag config.set.proxy_read_timeout tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.kubeapi-load-balancer_0.server.cert tracer: set flag endpoint.certificates.changed.kubeapi-load-balancer_0.server.key tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag endpoint.lb-consumers.created tracer: set flag endpoint.lb-consumers.joined tracer: set flag leadership.is_leader tracer: set flag nginx.available tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca_installed tracer: set flag tls_client.certs.saved tracer: set flag tls_client.server.cert.10.0.0.48.changed tracer: set flag tls_client.server.certs.changed 2025-04-18 05:24:18 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2025-04-18 05:24:18 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer> tracer: main dispatch loop, 11 handlers queued tracer: ++ queue handler hooks/relations/http/provides.py:15:broken:website tracer: ++ queue handler hooks/relations/http/requires.py:15:broken:apiserver tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/apt.py:50:ensure_package_status tracer: ++ queue handler reactive/load_balancer.py:156:install_load_balancer tracer: ++ queue handler reactive/load_balancer.py:230:set_nginx_version tracer: ++ queue handler reactive/load_balancer.py:276:provide_lb_consumers tracer: ++ queue handler reactive/load_balancer.py:76:request_server_certificates tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2025-04-18 05:24:18 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/apt.py:50:ensure_package_status 2025-04-18 05:24:18 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/load_balancer.py:76:request_server_certificates 2025-04-18 05:24:18 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/load_balancer.py:156:install_load_balancer 2025-04-18 05:24:18 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 status-set: maintenance: Configuring site apilb 2025-04-18 05:24:18 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 Writing file /etc/nginx/sites-available/apilb root:root 444 2025-04-18 05:24:18 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Wrote vhost config {'host': '127.0.0.1', 'port': 443, 'servers': {443: {('10.0.0.48', 6443)}, 6443: {('10.0.0.48', 6443)}}, 'server_certificate': '/srv/kubernetes/server.crt', 'server_key': '/srv/kubernetes/server.key', 'proxy_read_timeout': 600} to apilb.conf 2025-04-18 05:24:18 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/load_balancer.py:230:set_nginx_version 2025-04-18 05:24:18 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/load_balancer.py:276:provide_lb_consumers 2025-04-18 05:24:18 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:18:store_ca 2025-04-18 05:24:18 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:44:store_server 2025-04-18 05:24:18 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:71:store_client 2025-04-18 05:24:18 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/http/requires.py:15:broken:apiserver 2025-04-18 05:24:18 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/http/provides.py:15:broken:website 2025-04-18 05:24:18 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2025-04-18 05:24:18 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 status-set: active: Loadbalancer ready. 2025-04-18 05:24:18 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2025-04-18 05:24:18 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for kubeapi-load-balancer/0 2025-04-18 05:24:18 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2025-04-18 05:24:18 DEBUG juju.machinelock machinelock.go:186 machine lock released for kubeapi-load-balancer/0 uniter (run update-status hook) 2025-04-18 05:24:18 DEBUG juju.worker.uniter.operation executor.go:121 lock released for kubeapi-load-balancer/0 2025-04-18 05:24:18 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2025-04-18 05:24:18 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-control-plane/0" already joined relation 6 2025-04-18 05:24:18 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 12 2025-04-18 05:24:18 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-control-plane/0" already joined relation 5