2025-04-17 18:12:46 INFO juju unit_agent.go:289 Starting unit workers for "kubeapi-load-balancer/0" 2025-04-17 18:12:46 INFO juju.worker.apicaller connect.go:163 [ff38d9] "unit-kubeapi-load-balancer-0" successfully connected to "10.0.0.50:17070" 2025-04-17 18:12:46 INFO juju.worker.apicaller connect.go:260 [ff38d9] password changed for "unit-kubeapi-load-balancer-0" 2025-04-17 18:12:46 INFO juju.worker.apicaller connect.go:163 [ff38d9] "unit-kubeapi-load-balancer-0" successfully connected to "10.0.0.50:17070" 2025-04-17 18:12:46 INFO juju.worker.migrationminion worker.go:142 migration phase is now: NONE 2025-04-17 18:12:46 INFO juju.worker.logger logger.go:120 logger worker started 2025-04-17 18:12:46 DEBUG juju.worker.dependency engine.go:580 "metric-sender" manifold worker started at 2025-04-17 18:12:46.204384153 +0000 UTC 2025-04-17 18:12:46 DEBUG juju.worker.dependency engine.go:580 "uniter" manifold worker started at 2025-04-17 18:12:46.204457835 +0000 UTC 2025-04-17 18:12:46 DEBUG juju.worker.meterstatus connected.go:93 got meter status change signal from watcher 2025-04-17 18:12:46 DEBUG juju.worker.apiaddressupdater apiaddressupdater.go:98 updating API hostPorts to [[10.0.0.50:17070 252.50.0.1:17070 127.0.0.1:17070 [::1]:17070]] 2025-04-17 18:12:46 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for meterstatus (meter-status-changed) 2025-04-17 18:12:46 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for meterstatus (meter-status-changed) 2025-04-17 18:12:46 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-kubeapi-load-balancer-0/agent.socket } 2025-04-17 18:12:46 INFO juju.worker.upgrader upgrader.go:216 no waiter, upgrader is done 2025-04-17 18:12:46 DEBUG juju.worker.dependency engine.go:603 "upgrader" manifold worker completed successfully 2025-04-17 18:12:46 ERROR juju.worker.meterstatus runner.go:93 error running "meter-status-changed": charm missing from disk 2025-04-17 18:12:46 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2025-04-17 18:12:46 DEBUG juju.machinelock machinelock.go:186 machine lock released for meterstatus (meter-status-changed) 2025-04-17 18:12:46 DEBUG juju.worker.uniter uniter.go:883 starting local juju-run listener on {unix /var/lib/juju/agents/unit-kubeapi-load-balancer-0/run.socket } 2025-04-17 18:12:46 INFO juju.worker.uniter uniter.go:335 unit "kubeapi-load-balancer/0" started 2025-04-17 18:12:46 DEBUG juju.worker.uniter runlistener.go:117 juju-run listener running 2025-04-17 18:12:46 INFO juju.worker.uniter uniter.go:651 resuming charm install 2025-04-17 18:12:46 DEBUG juju.worker.uniter.operation executor.go:85 running operation install ch:amd64/focal/kubeapi-load-balancer-73 for kubeapi-load-balancer/0 2025-04-17 18:12:46 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "install ch:amd64/focal/kubeapi-load-balancer-73" for kubeapi-load-balancer/0 2025-04-17 18:12:46 INFO juju.worker.uniter.charm bundles.go:81 downloading ch:amd64/focal/kubeapi-load-balancer-73 from API server 2025-04-17 18:12:46 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "install ch:amd64/focal/kubeapi-load-balancer-73" for kubeapi-load-balancer/0 2025-04-17 18:12:46 DEBUG juju.worker.uniter.charm manifest_deployer.go:143 preparing to deploy charm "ch:amd64/focal/kubeapi-load-balancer-73" 2025-04-17 18:12:46 DEBUG juju.worker.uniter.charm manifest_deployer.go:132 deploying charm "ch:amd64/focal/kubeapi-load-balancer-73" 2025-04-17 18:12:47 DEBUG juju.worker.uniter.charm manifest_deployer.go:164 finishing deploy of charm "ch:amd64/focal/kubeapi-load-balancer-73" 2025-04-17 18:12:47 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "install ch:amd64/focal/kubeapi-load-balancer-73" for kubeapi-load-balancer/0 2025-04-17 18:12:47 INFO juju.worker.uniter uniter.go:361 hooks are retried true 2025-04-17 18:12:47 DEBUG juju.worker.uniter.remotestate watcher.go:499 got application change for kubeapi-load-balancer/0 2025-04-17 18:12:47 DEBUG juju.worker.uniter.remotestate watcher.go:489 got unit change for kubeapi-load-balancer/0 2025-04-17 18:12:47 DEBUG juju.worker.uniter.remotestate watcher.go:553 got trust config change for kubeapi-load-balancer/0: ok=true, hashes=[150f1995470e763f3e7f15a35bfa1cadcab7c5725810c3259886c7b8a418e71c] 2025-04-17 18:12:47 DEBUG juju.worker.uniter.remotestate watcher.go:603 got relations change for kubeapi-load-balancer/0: ok=true 2025-04-17 18:12:47 DEBUG juju.worker.uniter.remotestate watcher.go:595 got action change for kubeapi-load-balancer/0: [] ok=true 2025-04-17 18:12:47 DEBUG juju.worker.uniter.remotestate watcher.go:613 got storage change for kubeapi-load-balancer/0: [] ok=true 2025-04-17 18:12:47 DEBUG juju.worker.uniter.remotestate watcher.go:564 got upgrade series change 2025-04-17 18:12:47 DEBUG juju.worker.uniter.remotestate watcher.go:714 no upgrade series in progress, reinitializing local upgrade series state 2025-04-17 18:12:47 DEBUG juju.worker.uniter.remotestate watcher.go:585 got leader settings change for kubeapi-load-balancer/0: ok=true 2025-04-17 18:12:47 DEBUG juju.worker.uniter.remotestate watcher.go:574 got address change for kubeapi-load-balancer/0: ok=true, hashes=[31dedc9dd31a62a45a40282b1443d540bd505d46dd7e7e14a221d2cb38026685] 2025-04-17 18:12:47 DEBUG juju.worker.uniter.remotestate watcher.go:542 got config change for kubeapi-load-balancer/0: ok=true, hashes=[12fc74c30f7cef5a9d6d6ff7e11923d21284ce06f81915ae53af1465c0e4d873] 2025-04-17 18:12:47 DEBUG juju.worker.uniter.remotestate watcher.go:623 got update status interval change for kubeapi-load-balancer/0: ok=true 2025-04-17 18:12:47 INFO juju.worker.uniter.storage resolver.go:126 initial storage attachments ready 2025-04-17 18:12:47 INFO juju.worker.uniter resolver.go:159 found queued "install" hook 2025-04-17 18:12:47 DEBUG juju.worker.uniter.operation executor.go:85 running operation run install hook for kubeapi-load-balancer/0 2025-04-17 18:12:47 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for kubeapi-load-balancer/0 uniter (run install hook) 2025-04-17 18:13:38 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for kubeapi-load-balancer/0 : {12 {map[easyrsa/0:{0}] map[] []}} 2025-04-17 18:14:23 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for kubeapi-load-balancer/0 uniter (run install hook) 2025-04-17 18:14:23 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run install hook" for kubeapi-load-balancer/0 2025-04-17 18:14:23 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run install hook" for kubeapi-load-balancer/0 2025-04-17 18:14:23 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running install hook 2025-04-17 18:14:23 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-kubeapi-load-balancer-0/agent.socket } 2025-04-17 18:14:23 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Reading package lists... 2025-04-17 18:14:23 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Building dependency tree... 2025-04-17 18:14:23 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Reading state information... 2025-04-17 18:14:24 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 python3-dev is already the newest version (3.8.2-0ubuntu2). 2025-04-17 18:14:24 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 python3-setuptools is already the newest version (45.2.0-1ubuntu0.2). 2025-04-17 18:14:24 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 python3-yaml is already the newest version (5.3.1-1ubuntu0.1). 2025-04-17 18:14:24 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 python3-pip is already the newest version (20.0.2-5ubuntu1.11). 2025-04-17 18:14:24 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 python3-wheel is already the newest version (0.34.2-1ubuntu0.1). 2025-04-17 18:14:24 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 build-essential is already the newest version (12.8ubuntu1.1). 2025-04-17 18:14:24 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 0 upgraded, 0 newly installed, 0 to remove and 10 not upgraded. 2025-04-17 18:14:24 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Reading package lists... 2025-04-17 18:14:24 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Building dependency tree... 2025-04-17 18:14:24 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Reading state information... 2025-04-17 18:14:24 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 0 upgraded, 0 newly installed, 0 to remove and 10 not upgraded. 2025-04-17 18:14:24 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Reading package lists... 2025-04-17 18:14:25 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Building dependency tree... 2025-04-17 18:14:25 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Reading state information... 2025-04-17 18:14:25 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 virtualenv is already the newest version (20.0.17-1ubuntu0.4). 2025-04-17 18:14:25 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 0 upgraded, 0 newly installed, 0 to remove and 10 not upgraded. 2025-04-17 18:14:25 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 created virtual environment CPython3.8.10.final.0-64 in 112ms 2025-04-17 18:14:25 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 creator CPython3Posix(dest=/var/lib/juju/agents/unit-kubeapi-load-balancer-0/.venv, clear=False, global=False) 2025-04-17 18:14:25 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 seeder FromAppData(download=False, pip=latest, setuptools=latest, wheel=latest, pkg_resources=latest, via=copy, app_data_dir=/root/.local/share/virtualenv/seed-app-data/v1.0.1.debian.1) 2025-04-17 18:14:25 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 activators BashActivator,CShellActivator,FishActivator,PowerShellActivator,PythonActivator,XonshActivator 2025-04-17 18:14:27 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Looking in links: wheelhouse 2025-04-17 18:14:27 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Requirement already up-to-date: pip in /var/lib/juju/agents/unit-kubeapi-load-balancer-0/.venv/lib/python3.8/site-packages (20.0.2) 2025-04-17 18:14:28 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Looking in links: wheelhouse 2025-04-17 18:14:28 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Requirement already up-to-date: setuptools in /var/lib/juju/agents/unit-kubeapi-load-balancer-0/.venv/lib/python3.8/site-packages (44.0.0) 2025-04-17 18:14:30 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Looking in links: wheelhouse 2025-04-17 18:14:30 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Processing ./wheelhouse/setuptools_scm-1.17.0.tar.gz 2025-04-17 18:14:30 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Building wheels for collected packages: setuptools-scm 2025-04-17 18:14:30 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Building wheel for setuptools-scm (setup.py): started 2025-04-17 18:14:30 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Building wheel for setuptools-scm (setup.py): finished with status 'done' 2025-04-17 18:14:30 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Created wheel for setuptools-scm: filename=setuptools_scm-1.17.0-py2.py3-none-any.whl size=17696 sha256=ffb74d225e8c70a0c16b2790799b0fdec3fd3dc993ef5cc23b04f629a7e347d9 2025-04-17 18:14:30 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Stored in directory: /root/.cache/pip/wheels/1a/e3/20/9813490b9032e681a59835d252a5e73cf56c15f4e75745c2ea 2025-04-17 18:14:30 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Successfully built setuptools-scm 2025-04-17 18:14:30 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Installing collected packages: setuptools-scm 2025-04-17 18:14:30 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Successfully installed setuptools-scm-1.17.0 2025-04-17 18:14:32 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Looking in links: wheelhouse 2025-04-17 18:14:32 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Processing ./wheelhouse/wheel-0.33.6.tar.gz 2025-04-17 18:14:32 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Processing ./wheelhouse/MarkupSafe-2.0.1.tar.gz 2025-04-17 18:14:32 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Building wheels for collected packages: wheel, MarkupSafe 2025-04-17 18:14:32 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Building wheel for wheel (setup.py): started 2025-04-17 18:14:32 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Building wheel for wheel (setup.py): finished with status 'done' 2025-04-17 18:14:32 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Created wheel for wheel: filename=wheel-0.33.6-py2.py3-none-any.whl size=21555 sha256=8ba63d007b49d1ad6668fe704208573c1c193a18b85c3b7948a36358c0e39ad9 2025-04-17 18:14:32 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-tedw9wdz/wheels/ca/93/8c/d4a29a7c11e02122a600e627f92718c15b8777774a780e9a61 2025-04-17 18:14:32 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Building wheel for MarkupSafe (setup.py): started 2025-04-17 18:14:33 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Building wheel for MarkupSafe (setup.py): finished with status 'done' 2025-04-17 18:14:33 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Created wheel for MarkupSafe: filename=MarkupSafe-2.0.1-cp38-cp38-linux_x86_64.whl size=30805 sha256=a3d46c900e3e8804440c99e792631afc9c44d42ab91326abc5b2d4a6aa0cc43f 2025-04-17 18:14:33 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-tedw9wdz/wheels/1d/aa/0c/91bee1f1fa484023111160669fd8175bbe13d89e9a0ad5fc53 2025-04-17 18:14:33 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Successfully built wheel MarkupSafe 2025-04-17 18:14:33 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Installing collected packages: wheel, MarkupSafe 2025-04-17 18:14:33 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Attempting uninstall: wheel 2025-04-17 18:14:33 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Found existing installation: wheel 0.34.2 2025-04-17 18:14:33 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Uninstalling wheel-0.34.2: 2025-04-17 18:14:33 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Successfully uninstalled wheel-0.34.2 2025-04-17 18:14:33 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Successfully installed MarkupSafe-2.0.1 wheel-0.33.6 2025-04-17 18:14:34 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Looking in links: wheelhouse 2025-04-17 18:14:34 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Processing ./wheelhouse/charms.reactive-1.5.2.tar.gz 2025-04-17 18:14:34 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Processing ./wheelhouse/netaddr-0.7.19.tar.gz 2025-04-17 18:14:35 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Processing ./wheelhouse/ops-1.5.5.tar.gz 2025-04-17 18:14:35 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Installing build dependencies: started 2025-04-17 18:14:37 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Installing build dependencies: finished with status 'done' 2025-04-17 18:14:38 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Getting requirements to build wheel: started 2025-04-17 18:14:38 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Getting requirements to build wheel: finished with status 'done' 2025-04-17 18:14:38 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Preparing wheel metadata: started 2025-04-17 18:14:38 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Preparing wheel metadata: finished with status 'done' 2025-04-17 18:14:38 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Processing ./wheelhouse/marshmallow-3.14.1.tar.gz 2025-04-17 18:14:38 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Installing build dependencies: started 2025-04-17 18:14:40 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Installing build dependencies: finished with status 'done' 2025-04-17 18:14:40 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Getting requirements to build wheel: started 2025-04-17 18:14:40 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Getting requirements to build wheel: finished with status 'done' 2025-04-17 18:14:40 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Preparing wheel metadata: started 2025-04-17 18:14:40 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Preparing wheel metadata: finished with status 'done' 2025-04-17 18:14:40 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Processing ./wheelhouse/toml-0.10.2.tar.gz 2025-04-17 18:14:40 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Processing ./wheelhouse/pyaml-21.10.1.tar.gz 2025-04-17 18:14:41 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Processing ./wheelhouse/ops_reactive_interface-1.0.1.tar.gz 2025-04-17 18:14:41 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Processing ./wheelhouse/PyYAML-5.3.1.tar.gz 2025-04-17 18:14:41 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Processing ./wheelhouse/marshmallow-enum-1.5.1.tar.gz 2025-04-17 18:14:41 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Processing ./wheelhouse/cached-property-1.5.2.tar.gz 2025-04-17 18:14:42 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Processing ./wheelhouse/pbr-5.11.1.tar.gz 2025-04-17 18:14:42 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Processing ./wheelhouse/charmhelpers-1.2.1.tar.gz 2025-04-17 18:14:44 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Processing ./wheelhouse/Jinja2-3.0.3.tar.gz 2025-04-17 18:14:45 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Processing ./wheelhouse/loadbalancer_interface-1.2.0.tar.gz 2025-04-17 18:14:45 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Processing ./wheelhouse/MarkupSafe-2.0.1.tar.gz 2025-04-17 18:14:45 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Building wheels for collected packages: charms.reactive, netaddr, ops, marshmallow, toml, pyaml, ops-reactive-interface, PyYAML, marshmallow-enum, cached-property, pbr, charmhelpers, Jinja2, loadbalancer-interface, MarkupSafe 2025-04-17 18:14:45 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Building wheel for charms.reactive (setup.py): started 2025-04-17 18:14:45 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Building wheel for charms.reactive (setup.py): finished with status 'done' 2025-04-17 18:14:45 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Created wheel for charms.reactive: filename=charms.reactive-1.5.2-py3-none-any.whl size=48373 sha256=85a38647dcacc6edceef730fe7ff27e19885daec143ecc190ee8058697582dd8 2025-04-17 18:14:45 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-sqcwzjdq/wheels/be/aa/74/63feccd1cc3014754b29dccfa43ed0e34a2dcc8041705c95fa 2025-04-17 18:14:45 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Building wheel for netaddr (setup.py): started 2025-04-17 18:14:46 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Building wheel for netaddr (setup.py): finished with status 'done' 2025-04-17 18:14:46 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Created wheel for netaddr: filename=netaddr-0.7.19-py3-none-any.whl size=1627892 sha256=d222ac4da3ca63d5d980bad0878eec7f37d111af8e7872dff619783049ebe607 2025-04-17 18:14:46 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-sqcwzjdq/wheels/36/31/c5/4ce2eedf4f1ce180ccd89414c4b657186b1d6bd3c38aef006a 2025-04-17 18:14:46 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Building wheel for ops (PEP 517): started 2025-04-17 18:14:46 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Building wheel for ops (PEP 517): finished with status 'done' 2025-04-17 18:14:46 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Created wheel for ops: filename=ops-1.5.5-py3-none-any.whl size=159202 sha256=c2f0aea8fa44074e1ef502bd377656d3e119be571f3459201c729c38db351f48 2025-04-17 18:14:46 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-sqcwzjdq/wheels/2a/1b/9e/5337dda788fc9e8c5e13ab680acc2cdc29ea087531ba5ee02b 2025-04-17 18:14:46 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Building wheel for marshmallow (PEP 517): started 2025-04-17 18:14:46 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Building wheel for marshmallow (PEP 517): finished with status 'done' 2025-04-17 18:14:46 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Created wheel for marshmallow: filename=marshmallow-3.14.1-py3-none-any.whl size=47572 sha256=554f469a79fa9c76746f9b9c55f612b609a176aea6b877c324d3fd69cd65d7ff 2025-04-17 18:14:46 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-sqcwzjdq/wheels/a6/b7/cd/14594ff8b08684a8f40e9d97b6fbedad63f33f00fa7cb6c7af 2025-04-17 18:14:46 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Building wheel for toml (setup.py): started 2025-04-17 18:14:47 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Building wheel for toml (setup.py): finished with status 'done' 2025-04-17 18:14:47 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Created wheel for toml: filename=toml-0.10.2-py2.py3-none-any.whl size=16587 sha256=cbbf41becedfa2cab12a9cd7da55f0ebdf09bebafeaaed9b3b4d67f25eec459f 2025-04-17 18:14:47 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-sqcwzjdq/wheels/79/87/8c/eb2c7a25ed4821d1e38672eafd2316ccf39ff1c71da199bbb6 2025-04-17 18:14:47 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Building wheel for pyaml (setup.py): started 2025-04-17 18:14:47 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Building wheel for pyaml (setup.py): finished with status 'done' 2025-04-17 18:14:47 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Created wheel for pyaml: filename=pyaml-21.10.1-py2.py3-none-any.whl size=17626 sha256=35aff13ca19f9823b4dbf203a44188e049485f3ab834cefc87c566bd57291dba 2025-04-17 18:14:47 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-sqcwzjdq/wheels/09/b1/57/549524577380328a7644a4e6c9da4ee9775007f97dfba086f0 2025-04-17 18:14:47 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Building wheel for ops-reactive-interface (setup.py): started 2025-04-17 18:14:47 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Building wheel for ops-reactive-interface (setup.py): finished with status 'done' 2025-04-17 18:14:47 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Created wheel for ops-reactive-interface: filename=ops_reactive_interface-1.0.1-py3-none-any.whl size=4172 sha256=566d6ec24d9087dc21795a2dcf6dcc74c369fead98640e589aa0b22914b66bda 2025-04-17 18:14:47 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-sqcwzjdq/wheels/27/16/8b/475587258a77f07ea7f8bbeff29be852e2ca92711c6b280b43 2025-04-17 18:14:47 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Building wheel for PyYAML (setup.py): started 2025-04-17 18:14:48 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Building wheel for PyYAML (setup.py): finished with status 'done' 2025-04-17 18:14:48 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Created wheel for PyYAML: filename=PyYAML-5.3.1-cp38-cp38-linux_x86_64.whl size=44617 sha256=ef5dee3a06eff941bec746243095f59a545805da27f5309acde5be98ce0fec82 2025-04-17 18:14:48 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-sqcwzjdq/wheels/64/c4/e6/388b15f83607de7aec92e573647c97a300b038faf081645b57 2025-04-17 18:14:48 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Building wheel for marshmallow-enum (setup.py): started 2025-04-17 18:14:48 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Building wheel for marshmallow-enum (setup.py): finished with status 'done' 2025-04-17 18:14:48 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Created wheel for marshmallow-enum: filename=marshmallow_enum-1.5.1-py2.py3-none-any.whl size=4186 sha256=049a69518db562c286b56f2f189c8974754a0b2973b315b728d22e90a97fec9e 2025-04-17 18:14:48 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-sqcwzjdq/wheels/47/35/1c/81e1205b3fb39abc226e4eab1873acb2adefb0c29d3f38ffba 2025-04-17 18:14:48 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Building wheel for cached-property (setup.py): started 2025-04-17 18:14:48 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Building wheel for cached-property (setup.py): finished with status 'done' 2025-04-17 18:14:48 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Created wheel for cached-property: filename=cached_property-1.5.2-py2.py3-none-any.whl size=7574 sha256=cce9fd2a9011bac5433fcfc1fa74f89c00c9c30efe05f2e15a6ab6ccc8e05b50 2025-04-17 18:14:48 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-sqcwzjdq/wheels/35/c0/49/051acf0ec4af55a2852a91cb5c6eebe5784e1f3165be700e84 2025-04-17 18:14:48 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Building wheel for pbr (setup.py): started 2025-04-17 18:14:48 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Building wheel for pbr (setup.py): finished with status 'done' 2025-04-17 18:14:48 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Created wheel for pbr: filename=pbr-5.11.1-py2.py3-none-any.whl size=112680 sha256=89d0cae529ff18f782ac4b04c7ff96d7bc4ddc6c3c40dc5659ca2f330d193546 2025-04-17 18:14:48 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-sqcwzjdq/wheels/24/11/93/eb71cb42b9bb677e209ba27012de0faacf261ed097c47ca988 2025-04-17 18:14:48 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Building wheel for charmhelpers (setup.py): started 2025-04-17 18:14:49 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Building wheel for charmhelpers (setup.py): finished with status 'done' 2025-04-17 18:14:49 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Created wheel for charmhelpers: filename=charmhelpers-1.2.1-py3-none-any.whl size=411703 sha256=6484af9f73389f1c3b6e678a76706a40a5a8250568bea992e908aa891bb5b473 2025-04-17 18:14:49 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-sqcwzjdq/wheels/d7/7c/bf/c6933e5547343e3b51952d46762dbcafdef324f92ef6d00882 2025-04-17 18:14:49 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Building wheel for Jinja2 (setup.py): started 2025-04-17 18:14:49 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Building wheel for Jinja2 (setup.py): finished with status 'done' 2025-04-17 18:14:49 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Created wheel for Jinja2: filename=Jinja2-3.0.3-py3-none-any.whl size=133612 sha256=be8d94d3fd2b80be9470f7bd63b13c3e2c13aa7fec5b6d9c9a19abf6d22ddbff 2025-04-17 18:14:49 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-sqcwzjdq/wheels/e5/62/73/c8391f9eec69050ed1cc26d2d51e0b74f0df3f0eeae96cb9ce 2025-04-17 18:14:49 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Building wheel for loadbalancer-interface (setup.py): started 2025-04-17 18:14:49 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Building wheel for loadbalancer-interface (setup.py): finished with status 'done' 2025-04-17 18:14:49 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Created wheel for loadbalancer-interface: filename=loadbalancer_interface-1.2.0-py3-none-any.whl size=24384 sha256=1dc03d77fd06fd04368cae9ca932d1081738148bfd2a98c75faec67e18d8d134 2025-04-17 18:14:49 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-sqcwzjdq/wheels/5b/5b/21/d4f4dbf2585212230fd91e083e02819307e72ac08c601cca60 2025-04-17 18:14:49 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Building wheel for MarkupSafe (setup.py): started 2025-04-17 18:14:50 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Building wheel for MarkupSafe (setup.py): finished with status 'done' 2025-04-17 18:14:50 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Created wheel for MarkupSafe: filename=MarkupSafe-2.0.1-cp38-cp38-linux_x86_64.whl size=30800 sha256=b3394399f6ce25ed0f7b9750671b3948a618d06488c208821127d9770bf79e72 2025-04-17 18:14:50 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Stored in directory: /tmp/pip-ephem-wheel-cache-sqcwzjdq/wheels/1d/aa/0c/91bee1f1fa484023111160669fd8175bbe13d89e9a0ad5fc53 2025-04-17 18:14:50 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Successfully built charms.reactive netaddr ops marshmallow toml pyaml ops-reactive-interface PyYAML marshmallow-enum cached-property pbr charmhelpers Jinja2 loadbalancer-interface MarkupSafe 2025-04-17 18:14:50 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Installing collected packages: MarkupSafe, Jinja2, PyYAML, netaddr, pbr, charmhelpers, pyaml, charms.reactive, ops, marshmallow, toml, ops-reactive-interface, marshmallow-enum, cached-property, loadbalancer-interface 2025-04-17 18:14:50 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Attempting uninstall: MarkupSafe 2025-04-17 18:14:50 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Found existing installation: MarkupSafe 2.0.1 2025-04-17 18:14:50 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Uninstalling MarkupSafe-2.0.1: 2025-04-17 18:14:50 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Successfully uninstalled MarkupSafe-2.0.1 2025-04-17 18:14:51 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Successfully installed Jinja2-3.0.3 MarkupSafe-2.0.1 PyYAML-5.3.1 cached-property-1.5.2 charmhelpers-1.2.1 charms.reactive-1.5.2 loadbalancer-interface-1.2.0 marshmallow-3.14.1 marshmallow-enum-1.5.1 netaddr-0.7.19 ops-1.5.5 ops-reactive-interface-1.0.1 pbr-5.11.1 pyaml-21.10.1 toml-0.10.2 2025-04-17 18:14:51 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Reactive main running for hook install 2025-04-17 18:14:51 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.changed 2025-04-17 18:14:51 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.changed.nagios_context 2025-04-17 18:14:51 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.set.nagios_context 2025-04-17 18:14:51 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.nagios_context 2025-04-17 18:14:51 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.changed.nagios_servicegroups 2025-04-17 18:14:51 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2025-04-17 18:14:51 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.changed.extra_packages 2025-04-17 18:14:51 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.extra_packages 2025-04-17 18:14:51 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.changed.package_status 2025-04-17 18:14:51 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.set.package_status 2025-04-17 18:14:51 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.package_status 2025-04-17 18:14:51 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.changed.install_sources 2025-04-17 18:14:51 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.install_sources 2025-04-17 18:14:51 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.changed.install_keys 2025-04-17 18:14:51 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.install_keys 2025-04-17 18:14:51 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.changed.port 2025-04-17 18:14:51 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.set.port 2025-04-17 18:14:51 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.port 2025-04-17 18:14:51 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.changed.host 2025-04-17 18:14:51 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.set.host 2025-04-17 18:14:51 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.host 2025-04-17 18:14:51 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.changed.ha-cluster-vip 2025-04-17 18:14:51 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.ha-cluster-vip 2025-04-17 18:14:51 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.changed.ha-cluster-dns 2025-04-17 18:14:51 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.ha-cluster-dns 2025-04-17 18:14:51 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.changed.extra_sans 2025-04-17 18:14:51 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.extra_sans 2025-04-17 18:14:51 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.changed.proxy_read_timeout 2025-04-17 18:14:51 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.set.proxy_read_timeout 2025-04-17 18:14:51 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.proxy_read_timeout 2025-04-17 18:14:51 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.changed.loadbalancer-ips 2025-04-17 18:14:51 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.loadbalancer-ips 2025-04-17 18:14:51 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Initializing Leadership Layer (is leader) 2025-04-17 18:14:51 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag leadership.is_leader 2025-04-17 18:14:51 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Initializing Apt Layer 2025-04-17 18:14:51 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag apt.needs_update 2025-04-17 18:14:51 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag apt.queued_installs 2025-04-17 18:14:51 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer> tracer: starting handler dispatch, 35 flags set tracer: set flag apt.needs_update tracer: set flag apt.queued_installs tracer: set flag config.changed tracer: set flag config.changed.extra_packages tracer: set flag config.changed.extra_sans tracer: set flag config.changed.ha-cluster-dns tracer: set flag config.changed.ha-cluster-vip tracer: set flag config.changed.host tracer: set flag config.changed.install_keys tracer: set flag config.changed.install_sources tracer: set flag config.changed.loadbalancer-ips tracer: set flag config.changed.nagios_context tracer: set flag config.changed.nagios_servicegroups tracer: set flag config.changed.package_status tracer: set flag config.changed.port tracer: set flag config.changed.proxy_read_timeout tracer: set flag config.default.extra_packages tracer: set flag config.default.extra_sans tracer: set flag config.default.ha-cluster-dns tracer: set flag config.default.ha-cluster-vip tracer: set flag config.default.host tracer: set flag config.default.install_keys tracer: set flag config.default.install_sources tracer: set flag config.default.loadbalancer-ips tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.package_status tracer: set flag config.default.port tracer: set flag config.default.proxy_read_timeout tracer: set flag config.set.host tracer: set flag config.set.nagios_context tracer: set flag config.set.package_status tracer: set flag config.set.port tracer: set flag config.set.proxy_read_timeout tracer: set flag leadership.is_leader 2025-04-17 18:14:52 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2025-04-17 18:14:52 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer> tracer: main dispatch loop, 5 handlers queued tracer: ++ queue handler hooks/relations/http/provides.py:15:broken:website tracer: ++ queue handler hooks/relations/http/requires.py:15:broken:apiserver tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/apt.py:39:update tracer: ++ queue handler reactive/load_balancer.py:130:close_old_port 2025-04-17 18:14:52 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/apt.py:39:update 2025-04-17 18:14:52 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 status-set: maintenance: Updating apt cache 2025-04-17 18:14:52 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Hit:1 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal InRelease 2025-04-17 18:14:52 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Hit:2 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security InRelease 2025-04-17 18:14:52 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Hit:3 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-updates InRelease 2025-04-17 18:14:52 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Hit:4 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-proposed InRelease 2025-04-17 18:14:52 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Hit:5 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-backports InRelease 2025-04-17 18:14:54 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Reading package lists... 2025-04-17 18:14:54 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer> tracer: cleared flag apt.needs_update tracer: ++ queue handler reactive/apt.py:44:install_queued tracer: -- dequeue handler reactive/apt.py:39:update 2025-04-17 18:14:54 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/load_balancer.py:130:close_old_port 2025-04-17 18:14:54 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/http/requires.py:15:broken:apiserver 2025-04-17 18:14:54 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/http/provides.py:15:broken:website 2025-04-17 18:14:54 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2025-04-17 18:14:54 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/apt.py:44:install_queued 2025-04-17 18:14:54 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 status-set: maintenance: Installing nginx-full 2025-04-17 18:14:54 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Installing ['nginx-full'] with options: ['--option=Dpkg::Options::=--force-confold'] 2025-04-17 18:14:54 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Reading package lists... 2025-04-17 18:14:54 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Building dependency tree... 2025-04-17 18:14:54 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Reading state information... 2025-04-17 18:14:54 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 The following additional packages will be installed: 2025-04-17 18:14:54 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 fontconfig-config fonts-dejavu-core geoip-database libfontconfig1 libgd3 2025-04-17 18:14:54 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 libgeoip1 libjbig0 libjpeg-turbo8 libjpeg8 libnginx-mod-http-auth-pam 2025-04-17 18:14:54 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 libnginx-mod-http-dav-ext libnginx-mod-http-echo libnginx-mod-http-geoip 2025-04-17 18:14:54 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 libnginx-mod-http-geoip2 libnginx-mod-http-image-filter 2025-04-17 18:14:54 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 libnginx-mod-http-subs-filter libnginx-mod-http-upstream-fair 2025-04-17 18:14:54 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 libnginx-mod-http-xslt-filter libnginx-mod-mail libnginx-mod-stream libtiff5 2025-04-17 18:14:54 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 libwebp6 libxpm4 nginx-common 2025-04-17 18:14:54 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Suggested packages: 2025-04-17 18:14:54 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 libgd-tools geoip-bin fcgiwrap nginx-doc ssl-cert 2025-04-17 18:14:54 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 The following NEW packages will be installed: 2025-04-17 18:14:54 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 fontconfig-config fonts-dejavu-core geoip-database libfontconfig1 libgd3 2025-04-17 18:14:54 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 libgeoip1 libjbig0 libjpeg-turbo8 libjpeg8 libnginx-mod-http-auth-pam 2025-04-17 18:14:54 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 libnginx-mod-http-dav-ext libnginx-mod-http-echo libnginx-mod-http-geoip 2025-04-17 18:14:54 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 libnginx-mod-http-geoip2 libnginx-mod-http-image-filter 2025-04-17 18:14:54 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 libnginx-mod-http-subs-filter libnginx-mod-http-upstream-fair 2025-04-17 18:14:54 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 libnginx-mod-http-xslt-filter libnginx-mod-mail libnginx-mod-stream libtiff5 2025-04-17 18:14:54 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 libwebp6 libxpm4 nginx-common nginx-full 2025-04-17 18:14:55 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 0 upgraded, 25 newly installed, 0 to remove and 10 not upgraded. 2025-04-17 18:14:55 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Need to get 5627 kB of archives. 2025-04-17 18:14:55 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 After this operation, 19.0 MB of additional disk space will be used. 2025-04-17 18:14:55 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Get:1 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal/main amd64 fonts-dejavu-core all 2.37-1 [1041 kB] 2025-04-17 18:14:55 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Get:2 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal/main amd64 fontconfig-config all 2.13.1-2ubuntu3 [28.8 kB] 2025-04-17 18:14:55 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Get:3 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal/universe amd64 geoip-database all 20191224-2 [3029 kB] 2025-04-17 18:14:55 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Get:4 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal/main amd64 libfontconfig1 amd64 2.13.1-2ubuntu3 [114 kB] 2025-04-17 18:14:55 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Get:5 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security/main amd64 libjpeg-turbo8 amd64 2.0.3-0ubuntu1.20.04.3 [118 kB] 2025-04-17 18:14:55 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Get:6 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal/main amd64 libjpeg8 amd64 8c-2ubuntu8 [2194 B] 2025-04-17 18:14:55 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Get:7 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security/main amd64 libjbig0 amd64 2.1-3.1ubuntu0.20.04.1 [27.3 kB] 2025-04-17 18:14:55 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Get:8 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security/main amd64 libwebp6 amd64 0.6.1-2ubuntu0.20.04.3 [185 kB] 2025-04-17 18:14:55 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Get:9 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security/main amd64 libtiff5 amd64 4.1.0+git191117-2ubuntu0.20.04.14 [164 kB] 2025-04-17 18:14:55 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Get:10 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security/main amd64 libxpm4 amd64 1:3.5.12-1ubuntu0.20.04.2 [34.9 kB] 2025-04-17 18:14:55 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Get:11 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security/main amd64 libgd3 amd64 2.2.5-5.2ubuntu2.4 [118 kB] 2025-04-17 18:14:55 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Get:12 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal/universe amd64 libgeoip1 amd64 1.6.12-6build1 [70.5 kB] 2025-04-17 18:14:55 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Get:13 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security/main amd64 nginx-common all 1.18.0-0ubuntu1.7 [37.8 kB] 2025-04-17 18:14:55 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Get:14 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security/universe amd64 libnginx-mod-http-auth-pam amd64 1.18.0-0ubuntu1.7 [10.0 kB] 2025-04-17 18:14:55 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Get:15 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security/universe amd64 libnginx-mod-http-dav-ext amd64 1.18.0-0ubuntu1.7 [11.9 kB] 2025-04-17 18:14:55 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Get:16 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security/universe amd64 libnginx-mod-http-echo amd64 1.18.0-0ubuntu1.7 [21.5 kB] 2025-04-17 18:14:55 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Get:17 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security/universe amd64 libnginx-mod-http-geoip amd64 1.18.0-0ubuntu1.7 [11.3 kB] 2025-04-17 18:14:55 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Get:18 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security/universe amd64 libnginx-mod-http-geoip2 amd64 1.18.0-0ubuntu1.7 [11.8 kB] 2025-04-17 18:14:55 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Get:19 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security/main amd64 libnginx-mod-http-image-filter amd64 1.18.0-0ubuntu1.7 [14.8 kB] 2025-04-17 18:14:55 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Get:20 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security/universe amd64 libnginx-mod-http-subs-filter amd64 1.18.0-0ubuntu1.7 [13.1 kB] 2025-04-17 18:14:55 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Get:21 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security/universe amd64 libnginx-mod-http-upstream-fair amd64 1.18.0-0ubuntu1.7 [13.3 kB] 2025-04-17 18:14:55 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Get:22 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security/main amd64 libnginx-mod-http-xslt-filter amd64 1.18.0-0ubuntu1.7 [13.1 kB] 2025-04-17 18:14:55 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Get:23 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security/main amd64 libnginx-mod-mail amd64 1.18.0-0ubuntu1.7 [43.0 kB] 2025-04-17 18:14:55 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Get:24 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security/main amd64 libnginx-mod-stream amd64 1.18.0-0ubuntu1.7 [67.3 kB] 2025-04-17 18:14:55 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Get:25 http://tf-mirrors.gz1.opensdn.io/repos/ubuntu/latest/mirror/archive.ubuntu.com/ubuntu focal-security/universe amd64 nginx-full amd64 1.18.0-0ubuntu1.7 [425 kB] 2025-04-17 18:14:55 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Preconfiguring packages ... 2025-04-17 18:14:55 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Fetched 5627 kB in 0s (52.0 MB/s) 2025-04-17 18:14:55 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Selecting previously unselected package fonts-dejavu-core. 2025-04-17 18:14:55 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 70995 files and directories currently installed.) 2025-04-17 18:14:55 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Preparing to unpack .../00-fonts-dejavu-core_2.37-1_all.deb ... 2025-04-17 18:14:55 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Unpacking fonts-dejavu-core (2.37-1) ... 2025-04-17 18:14:55 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Selecting previously unselected package fontconfig-config. 2025-04-17 18:14:55 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Preparing to unpack .../01-fontconfig-config_2.13.1-2ubuntu3_all.deb ... 2025-04-17 18:14:55 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Unpacking fontconfig-config (2.13.1-2ubuntu3) ... 2025-04-17 18:14:55 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Selecting previously unselected package geoip-database. 2025-04-17 18:14:55 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Preparing to unpack .../02-geoip-database_20191224-2_all.deb ... 2025-04-17 18:14:55 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Unpacking geoip-database (20191224-2) ... 2025-04-17 18:14:56 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Selecting previously unselected package libfontconfig1:amd64. 2025-04-17 18:14:56 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Preparing to unpack .../03-libfontconfig1_2.13.1-2ubuntu3_amd64.deb ... 2025-04-17 18:14:56 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Unpacking libfontconfig1:amd64 (2.13.1-2ubuntu3) ... 2025-04-17 18:14:56 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Selecting previously unselected package libjpeg-turbo8:amd64. 2025-04-17 18:14:56 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Preparing to unpack .../04-libjpeg-turbo8_2.0.3-0ubuntu1.20.04.3_amd64.deb ... 2025-04-17 18:14:56 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Unpacking libjpeg-turbo8:amd64 (2.0.3-0ubuntu1.20.04.3) ... 2025-04-17 18:14:56 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Selecting previously unselected package libjpeg8:amd64. 2025-04-17 18:14:56 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Preparing to unpack .../05-libjpeg8_8c-2ubuntu8_amd64.deb ... 2025-04-17 18:14:56 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Unpacking libjpeg8:amd64 (8c-2ubuntu8) ... 2025-04-17 18:14:56 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Selecting previously unselected package libjbig0:amd64. 2025-04-17 18:14:56 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Preparing to unpack .../06-libjbig0_2.1-3.1ubuntu0.20.04.1_amd64.deb ... 2025-04-17 18:14:56 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Unpacking libjbig0:amd64 (2.1-3.1ubuntu0.20.04.1) ... 2025-04-17 18:14:56 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Selecting previously unselected package libwebp6:amd64. 2025-04-17 18:14:56 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Preparing to unpack .../07-libwebp6_0.6.1-2ubuntu0.20.04.3_amd64.deb ... 2025-04-17 18:14:56 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Unpacking libwebp6:amd64 (0.6.1-2ubuntu0.20.04.3) ... 2025-04-17 18:14:56 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Selecting previously unselected package libtiff5:amd64. 2025-04-17 18:14:56 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Preparing to unpack .../08-libtiff5_4.1.0+git191117-2ubuntu0.20.04.14_amd64.deb ... 2025-04-17 18:14:56 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Unpacking libtiff5:amd64 (4.1.0+git191117-2ubuntu0.20.04.14) ... 2025-04-17 18:14:56 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Selecting previously unselected package libxpm4:amd64. 2025-04-17 18:14:56 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Preparing to unpack .../09-libxpm4_1%3a3.5.12-1ubuntu0.20.04.2_amd64.deb ... 2025-04-17 18:14:56 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Unpacking libxpm4:amd64 (1:3.5.12-1ubuntu0.20.04.2) ... 2025-04-17 18:14:56 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Selecting previously unselected package libgd3:amd64. 2025-04-17 18:14:56 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Preparing to unpack .../10-libgd3_2.2.5-5.2ubuntu2.4_amd64.deb ... 2025-04-17 18:14:56 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Unpacking libgd3:amd64 (2.2.5-5.2ubuntu2.4) ... 2025-04-17 18:14:56 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Selecting previously unselected package libgeoip1:amd64. 2025-04-17 18:14:56 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Preparing to unpack .../11-libgeoip1_1.6.12-6build1_amd64.deb ... 2025-04-17 18:14:56 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Unpacking libgeoip1:amd64 (1.6.12-6build1) ... 2025-04-17 18:14:56 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Selecting previously unselected package nginx-common. 2025-04-17 18:14:56 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Preparing to unpack .../12-nginx-common_1.18.0-0ubuntu1.7_all.deb ... 2025-04-17 18:14:56 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Unpacking nginx-common (1.18.0-0ubuntu1.7) ... 2025-04-17 18:14:56 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Selecting previously unselected package libnginx-mod-http-auth-pam. 2025-04-17 18:14:56 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Preparing to unpack .../13-libnginx-mod-http-auth-pam_1.18.0-0ubuntu1.7_amd64.deb ... 2025-04-17 18:14:56 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Unpacking libnginx-mod-http-auth-pam (1.18.0-0ubuntu1.7) ... 2025-04-17 18:14:57 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Selecting previously unselected package libnginx-mod-http-dav-ext. 2025-04-17 18:14:57 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Preparing to unpack .../14-libnginx-mod-http-dav-ext_1.18.0-0ubuntu1.7_amd64.deb ... 2025-04-17 18:14:57 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Unpacking libnginx-mod-http-dav-ext (1.18.0-0ubuntu1.7) ... 2025-04-17 18:14:57 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Selecting previously unselected package libnginx-mod-http-echo. 2025-04-17 18:14:57 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Preparing to unpack .../15-libnginx-mod-http-echo_1.18.0-0ubuntu1.7_amd64.deb ... 2025-04-17 18:14:57 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Unpacking libnginx-mod-http-echo (1.18.0-0ubuntu1.7) ... 2025-04-17 18:14:57 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Selecting previously unselected package libnginx-mod-http-geoip. 2025-04-17 18:14:57 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Preparing to unpack .../16-libnginx-mod-http-geoip_1.18.0-0ubuntu1.7_amd64.deb ... 2025-04-17 18:14:57 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Unpacking libnginx-mod-http-geoip (1.18.0-0ubuntu1.7) ... 2025-04-17 18:14:57 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Selecting previously unselected package libnginx-mod-http-geoip2. 2025-04-17 18:14:57 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Preparing to unpack .../17-libnginx-mod-http-geoip2_1.18.0-0ubuntu1.7_amd64.deb ... 2025-04-17 18:14:57 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Unpacking libnginx-mod-http-geoip2 (1.18.0-0ubuntu1.7) ... 2025-04-17 18:14:57 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Selecting previously unselected package libnginx-mod-http-image-filter. 2025-04-17 18:14:57 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Preparing to unpack .../18-libnginx-mod-http-image-filter_1.18.0-0ubuntu1.7_amd64.deb ... 2025-04-17 18:14:57 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Unpacking libnginx-mod-http-image-filter (1.18.0-0ubuntu1.7) ... 2025-04-17 18:14:57 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Selecting previously unselected package libnginx-mod-http-subs-filter. 2025-04-17 18:14:57 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Preparing to unpack .../19-libnginx-mod-http-subs-filter_1.18.0-0ubuntu1.7_amd64.deb ... 2025-04-17 18:14:57 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Unpacking libnginx-mod-http-subs-filter (1.18.0-0ubuntu1.7) ... 2025-04-17 18:14:57 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Selecting previously unselected package libnginx-mod-http-upstream-fair. 2025-04-17 18:14:57 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Preparing to unpack .../20-libnginx-mod-http-upstream-fair_1.18.0-0ubuntu1.7_amd64.deb ... 2025-04-17 18:14:57 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Unpacking libnginx-mod-http-upstream-fair (1.18.0-0ubuntu1.7) ... 2025-04-17 18:14:57 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Selecting previously unselected package libnginx-mod-http-xslt-filter. 2025-04-17 18:14:57 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Preparing to unpack .../21-libnginx-mod-http-xslt-filter_1.18.0-0ubuntu1.7_amd64.deb ... 2025-04-17 18:14:57 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Unpacking libnginx-mod-http-xslt-filter (1.18.0-0ubuntu1.7) ... 2025-04-17 18:14:57 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Selecting previously unselected package libnginx-mod-mail. 2025-04-17 18:14:57 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Preparing to unpack .../22-libnginx-mod-mail_1.18.0-0ubuntu1.7_amd64.deb ... 2025-04-17 18:14:57 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Unpacking libnginx-mod-mail (1.18.0-0ubuntu1.7) ... 2025-04-17 18:14:57 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Selecting previously unselected package libnginx-mod-stream. 2025-04-17 18:14:57 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Preparing to unpack .../23-libnginx-mod-stream_1.18.0-0ubuntu1.7_amd64.deb ... 2025-04-17 18:14:57 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Unpacking libnginx-mod-stream (1.18.0-0ubuntu1.7) ... 2025-04-17 18:14:57 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Selecting previously unselected package nginx-full. 2025-04-17 18:14:57 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Preparing to unpack .../24-nginx-full_1.18.0-0ubuntu1.7_amd64.deb ... 2025-04-17 18:14:57 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Unpacking nginx-full (1.18.0-0ubuntu1.7) ... 2025-04-17 18:14:57 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Setting up libxpm4:amd64 (1:3.5.12-1ubuntu0.20.04.2) ... 2025-04-17 18:14:57 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Setting up nginx-common (1.18.0-0ubuntu1.7) ... 2025-04-17 18:14:58 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Created symlink /etc/systemd/system/multi-user.target.wants/nginx.service → /lib/systemd/system/nginx.service. 2025-04-17 18:14:58 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Setting up libjbig0:amd64 (2.1-3.1ubuntu0.20.04.1) ... 2025-04-17 18:14:58 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Setting up libnginx-mod-http-xslt-filter (1.18.0-0ubuntu1.7) ... 2025-04-17 18:14:58 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Setting up libnginx-mod-http-auth-pam (1.18.0-0ubuntu1.7) ... 2025-04-17 18:14:58 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Setting up libwebp6:amd64 (0.6.1-2ubuntu0.20.04.3) ... 2025-04-17 18:14:58 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Setting up fonts-dejavu-core (2.37-1) ... 2025-04-17 18:14:58 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Setting up libjpeg-turbo8:amd64 (2.0.3-0ubuntu1.20.04.3) ... 2025-04-17 18:14:58 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Setting up libnginx-mod-http-echo (1.18.0-0ubuntu1.7) ... 2025-04-17 18:14:58 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Setting up libnginx-mod-http-subs-filter (1.18.0-0ubuntu1.7) ... 2025-04-17 18:14:58 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Setting up libgeoip1:amd64 (1.6.12-6build1) ... 2025-04-17 18:14:58 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Setting up geoip-database (20191224-2) ... 2025-04-17 18:14:58 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Setting up libnginx-mod-http-geoip2 (1.18.0-0ubuntu1.7) ... 2025-04-17 18:14:58 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Setting up libjpeg8:amd64 (8c-2ubuntu8) ... 2025-04-17 18:14:58 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Setting up libnginx-mod-http-dav-ext (1.18.0-0ubuntu1.7) ... 2025-04-17 18:14:58 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Setting up libnginx-mod-mail (1.18.0-0ubuntu1.7) ... 2025-04-17 18:14:58 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Setting up fontconfig-config (2.13.1-2ubuntu3) ... 2025-04-17 18:14:59 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Setting up libnginx-mod-stream (1.18.0-0ubuntu1.7) ... 2025-04-17 18:14:59 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Setting up libnginx-mod-http-upstream-fair (1.18.0-0ubuntu1.7) ... 2025-04-17 18:14:59 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Setting up libnginx-mod-http-geoip (1.18.0-0ubuntu1.7) ... 2025-04-17 18:14:59 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Setting up libtiff5:amd64 (4.1.0+git191117-2ubuntu0.20.04.14) ... 2025-04-17 18:14:59 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Setting up libfontconfig1:amd64 (2.13.1-2ubuntu3) ... 2025-04-17 18:14:59 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Setting up libgd3:amd64 (2.2.5-5.2ubuntu2.4) ... 2025-04-17 18:14:59 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Setting up libnginx-mod-http-image-filter (1.18.0-0ubuntu1.7) ... 2025-04-17 18:14:59 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Setting up nginx-full (1.18.0-0ubuntu1.7) ... 2025-04-17 18:14:59 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Processing triggers for libc-bin (2.31-0ubuntu9.17) ... 2025-04-17 18:14:59 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Processing triggers for ufw (0.36-6ubuntu1.1) ... 2025-04-17 18:14:59 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Processing triggers for systemd (245.4-4ubuntu3.24) ... 2025-04-17 18:14:59 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 Processing triggers for man-db (2.9.1-1) ... 2025-04-17 18:15:02 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag apt.installed.nginx-full 2025-04-17 18:15:02 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer> tracer: cleared flag apt.queued_installs tracer: -- dequeue handler reactive/apt.py:44:install_queued 2025-04-17 18:15:02 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/apt.py:50:ensure_package_status 2025-04-17 18:15:02 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Unholding packages nginx-full 2025-04-17 18:15:02 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Marking {'nginx-full'} as unhold 2025-04-17 18:15:02 DEBUG unit.kubeapi-load-balancer/0.install logger.go:60 nginx-full was already not hold. 2025-04-17 18:15:02 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/nginx.py:15:nginx_ready 2025-04-17 18:15:02 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer> tracer: set flag nginx.available tracer: -- dequeue handler reactive/nginx.py:15:nginx_ready 2025-04-17 18:15:02 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/load_balancer.py:230:set_nginx_version 2025-04-17 18:15:02 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 status-set: active: NGINX is ready 2025-04-17 18:15:02 INFO juju.worker.uniter.operation runhook.go:159 ran "install" hook (via explicit, bespoke hook script) 2025-04-17 18:15:02 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run install hook" for kubeapi-load-balancer/0 2025-04-17 18:15:02 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2025-04-17 18:15:02 DEBUG juju.machinelock machinelock.go:186 machine lock released for kubeapi-load-balancer/0 uniter (run install hook) 2025-04-17 18:15:02 DEBUG juju.worker.uniter.operation executor.go:121 lock released for kubeapi-load-balancer/0 2025-04-17 18:15:03 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "kubeapi-load-balancer/0" (leader=true) entered scope for relation "kubeapi-load-balancer:certificates easyrsa:client" 2025-04-17 18:15:03 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "kubeapi-load-balancer/0" (leader=true) entered scope for relation "kubernetes-control-plane:loadbalancer-external kubeapi-load-balancer:lb-consumers" 2025-04-17 18:15:03 DEBUG juju.worker.uniter.relation statetracker.go:221 unit "kubeapi-load-balancer/0" (leader=true) entered scope for relation "kubernetes-control-plane:loadbalancer-internal kubeapi-load-balancer:lb-consumers" 2025-04-17 18:15:03 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-created (12; app: easyrsa) hook for kubeapi-load-balancer/0 2025-04-17 18:15:03 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for kubeapi-load-balancer/0 uniter (run relation-created (12; app: easyrsa) hook) 2025-04-17 18:16:54 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for kubeapi-load-balancer/0 2025-04-17 18:17:43 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for kubeapi-load-balancer/0 : {5 {map[kubernetes-control-plane/0:{0}] map[] []}} 2025-04-17 18:17:43 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for kubeapi-load-balancer/0 : {6 {map[kubernetes-control-plane/0:{0}] map[] []}} 2025-04-17 18:17:46 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for kubeapi-load-balancer/0 uniter (run relation-created (12; app: easyrsa) hook) 2025-04-17 18:17:46 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-created (12; app: easyrsa) hook" for kubeapi-load-balancer/0 2025-04-17 18:17:46 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-created (12; app: easyrsa) hook" for kubeapi-load-balancer/0 2025-04-17 18:17:46 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running certificates-relation-created hook 2025-04-17 18:17:46 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-kubeapi-load-balancer-0/agent.socket } 2025-04-17 18:17:46 INFO juju.worker.uniter.operation runhook.go:162 skipped "certificates-relation-created" hook (missing) 2025-04-17 18:17:46 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-created (12; app: easyrsa) hook" for kubeapi-load-balancer/0 2025-04-17 18:17:46 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2025-04-17 18:17:46 DEBUG juju.machinelock machinelock.go:186 machine lock released for kubeapi-load-balancer/0 uniter (run relation-created (12; app: easyrsa) hook) 2025-04-17 18:17:46 DEBUG juju.worker.uniter.operation executor.go:121 lock released for kubeapi-load-balancer/0 2025-04-17 18:17:46 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-created (5; app: kubernetes-control-plane) hook for kubeapi-load-balancer/0 2025-04-17 18:17:46 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for kubeapi-load-balancer/0 uniter (run relation-created (5; app: kubernetes-control-plane) hook) 2025-04-17 18:17:57 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for kubeapi-load-balancer/0 : {5 {map[] map[kubernetes-control-plane:1] []}} 2025-04-17 18:17:57 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for kubeapi-load-balancer/0 : {6 {map[] map[kubernetes-control-plane:1] []}} 2025-04-17 18:18:52 DEBUG juju.worker.meterstatus connected.go:93 got meter status change signal from watcher 2025-04-17 18:19:08 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for kubeapi-load-balancer/0 uniter (run relation-created (5; app: kubernetes-control-plane) hook) 2025-04-17 18:19:08 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-created (5; app: kubernetes-control-plane) hook" for kubeapi-load-balancer/0 2025-04-17 18:19:08 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-created (5; app: kubernetes-control-plane) hook" for kubeapi-load-balancer/0 2025-04-17 18:19:08 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running lb-consumers-relation-created hook 2025-04-17 18:19:08 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-kubeapi-load-balancer-0/agent.socket } 2025-04-17 18:19:08 INFO juju.worker.uniter.operation runhook.go:162 skipped "lb-consumers-relation-created" hook (missing) 2025-04-17 18:19:08 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-created (5; app: kubernetes-control-plane) hook" for kubeapi-load-balancer/0 2025-04-17 18:19:08 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2025-04-17 18:19:08 DEBUG juju.machinelock machinelock.go:186 machine lock released for kubeapi-load-balancer/0 uniter (run relation-created (5; app: kubernetes-control-plane) hook) 2025-04-17 18:19:08 DEBUG juju.worker.uniter.operation executor.go:121 lock released for kubeapi-load-balancer/0 2025-04-17 18:19:08 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-created (6; app: kubernetes-control-plane) hook for kubeapi-load-balancer/0 2025-04-17 18:19:08 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for kubeapi-load-balancer/0 uniter (run relation-created (6; app: kubernetes-control-plane) hook) 2025-04-17 18:19:20 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for kubeapi-load-balancer/0 uniter (run relation-created (6; app: kubernetes-control-plane) hook) 2025-04-17 18:19:20 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-created (6; app: kubernetes-control-plane) hook" for kubeapi-load-balancer/0 2025-04-17 18:19:20 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-created (6; app: kubernetes-control-plane) hook" for kubeapi-load-balancer/0 2025-04-17 18:19:20 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-kubeapi-load-balancer-0/agent.socket } 2025-04-17 18:19:20 INFO juju.worker.uniter.operation runhook.go:162 skipped "lb-consumers-relation-created" hook (missing) 2025-04-17 18:19:20 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-created (6; app: kubernetes-control-plane) hook" for kubeapi-load-balancer/0 2025-04-17 18:19:20 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2025-04-17 18:19:20 DEBUG juju.machinelock machinelock.go:186 machine lock released for kubeapi-load-balancer/0 uniter (run relation-created (6; app: kubernetes-control-plane) hook) 2025-04-17 18:19:20 DEBUG juju.worker.uniter.operation executor.go:121 lock released for kubeapi-load-balancer/0 2025-04-17 18:19:20 DEBUG juju.worker.uniter.operation executor.go:85 running operation accept leadership for kubeapi-load-balancer/0 2025-04-17 18:19:20 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "accept leadership" for kubeapi-load-balancer/0 2025-04-17 18:19:20 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "accept leadership" for kubeapi-load-balancer/0 2025-04-17 18:19:20 INFO juju.worker.uniter resolver.go:159 found queued "leader-elected" hook 2025-04-17 18:19:20 DEBUG juju.worker.uniter.operation executor.go:85 running operation run leader-elected hook for kubeapi-load-balancer/0 2025-04-17 18:19:20 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for kubeapi-load-balancer/0 uniter (run leader-elected hook) 2025-04-17 18:19:32 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for kubeapi-load-balancer/0 uniter (run leader-elected hook) 2025-04-17 18:19:32 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run leader-elected hook" for kubeapi-load-balancer/0 2025-04-17 18:19:32 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run leader-elected hook" for kubeapi-load-balancer/0 2025-04-17 18:19:32 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running leader-elected hook 2025-04-17 18:19:32 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-kubeapi-load-balancer-0/agent.socket } 2025-04-17 18:19:32 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Reactive main running for hook leader-elected 2025-04-17 18:19:32 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer> tracer: set flag endpoint.lb-consumers.created tracer: ++ queue handler hooks/relations/http/provides.py:15:broken:website tracer: ++ queue handler hooks/relations/http/requires.py:15:broken:apiserver tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/apt.py:50:ensure_package_status tracer: ++ queue handler reactive/load_balancer.py:230:set_nginx_version 2025-04-17 18:19:32 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.set.nagios_context 2025-04-17 18:19:32 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.nagios_context 2025-04-17 18:19:32 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2025-04-17 18:19:32 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.extra_packages 2025-04-17 18:19:32 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.set.package_status 2025-04-17 18:19:32 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.package_status 2025-04-17 18:19:32 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.install_sources 2025-04-17 18:19:32 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.install_keys 2025-04-17 18:19:32 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.set.port 2025-04-17 18:19:32 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.port 2025-04-17 18:19:32 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.set.host 2025-04-17 18:19:32 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.host 2025-04-17 18:19:32 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.ha-cluster-vip 2025-04-17 18:19:32 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.ha-cluster-dns 2025-04-17 18:19:32 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.extra_sans 2025-04-17 18:19:32 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.set.proxy_read_timeout 2025-04-17 18:19:32 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.proxy_read_timeout 2025-04-17 18:19:32 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.loadbalancer-ips 2025-04-17 18:19:32 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Initializing Leadership Layer (is leader) 2025-04-17 18:19:32 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Initializing Apt Layer 2025-04-17 18:19:32 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer> tracer: starting handler dispatch, 22 flags set tracer: set flag apt.installed.nginx-full tracer: set flag config.default.extra_packages tracer: set flag config.default.extra_sans tracer: set flag config.default.ha-cluster-dns tracer: set flag config.default.ha-cluster-vip tracer: set flag config.default.host tracer: set flag config.default.install_keys tracer: set flag config.default.install_sources tracer: set flag config.default.loadbalancer-ips tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.package_status tracer: set flag config.default.port tracer: set flag config.default.proxy_read_timeout tracer: set flag config.set.host tracer: set flag config.set.nagios_context tracer: set flag config.set.package_status tracer: set flag config.set.port tracer: set flag config.set.proxy_read_timeout tracer: set flag endpoint.lb-consumers.created tracer: set flag leadership.is_leader tracer: set flag nginx.available 2025-04-17 18:19:32 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2025-04-17 18:19:32 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer> tracer: main dispatch loop, 5 handlers queued tracer: ++ queue handler hooks/relations/http/provides.py:15:broken:website tracer: ++ queue handler hooks/relations/http/requires.py:15:broken:apiserver tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/apt.py:50:ensure_package_status tracer: ++ queue handler reactive/load_balancer.py:230:set_nginx_version 2025-04-17 18:19:32 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/apt.py:50:ensure_package_status 2025-04-17 18:19:32 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/load_balancer.py:230:set_nginx_version 2025-04-17 18:19:32 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/http/requires.py:15:broken:apiserver 2025-04-17 18:19:32 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/http/provides.py:15:broken:website 2025-04-17 18:19:32 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2025-04-17 18:19:33 INFO juju.worker.uniter.operation runhook.go:159 ran "leader-elected" hook (via explicit, bespoke hook script) 2025-04-17 18:19:33 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run leader-elected hook" for kubeapi-load-balancer/0 2025-04-17 18:19:33 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2025-04-17 18:19:33 DEBUG juju.machinelock machinelock.go:186 machine lock released for kubeapi-load-balancer/0 uniter (run leader-elected hook) 2025-04-17 18:19:33 DEBUG juju.worker.uniter.operation executor.go:121 lock released for kubeapi-load-balancer/0 2025-04-17 18:19:33 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2025-04-17 18:19:33 DEBUG juju.worker.uniter.operation executor.go:85 running operation run config-changed hook for kubeapi-load-balancer/0 2025-04-17 18:19:33 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for kubeapi-load-balancer/0 uniter (run config-changed hook) 2025-04-17 18:19:42 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for kubeapi-load-balancer/0 : {5 {map[] map[kubernetes-control-plane:2] []}} 2025-04-17 18:19:42 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for kubeapi-load-balancer/0 : {6 {map[] map[kubernetes-control-plane:2] []}} 2025-04-17 18:19:44 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for kubeapi-load-balancer/0 uniter (run config-changed hook) 2025-04-17 18:19:44 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run config-changed hook" for kubeapi-load-balancer/0 2025-04-17 18:19:44 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run config-changed hook" for kubeapi-load-balancer/0 2025-04-17 18:19:44 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running config-changed hook 2025-04-17 18:19:44 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-kubeapi-load-balancer-0/agent.socket } 2025-04-17 18:19:45 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Reactive main running for hook config-changed 2025-04-17 18:19:45 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer> tracer: set flag endpoint.lb-consumers.changed tracer: ++ queue handler hooks/relations/http/provides.py:15:broken:website tracer: ++ queue handler hooks/relations/http/requires.py:15:broken:apiserver tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/apt.py:50:ensure_package_status tracer: ++ queue handler reactive/load_balancer.py:230:set_nginx_version 2025-04-17 18:19:45 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag endpoint.lb-consumers.requests_changed 2025-04-17 18:19:45 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.set.nagios_context 2025-04-17 18:19:45 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.nagios_context 2025-04-17 18:19:45 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2025-04-17 18:19:45 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.extra_packages 2025-04-17 18:19:45 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.set.package_status 2025-04-17 18:19:45 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.package_status 2025-04-17 18:19:45 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.install_sources 2025-04-17 18:19:45 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.install_keys 2025-04-17 18:19:45 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.set.port 2025-04-17 18:19:45 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.port 2025-04-17 18:19:45 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.set.host 2025-04-17 18:19:45 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.host 2025-04-17 18:19:45 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.ha-cluster-vip 2025-04-17 18:19:45 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.ha-cluster-dns 2025-04-17 18:19:45 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.extra_sans 2025-04-17 18:19:45 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.set.proxy_read_timeout 2025-04-17 18:19:45 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.proxy_read_timeout 2025-04-17 18:19:45 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.loadbalancer-ips 2025-04-17 18:19:45 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Initializing Leadership Layer (is leader) 2025-04-17 18:19:45 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Initializing Apt Layer 2025-04-17 18:19:45 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer> tracer: starting handler dispatch, 24 flags set tracer: set flag apt.installed.nginx-full tracer: set flag config.default.extra_packages tracer: set flag config.default.extra_sans tracer: set flag config.default.ha-cluster-dns tracer: set flag config.default.ha-cluster-vip tracer: set flag config.default.host tracer: set flag config.default.install_keys tracer: set flag config.default.install_sources tracer: set flag config.default.loadbalancer-ips tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.package_status tracer: set flag config.default.port tracer: set flag config.default.proxy_read_timeout tracer: set flag config.set.host tracer: set flag config.set.nagios_context tracer: set flag config.set.package_status tracer: set flag config.set.port tracer: set flag config.set.proxy_read_timeout tracer: set flag endpoint.lb-consumers.changed tracer: set flag endpoint.lb-consumers.created tracer: set flag endpoint.lb-consumers.requests_changed tracer: set flag leadership.is_leader tracer: set flag nginx.available 2025-04-17 18:19:45 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2025-04-17 18:19:45 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer> tracer: main dispatch loop, 5 handlers queued tracer: ++ queue handler hooks/relations/http/provides.py:15:broken:website tracer: ++ queue handler hooks/relations/http/requires.py:15:broken:apiserver tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/apt.py:50:ensure_package_status tracer: ++ queue handler reactive/load_balancer.py:230:set_nginx_version 2025-04-17 18:19:45 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/apt.py:50:ensure_package_status 2025-04-17 18:19:45 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/load_balancer.py:230:set_nginx_version 2025-04-17 18:19:45 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/http/requires.py:15:broken:apiserver 2025-04-17 18:19:45 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/http/provides.py:15:broken:website 2025-04-17 18:19:45 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2025-04-17 18:19:45 INFO juju.worker.uniter.operation runhook.go:159 ran "config-changed" hook (via explicit, bespoke hook script) 2025-04-17 18:19:45 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run config-changed hook" for kubeapi-load-balancer/0 2025-04-17 18:19:45 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2025-04-17 18:19:45 DEBUG juju.machinelock machinelock.go:186 machine lock released for kubeapi-load-balancer/0 uniter (run config-changed hook) 2025-04-17 18:19:45 DEBUG juju.worker.uniter.operation executor.go:121 lock released for kubeapi-load-balancer/0 2025-04-17 18:19:45 INFO juju.worker.uniter resolver.go:159 found queued "start" hook 2025-04-17 18:19:45 DEBUG juju.worker.uniter.operation executor.go:85 running operation run start hook for kubeapi-load-balancer/0 2025-04-17 18:19:45 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for kubeapi-load-balancer/0 uniter (run start hook) 2025-04-17 18:19:57 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for kubeapi-load-balancer/0 uniter (run start hook) 2025-04-17 18:19:57 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run start hook" for kubeapi-load-balancer/0 2025-04-17 18:19:57 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run start hook" for kubeapi-load-balancer/0 2025-04-17 18:19:57 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running start hook 2025-04-17 18:19:57 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-kubeapi-load-balancer-0/agent.socket } 2025-04-17 18:19:57 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Reactive main running for hook start 2025-04-17 18:19:58 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/http/provides.py:15:broken:website tracer: ++ queue handler hooks/relations/http/requires.py:15:broken:apiserver tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/apt.py:50:ensure_package_status tracer: ++ queue handler reactive/load_balancer.py:230:set_nginx_version 2025-04-17 18:19:58 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.nagios_context 2025-04-17 18:19:58 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2025-04-17 18:19:58 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.extra_packages 2025-04-17 18:19:58 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.set.package_status 2025-04-17 18:19:58 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.package_status 2025-04-17 18:19:58 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.install_sources 2025-04-17 18:19:58 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.install_keys 2025-04-17 18:19:58 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.set.port 2025-04-17 18:19:58 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.port 2025-04-17 18:19:58 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.set.host 2025-04-17 18:19:58 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.host 2025-04-17 18:19:58 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.ha-cluster-vip 2025-04-17 18:19:58 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.ha-cluster-dns 2025-04-17 18:19:58 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.extra_sans 2025-04-17 18:19:58 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.set.proxy_read_timeout 2025-04-17 18:19:58 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.proxy_read_timeout 2025-04-17 18:19:58 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.loadbalancer-ips 2025-04-17 18:19:58 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Initializing Leadership Layer (is leader) 2025-04-17 18:19:58 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Initializing Apt Layer 2025-04-17 18:19:58 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer> tracer: starting handler dispatch, 24 flags set tracer: set flag apt.installed.nginx-full tracer: set flag config.default.extra_packages tracer: set flag config.default.extra_sans tracer: set flag config.default.ha-cluster-dns tracer: set flag config.default.ha-cluster-vip tracer: set flag config.default.host tracer: set flag config.default.install_keys tracer: set flag config.default.install_sources tracer: set flag config.default.loadbalancer-ips tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.package_status tracer: set flag config.default.port tracer: set flag config.default.proxy_read_timeout tracer: set flag config.set.host tracer: set flag config.set.nagios_context tracer: set flag config.set.package_status tracer: set flag config.set.port tracer: set flag config.set.proxy_read_timeout tracer: set flag endpoint.lb-consumers.changed tracer: set flag endpoint.lb-consumers.created tracer: set flag endpoint.lb-consumers.requests_changed tracer: set flag leadership.is_leader tracer: set flag nginx.available 2025-04-17 18:19:58 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2025-04-17 18:19:58 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer> tracer: main dispatch loop, 5 handlers queued tracer: ++ queue handler hooks/relations/http/provides.py:15:broken:website tracer: ++ queue handler hooks/relations/http/requires.py:15:broken:apiserver tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:109:broken:certificates tracer: ++ queue handler reactive/apt.py:50:ensure_package_status tracer: ++ queue handler reactive/load_balancer.py:230:set_nginx_version 2025-04-17 18:19:58 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/apt.py:50:ensure_package_status 2025-04-17 18:19:58 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/load_balancer.py:230:set_nginx_version 2025-04-17 18:19:58 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/http/requires.py:15:broken:apiserver 2025-04-17 18:19:58 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/http/provides.py:15:broken:website 2025-04-17 18:19:58 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:109:broken:certificates 2025-04-17 18:19:58 INFO juju.worker.uniter.operation runhook.go:159 ran "start" hook (via explicit, bespoke hook script) 2025-04-17 18:19:58 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run start hook" for kubeapi-load-balancer/0 2025-04-17 18:19:58 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2025-04-17 18:19:58 DEBUG juju.machinelock machinelock.go:186 machine lock released for kubeapi-load-balancer/0 uniter (run start hook) 2025-04-17 18:19:58 DEBUG juju.worker.uniter.operation executor.go:121 lock released for kubeapi-load-balancer/0 2025-04-17 18:19:58 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2025-04-17 18:19:58 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-joined (12; unit: easyrsa/0) hook for kubeapi-load-balancer/0 2025-04-17 18:19:58 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for kubeapi-load-balancer/0 uniter (run relation-joined (12; unit: easyrsa/0) hook) 2025-04-17 18:19:58 DEBUG juju.worker.dependency engine.go:580 "metric-collect" manifold worker started at 2025-04-17 18:19:58.59840112 +0000 UTC 2025-04-17 18:19:58 DEBUG juju.worker.metrics.collect manifold.go:293 recording metrics 2025-04-17 18:19:58 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-kubeapi-load-balancer-0/metrics-collect-agent.socket } 2025-04-17 18:19:58 WARNING unit.unit-kubeapi-load-balancer-0.collect-metrics logger.go:60 /var/lib/juju/agents/unit-kubeapi-load-balancer-0/charm/hooks/collect-metrics:43: YAMLLoadWarning: calling yaml.load() without Loader=... is deprecated, as the default Loader is unsafe. Please read https://msg.pyyaml.org/load for full details. 2025-04-17 18:19:58 WARNING unit.unit-kubeapi-load-balancer-0.collect-metrics logger.go:60 doc = yaml.load(f) 2025-04-17 18:19:58 DEBUG juju.worker.metrics.collect manifold.go:316 ran "collect-metrics" hook (via explicit, bespoke hook script) 2025-04-17 18:20:11 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for kubeapi-load-balancer/0 uniter (run relation-joined (12; unit: easyrsa/0) hook) 2025-04-17 18:20:11 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-joined (12; unit: easyrsa/0) hook" for kubeapi-load-balancer/0 2025-04-17 18:20:11 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-joined (12; unit: easyrsa/0) hook" for kubeapi-load-balancer/0 2025-04-17 18:20:11 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running certificates-relation-joined hook for easyrsa/0 2025-04-17 18:20:11 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-kubeapi-load-balancer-0/agent.socket } 2025-04-17 18:20:12 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Reactive main running for hook certificates-relation-joined 2025-04-17 18:20:12 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer> tracer: set flag endpoint.certificates.joined tracer: ++ queue handler hooks/relations/http/provides.py:15:broken:website tracer: ++ queue handler hooks/relations/http/requires.py:15:broken:apiserver tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/apt.py:50:ensure_package_status tracer: ++ queue handler reactive/load_balancer.py:230:set_nginx_version 2025-04-17 18:20:12 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag endpoint.certificates.changed 2025-04-17 18:20:12 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag endpoint.certificates.changed.egress-subnets 2025-04-17 18:20:12 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag endpoint.certificates.changed.ingress-address 2025-04-17 18:20:12 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag endpoint.certificates.changed.private-address 2025-04-17 18:20:12 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.set.nagios_context 2025-04-17 18:20:12 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.nagios_context 2025-04-17 18:20:12 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.nagios_servicegroups 2025-04-17 18:20:12 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.extra_packages 2025-04-17 18:20:12 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.set.package_status 2025-04-17 18:20:12 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.package_status 2025-04-17 18:20:12 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.install_sources 2025-04-17 18:20:12 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.install_keys 2025-04-17 18:20:12 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.set.port 2025-04-17 18:20:12 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.port 2025-04-17 18:20:12 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.set.host 2025-04-17 18:20:12 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.host 2025-04-17 18:20:12 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.ha-cluster-vip 2025-04-17 18:20:12 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.ha-cluster-dns 2025-04-17 18:20:12 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.extra_sans 2025-04-17 18:20:12 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.set.proxy_read_timeout 2025-04-17 18:20:12 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.proxy_read_timeout 2025-04-17 18:20:12 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.loadbalancer-ips 2025-04-17 18:20:12 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Initializing Leadership Layer (is leader) 2025-04-17 18:20:12 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Initializing Apt Layer 2025-04-17 18:20:12 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer> tracer: starting handler dispatch, 29 flags set tracer: set flag apt.installed.nginx-full tracer: set flag config.default.extra_packages tracer: set flag config.default.extra_sans tracer: set flag config.default.ha-cluster-dns tracer: set flag config.default.ha-cluster-vip tracer: set flag config.default.host tracer: set flag config.default.install_keys tracer: set flag config.default.install_sources tracer: set flag config.default.loadbalancer-ips tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.package_status tracer: set flag config.default.port tracer: set flag config.default.proxy_read_timeout tracer: set flag config.set.host tracer: set flag config.set.nagios_context tracer: set flag config.set.package_status tracer: set flag config.set.port tracer: set flag config.set.proxy_read_timeout tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag endpoint.lb-consumers.changed tracer: set flag endpoint.lb-consumers.created tracer: set flag endpoint.lb-consumers.requests_changed tracer: set flag leadership.is_leader tracer: set flag nginx.available 2025-04-17 18:20:12 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: hooks phase, 0 handlers queued 2025-04-17 18:20:12 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer> tracer: main dispatch loop, 5 handlers queued tracer: ++ queue handler hooks/relations/http/provides.py:15:broken:website tracer: ++ queue handler hooks/relations/http/requires.py:15:broken:apiserver tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/apt.py:50:ensure_package_status tracer: ++ queue handler reactive/load_balancer.py:230:set_nginx_version 2025-04-17 18:20:12 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Invoking reactive handler: reactive/apt.py:50:ensure_package_status 2025-04-17 18:20:12 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Invoking reactive handler: reactive/load_balancer.py:230:set_nginx_version 2025-04-17 18:20:12 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Invoking reactive handler: hooks/relations/http/requires.py:15:broken:apiserver 2025-04-17 18:20:12 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Invoking reactive handler: hooks/relations/http/provides.py:15:broken:website 2025-04-17 18:20:12 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2025-04-17 18:20:12 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer> tracer: set flag certificates.available tracer: ++ queue handler reactive/load_balancer.py:76:request_server_certificates 2025-04-17 18:20:12 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer> tracer: set flag certificates.client.cert.available tracer: ++ queue handler reactive/tls_client.py:71:store_client 2025-04-17 18:20:12 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Invoking reactive handler: reactive/load_balancer.py:76:request_server_certificates 2025-04-17 18:20:12 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Invoking reactive handler: reactive/tls_client.py:71:store_client 2025-04-17 18:20:13 INFO juju.worker.uniter.operation runhook.go:159 ran "certificates-relation-joined" hook (via explicit, bespoke hook script) 2025-04-17 18:20:13 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-joined (12; unit: easyrsa/0) hook" for kubeapi-load-balancer/0 2025-04-17 18:20:13 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2025-04-17 18:20:13 DEBUG juju.machinelock machinelock.go:186 machine lock released for kubeapi-load-balancer/0 uniter (run relation-joined (12; unit: easyrsa/0) hook) 2025-04-17 18:20:13 DEBUG juju.worker.uniter.operation executor.go:121 lock released for kubeapi-load-balancer/0 2025-04-17 18:20:13 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2025-04-17 18:20:13 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (12; unit: easyrsa/0) hook for kubeapi-load-balancer/0 2025-04-17 18:20:13 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for kubeapi-load-balancer/0 uniter (run relation-changed (12; unit: easyrsa/0) hook) 2025-04-17 18:20:24 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for kubeapi-load-balancer/0 : {12 {map[easyrsa/0:{1}] map[] []}} 2025-04-17 18:20:26 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for kubeapi-load-balancer/0 uniter (run relation-changed (12; unit: easyrsa/0) hook) 2025-04-17 18:20:26 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (12; unit: easyrsa/0) hook" for kubeapi-load-balancer/0 2025-04-17 18:20:26 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (12; unit: easyrsa/0) hook" for kubeapi-load-balancer/0 2025-04-17 18:20:26 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running certificates-relation-changed hook for easyrsa/0 2025-04-17 18:20:26 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-kubeapi-load-balancer-0/agent.socket } 2025-04-17 18:20:26 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Reactive main running for hook certificates-relation-changed 2025-04-17 18:20:26 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer> tracer: set flag endpoint.certificates.changed.ca tracer: ++ queue handler hooks/relations/http/provides.py:15:broken:website tracer: ++ queue handler hooks/relations/http/requires.py:15:broken:apiserver tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/apt.py:50:ensure_package_status tracer: ++ queue handler reactive/load_balancer.py:230:set_nginx_version tracer: ++ queue handler reactive/load_balancer.py:76:request_server_certificates tracer: ++ queue handler reactive/tls_client.py:71:store_client 2025-04-17 18:20:26 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag endpoint.certificates.changed.client.cert 2025-04-17 18:20:26 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag endpoint.certificates.changed.client.key 2025-04-17 18:20:26 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.set.nagios_context 2025-04-17 18:20:26 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.nagios_context 2025-04-17 18:20:26 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.nagios_servicegroups 2025-04-17 18:20:26 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.extra_packages 2025-04-17 18:20:26 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.set.package_status 2025-04-17 18:20:26 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.package_status 2025-04-17 18:20:26 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.install_sources 2025-04-17 18:20:26 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.install_keys 2025-04-17 18:20:26 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.set.port 2025-04-17 18:20:26 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.port 2025-04-17 18:20:26 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.set.host 2025-04-17 18:20:26 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.host 2025-04-17 18:20:26 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.ha-cluster-vip 2025-04-17 18:20:26 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.ha-cluster-dns 2025-04-17 18:20:27 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.extra_sans 2025-04-17 18:20:27 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.set.proxy_read_timeout 2025-04-17 18:20:27 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.proxy_read_timeout 2025-04-17 18:20:27 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.loadbalancer-ips 2025-04-17 18:20:27 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Initializing Leadership Layer (is leader) 2025-04-17 18:20:27 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Initializing Apt Layer 2025-04-17 18:20:27 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer> tracer: starting handler dispatch, 34 flags set tracer: set flag apt.installed.nginx-full tracer: set flag certificates.available tracer: set flag certificates.client.cert.available tracer: set flag config.default.extra_packages tracer: set flag config.default.extra_sans tracer: set flag config.default.ha-cluster-dns tracer: set flag config.default.ha-cluster-vip tracer: set flag config.default.host tracer: set flag config.default.install_keys tracer: set flag config.default.install_sources tracer: set flag config.default.loadbalancer-ips tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.package_status tracer: set flag config.default.port tracer: set flag config.default.proxy_read_timeout tracer: set flag config.set.host tracer: set flag config.set.nagios_context tracer: set flag config.set.package_status tracer: set flag config.set.port tracer: set flag config.set.proxy_read_timeout tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag endpoint.lb-consumers.changed tracer: set flag endpoint.lb-consumers.created tracer: set flag endpoint.lb-consumers.requests_changed tracer: set flag leadership.is_leader tracer: set flag nginx.available 2025-04-17 18:20:27 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: hooks phase, 0 handlers queued 2025-04-17 18:20:27 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer> tracer: main dispatch loop, 7 handlers queued tracer: ++ queue handler hooks/relations/http/provides.py:15:broken:website tracer: ++ queue handler hooks/relations/http/requires.py:15:broken:apiserver tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/apt.py:50:ensure_package_status tracer: ++ queue handler reactive/load_balancer.py:230:set_nginx_version tracer: ++ queue handler reactive/load_balancer.py:76:request_server_certificates tracer: ++ queue handler reactive/tls_client.py:71:store_client 2025-04-17 18:20:27 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Invoking reactive handler: reactive/apt.py:50:ensure_package_status 2025-04-17 18:20:27 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Invoking reactive handler: reactive/load_balancer.py:76:request_server_certificates 2025-04-17 18:20:27 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Invoking reactive handler: reactive/load_balancer.py:230:set_nginx_version 2025-04-17 18:20:27 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Invoking reactive handler: reactive/tls_client.py:71:store_client 2025-04-17 18:20:27 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Invoking reactive handler: hooks/relations/http/requires.py:15:broken:apiserver 2025-04-17 18:20:27 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Invoking reactive handler: hooks/relations/http/provides.py:15:broken:website 2025-04-17 18:20:27 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2025-04-17 18:20:27 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer> tracer: set flag certificates.ca.available tracer: ++ queue handler reactive/tls_client.py:18:store_ca 2025-04-17 18:20:27 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag certificates.ca.changed 2025-04-17 18:20:27 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Invoking reactive handler: reactive/tls_client.py:18:store_ca 2025-04-17 18:20:27 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Writing CA certificate to /srv/kubernetes/ca.crt 2025-04-17 18:20:27 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag tls_client.ca.written 2025-04-17 18:20:27 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag tls_client.ca.saved 2025-04-17 18:20:27 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Writing CA certificate to /usr/local/share/ca-certificates/kubeapi-load-balancer.crt 2025-04-17 18:20:27 DEBUG unit.kubeapi-load-balancer/0.certificates-relation-changed logger.go:60 Updating certificates in /etc/ssl/certs... 2025-04-17 18:20:28 WARNING unit.kubeapi-load-balancer/0.certificates-relation-changed logger.go:60 rehash: warning: skipping duplicate certificate in kubeapi-load-balancer.pem 2025-04-17 18:20:28 WARNING unit.kubeapi-load-balancer/0.certificates-relation-changed logger.go:60 rehash: warning: skipping ca-certificates.crt,it does not contain exactly one certificate or CRL 2025-04-17 18:20:28 DEBUG unit.kubeapi-load-balancer/0.certificates-relation-changed logger.go:60 1 added, 0 removed; done. 2025-04-17 18:20:28 DEBUG unit.kubeapi-load-balancer/0.certificates-relation-changed logger.go:60 Running hooks in /etc/ca-certificates/update.d... 2025-04-17 18:20:28 DEBUG unit.kubeapi-load-balancer/0.certificates-relation-changed logger.go:60 done. 2025-04-17 18:20:28 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Generated ca-certificates.crt for kubeapi-load-balancer 2025-04-17 18:20:28 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag tls_client.ca_installed 2025-04-17 18:20:28 INFO juju.worker.uniter.operation runhook.go:159 ran "certificates-relation-changed" hook (via explicit, bespoke hook script) 2025-04-17 18:20:28 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (12; unit: easyrsa/0) hook" for kubeapi-load-balancer/0 2025-04-17 18:20:28 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2025-04-17 18:20:28 DEBUG juju.machinelock machinelock.go:186 machine lock released for kubeapi-load-balancer/0 uniter (run relation-changed (12; unit: easyrsa/0) hook) 2025-04-17 18:20:28 DEBUG juju.worker.uniter.operation executor.go:121 lock released for kubeapi-load-balancer/0 2025-04-17 18:20:28 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2025-04-17 18:20:28 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 12 2025-04-17 18:20:28 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (12; unit: easyrsa/0) hook for kubeapi-load-balancer/0 2025-04-17 18:20:28 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for kubeapi-load-balancer/0 uniter (run relation-changed (12; unit: easyrsa/0) hook) 2025-04-17 18:20:41 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for kubeapi-load-balancer/0 uniter (run relation-changed (12; unit: easyrsa/0) hook) 2025-04-17 18:20:41 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (12; unit: easyrsa/0) hook" for kubeapi-load-balancer/0 2025-04-17 18:20:41 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (12; unit: easyrsa/0) hook" for kubeapi-load-balancer/0 2025-04-17 18:20:41 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-kubeapi-load-balancer-0/agent.socket } 2025-04-17 18:20:42 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Reactive main running for hook certificates-relation-changed 2025-04-17 18:20:42 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/http/provides.py:15:broken:website tracer: ++ queue handler hooks/relations/http/requires.py:15:broken:apiserver tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/apt.py:50:ensure_package_status tracer: ++ queue handler reactive/load_balancer.py:230:set_nginx_version tracer: ++ queue handler reactive/load_balancer.py:76:request_server_certificates tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:71:store_client 2025-04-17 18:20:42 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.nagios_context 2025-04-17 18:20:42 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.nagios_servicegroups 2025-04-17 18:20:42 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.extra_packages 2025-04-17 18:20:42 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.set.package_status 2025-04-17 18:20:42 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.package_status 2025-04-17 18:20:42 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.install_sources 2025-04-17 18:20:42 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.install_keys 2025-04-17 18:20:42 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.set.port 2025-04-17 18:20:42 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.port 2025-04-17 18:20:42 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.set.host 2025-04-17 18:20:42 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.host 2025-04-17 18:20:42 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.ha-cluster-vip 2025-04-17 18:20:42 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.ha-cluster-dns 2025-04-17 18:20:42 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.extra_sans 2025-04-17 18:20:42 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.set.proxy_read_timeout 2025-04-17 18:20:42 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.proxy_read_timeout 2025-04-17 18:20:42 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.loadbalancer-ips 2025-04-17 18:20:42 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Initializing Leadership Layer (is leader) 2025-04-17 18:20:42 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Initializing Apt Layer 2025-04-17 18:20:42 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer> tracer: starting handler dispatch, 39 flags set tracer: set flag apt.installed.nginx-full tracer: set flag certificates.available tracer: set flag certificates.ca.available tracer: set flag certificates.ca.changed tracer: set flag certificates.client.cert.available tracer: set flag config.default.extra_packages tracer: set flag config.default.extra_sans tracer: set flag config.default.ha-cluster-dns tracer: set flag config.default.ha-cluster-vip tracer: set flag config.default.host tracer: set flag config.default.install_keys tracer: set flag config.default.install_sources tracer: set flag config.default.loadbalancer-ips tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.package_status tracer: set flag config.default.port tracer: set flag config.default.proxy_read_timeout tracer: set flag config.set.host tracer: set flag config.set.nagios_context tracer: set flag config.set.package_status tracer: set flag config.set.port tracer: set flag config.set.proxy_read_timeout tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag endpoint.lb-consumers.changed tracer: set flag endpoint.lb-consumers.created tracer: set flag endpoint.lb-consumers.requests_changed tracer: set flag leadership.is_leader tracer: set flag nginx.available tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca.written tracer: set flag tls_client.ca_installed 2025-04-17 18:20:42 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: hooks phase, 0 handlers queued 2025-04-17 18:20:42 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer> tracer: main dispatch loop, 8 handlers queued tracer: ++ queue handler hooks/relations/http/provides.py:15:broken:website tracer: ++ queue handler hooks/relations/http/requires.py:15:broken:apiserver tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/apt.py:50:ensure_package_status tracer: ++ queue handler reactive/load_balancer.py:230:set_nginx_version tracer: ++ queue handler reactive/load_balancer.py:76:request_server_certificates tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:71:store_client 2025-04-17 18:20:42 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Invoking reactive handler: reactive/apt.py:50:ensure_package_status 2025-04-17 18:20:42 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Invoking reactive handler: reactive/load_balancer.py:76:request_server_certificates 2025-04-17 18:20:42 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Invoking reactive handler: reactive/load_balancer.py:230:set_nginx_version 2025-04-17 18:20:42 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Invoking reactive handler: reactive/tls_client.py:18:store_ca 2025-04-17 18:20:42 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Invoking reactive handler: reactive/tls_client.py:71:store_client 2025-04-17 18:20:42 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Invoking reactive handler: hooks/relations/http/requires.py:15:broken:apiserver 2025-04-17 18:20:42 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Invoking reactive handler: hooks/relations/http/provides.py:15:broken:website 2025-04-17 18:20:42 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2025-04-17 18:20:42 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: cleared flag certificates.ca.changed 2025-04-17 18:20:42 INFO juju.worker.uniter.operation runhook.go:159 ran "certificates-relation-changed" hook (via explicit, bespoke hook script) 2025-04-17 18:20:42 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (12; unit: easyrsa/0) hook" for kubeapi-load-balancer/0 2025-04-17 18:20:42 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2025-04-17 18:20:42 DEBUG juju.machinelock machinelock.go:186 machine lock released for kubeapi-load-balancer/0 uniter (run relation-changed (12; unit: easyrsa/0) hook) 2025-04-17 18:20:42 DEBUG juju.worker.uniter.operation executor.go:121 lock released for kubeapi-load-balancer/0 2025-04-17 18:20:42 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2025-04-17 18:20:42 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (5; app: kubernetes-control-plane) hook for kubeapi-load-balancer/0 2025-04-17 18:20:42 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for kubeapi-load-balancer/0 uniter (run relation-changed (5; app: kubernetes-control-plane) hook) 2025-04-17 18:20:53 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for kubeapi-load-balancer/0 uniter (run relation-changed (5; app: kubernetes-control-plane) hook) 2025-04-17 18:20:53 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (5; app: kubernetes-control-plane) hook" for kubeapi-load-balancer/0 2025-04-17 18:20:53 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (5; app: kubernetes-control-plane) hook" for kubeapi-load-balancer/0 2025-04-17 18:20:53 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running lb-consumers-relation-changed hook 2025-04-17 18:20:53 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-kubeapi-load-balancer-0/agent.socket } 2025-04-17 18:20:53 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: Reactive main running for hook lb-consumers-relation-changed 2025-04-17 18:20:54 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/http/provides.py:15:broken:website tracer: ++ queue handler hooks/relations/http/requires.py:15:broken:apiserver tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/apt.py:50:ensure_package_status tracer: ++ queue handler reactive/load_balancer.py:230:set_nginx_version tracer: ++ queue handler reactive/load_balancer.py:76:request_server_certificates tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:71:store_client 2025-04-17 18:20:54 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.default.nagios_context 2025-04-17 18:20:54 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.default.nagios_servicegroups 2025-04-17 18:20:54 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.default.extra_packages 2025-04-17 18:20:54 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.set.package_status 2025-04-17 18:20:54 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.default.package_status 2025-04-17 18:20:54 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.default.install_sources 2025-04-17 18:20:54 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.default.install_keys 2025-04-17 18:20:54 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.set.port 2025-04-17 18:20:54 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.default.port 2025-04-17 18:20:54 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.set.host 2025-04-17 18:20:54 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.default.host 2025-04-17 18:20:54 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.default.ha-cluster-vip 2025-04-17 18:20:54 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.default.ha-cluster-dns 2025-04-17 18:20:54 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.default.extra_sans 2025-04-17 18:20:54 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.set.proxy_read_timeout 2025-04-17 18:20:54 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.default.proxy_read_timeout 2025-04-17 18:20:54 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.default.loadbalancer-ips 2025-04-17 18:20:54 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: Initializing Leadership Layer (is leader) 2025-04-17 18:20:54 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: Initializing Apt Layer 2025-04-17 18:20:54 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer> tracer: starting handler dispatch, 38 flags set tracer: set flag apt.installed.nginx-full tracer: set flag certificates.available tracer: set flag certificates.ca.available tracer: set flag certificates.client.cert.available tracer: set flag config.default.extra_packages tracer: set flag config.default.extra_sans tracer: set flag config.default.ha-cluster-dns tracer: set flag config.default.ha-cluster-vip tracer: set flag config.default.host tracer: set flag config.default.install_keys tracer: set flag config.default.install_sources tracer: set flag config.default.loadbalancer-ips tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.package_status tracer: set flag config.default.port tracer: set flag config.default.proxy_read_timeout tracer: set flag config.set.host tracer: set flag config.set.nagios_context tracer: set flag config.set.package_status tracer: set flag config.set.port tracer: set flag config.set.proxy_read_timeout tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag endpoint.lb-consumers.changed tracer: set flag endpoint.lb-consumers.created tracer: set flag endpoint.lb-consumers.requests_changed tracer: set flag leadership.is_leader tracer: set flag nginx.available tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca.written tracer: set flag tls_client.ca_installed 2025-04-17 18:20:54 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: hooks phase, 0 handlers queued 2025-04-17 18:20:54 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer> tracer: main dispatch loop, 8 handlers queued tracer: ++ queue handler hooks/relations/http/provides.py:15:broken:website tracer: ++ queue handler hooks/relations/http/requires.py:15:broken:apiserver tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/apt.py:50:ensure_package_status tracer: ++ queue handler reactive/load_balancer.py:230:set_nginx_version tracer: ++ queue handler reactive/load_balancer.py:76:request_server_certificates tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:71:store_client 2025-04-17 18:20:54 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: Invoking reactive handler: reactive/apt.py:50:ensure_package_status 2025-04-17 18:20:54 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: Invoking reactive handler: reactive/load_balancer.py:76:request_server_certificates 2025-04-17 18:20:54 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: Invoking reactive handler: reactive/load_balancer.py:230:set_nginx_version 2025-04-17 18:20:54 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: Invoking reactive handler: reactive/tls_client.py:18:store_ca 2025-04-17 18:20:54 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: Invoking reactive handler: reactive/tls_client.py:71:store_client 2025-04-17 18:20:54 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: Invoking reactive handler: hooks/relations/http/requires.py:15:broken:apiserver 2025-04-17 18:20:54 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: Invoking reactive handler: hooks/relations/http/provides.py:15:broken:website 2025-04-17 18:20:54 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2025-04-17 18:20:54 INFO juju.worker.uniter.operation runhook.go:159 ran "lb-consumers-relation-changed" hook (via explicit, bespoke hook script) 2025-04-17 18:20:54 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (5; app: kubernetes-control-plane) hook" for kubeapi-load-balancer/0 2025-04-17 18:20:54 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2025-04-17 18:20:54 DEBUG juju.machinelock machinelock.go:186 machine lock released for kubeapi-load-balancer/0 uniter (run relation-changed (5; app: kubernetes-control-plane) hook) 2025-04-17 18:20:54 DEBUG juju.worker.uniter.operation executor.go:121 lock released for kubeapi-load-balancer/0 2025-04-17 18:20:54 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2025-04-17 18:20:54 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (6; app: kubernetes-control-plane) hook for kubeapi-load-balancer/0 2025-04-17 18:20:54 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for kubeapi-load-balancer/0 uniter (run relation-changed (6; app: kubernetes-control-plane) hook) 2025-04-17 18:21:05 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for kubeapi-load-balancer/0 uniter (run relation-changed (6; app: kubernetes-control-plane) hook) 2025-04-17 18:21:05 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (6; app: kubernetes-control-plane) hook" for kubeapi-load-balancer/0 2025-04-17 18:21:05 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (6; app: kubernetes-control-plane) hook" for kubeapi-load-balancer/0 2025-04-17 18:21:05 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-kubeapi-load-balancer-0/agent.socket } 2025-04-17 18:21:05 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Reactive main running for hook lb-consumers-relation-changed 2025-04-17 18:21:05 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/http/provides.py:15:broken:website tracer: ++ queue handler hooks/relations/http/requires.py:15:broken:apiserver tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/apt.py:50:ensure_package_status tracer: ++ queue handler reactive/load_balancer.py:230:set_nginx_version tracer: ++ queue handler reactive/load_balancer.py:76:request_server_certificates tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:71:store_client 2025-04-17 18:21:05 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.default.nagios_context 2025-04-17 18:21:05 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.default.nagios_servicegroups 2025-04-17 18:21:05 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.default.extra_packages 2025-04-17 18:21:05 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.set.package_status 2025-04-17 18:21:05 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.default.package_status 2025-04-17 18:21:05 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.default.install_sources 2025-04-17 18:21:05 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.default.install_keys 2025-04-17 18:21:05 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.set.port 2025-04-17 18:21:06 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.default.port 2025-04-17 18:21:06 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.set.host 2025-04-17 18:21:06 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.default.host 2025-04-17 18:21:06 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.default.ha-cluster-vip 2025-04-17 18:21:06 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.default.ha-cluster-dns 2025-04-17 18:21:06 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.default.extra_sans 2025-04-17 18:21:06 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.set.proxy_read_timeout 2025-04-17 18:21:06 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.default.proxy_read_timeout 2025-04-17 18:21:06 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.default.loadbalancer-ips 2025-04-17 18:21:06 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Initializing Leadership Layer (is leader) 2025-04-17 18:21:06 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Initializing Apt Layer 2025-04-17 18:21:06 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer> tracer: starting handler dispatch, 38 flags set tracer: set flag apt.installed.nginx-full tracer: set flag certificates.available tracer: set flag certificates.ca.available tracer: set flag certificates.client.cert.available tracer: set flag config.default.extra_packages tracer: set flag config.default.extra_sans tracer: set flag config.default.ha-cluster-dns tracer: set flag config.default.ha-cluster-vip tracer: set flag config.default.host tracer: set flag config.default.install_keys tracer: set flag config.default.install_sources tracer: set flag config.default.loadbalancer-ips tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.package_status tracer: set flag config.default.port tracer: set flag config.default.proxy_read_timeout tracer: set flag config.set.host tracer: set flag config.set.nagios_context tracer: set flag config.set.package_status tracer: set flag config.set.port tracer: set flag config.set.proxy_read_timeout tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag endpoint.lb-consumers.changed tracer: set flag endpoint.lb-consumers.created tracer: set flag endpoint.lb-consumers.requests_changed tracer: set flag leadership.is_leader tracer: set flag nginx.available tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca.written tracer: set flag tls_client.ca_installed 2025-04-17 18:21:06 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: hooks phase, 0 handlers queued 2025-04-17 18:21:06 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer> tracer: main dispatch loop, 8 handlers queued tracer: ++ queue handler hooks/relations/http/provides.py:15:broken:website tracer: ++ queue handler hooks/relations/http/requires.py:15:broken:apiserver tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/apt.py:50:ensure_package_status tracer: ++ queue handler reactive/load_balancer.py:230:set_nginx_version tracer: ++ queue handler reactive/load_balancer.py:76:request_server_certificates tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:71:store_client 2025-04-17 18:21:06 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Invoking reactive handler: reactive/apt.py:50:ensure_package_status 2025-04-17 18:21:06 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Invoking reactive handler: reactive/load_balancer.py:76:request_server_certificates 2025-04-17 18:21:06 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Invoking reactive handler: reactive/load_balancer.py:230:set_nginx_version 2025-04-17 18:21:06 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Invoking reactive handler: reactive/tls_client.py:18:store_ca 2025-04-17 18:21:06 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Invoking reactive handler: reactive/tls_client.py:71:store_client 2025-04-17 18:21:06 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Invoking reactive handler: hooks/relations/http/requires.py:15:broken:apiserver 2025-04-17 18:21:06 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Invoking reactive handler: hooks/relations/http/provides.py:15:broken:website 2025-04-17 18:21:06 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2025-04-17 18:21:06 INFO juju.worker.uniter.operation runhook.go:159 ran "lb-consumers-relation-changed" hook (via explicit, bespoke hook script) 2025-04-17 18:21:06 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (6; app: kubernetes-control-plane) hook" for kubeapi-load-balancer/0 2025-04-17 18:21:06 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2025-04-17 18:21:06 DEBUG juju.machinelock machinelock.go:186 machine lock released for kubeapi-load-balancer/0 uniter (run relation-changed (6; app: kubernetes-control-plane) hook) 2025-04-17 18:21:06 DEBUG juju.worker.uniter.operation executor.go:121 lock released for kubeapi-load-balancer/0 2025-04-17 18:21:06 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2025-04-17 18:21:06 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-joined (5; unit: kubernetes-control-plane/0) hook for kubeapi-load-balancer/0 2025-04-17 18:21:06 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for kubeapi-load-balancer/0 uniter (run relation-joined (5; unit: kubernetes-control-plane/0) hook) 2025-04-17 18:21:20 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for kubeapi-load-balancer/0 2025-04-17 18:21:23 DEBUG juju.worker.uniter.remotestate watcher.go:660 got a relation units change for kubeapi-load-balancer/0 : {12 {map[easyrsa/0:{2}] map[] []}} 2025-04-17 18:21:23 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for kubeapi-load-balancer/0 uniter (run relation-joined (5; unit: kubernetes-control-plane/0) hook) 2025-04-17 18:21:23 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-joined (5; unit: kubernetes-control-plane/0) hook" for kubeapi-load-balancer/0 2025-04-17 18:21:23 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-joined (5; unit: kubernetes-control-plane/0) hook" for kubeapi-load-balancer/0 2025-04-17 18:21:23 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running lb-consumers-relation-joined hook for kubernetes-control-plane/0 2025-04-17 18:21:23 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-kubeapi-load-balancer-0/agent.socket } 2025-04-17 18:21:24 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: Reactive main running for hook lb-consumers-relation-joined 2025-04-17 18:21:24 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer> tracer: set flag endpoint.lb-consumers.joined tracer: ++ queue handler hooks/relations/http/provides.py:15:broken:website tracer: ++ queue handler hooks/relations/http/requires.py:15:broken:apiserver tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/apt.py:50:ensure_package_status tracer: ++ queue handler reactive/load_balancer.py:230:set_nginx_version tracer: ++ queue handler reactive/load_balancer.py:276:provide_lb_consumers tracer: ++ queue handler reactive/load_balancer.py:76:request_server_certificates tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:71:store_client 2025-04-17 18:21:24 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.set.nagios_context 2025-04-17 18:21:24 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.default.nagios_context 2025-04-17 18:21:24 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.default.nagios_servicegroups 2025-04-17 18:21:24 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.default.extra_packages 2025-04-17 18:21:24 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.set.package_status 2025-04-17 18:21:24 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.default.package_status 2025-04-17 18:21:24 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.default.install_sources 2025-04-17 18:21:24 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.default.install_keys 2025-04-17 18:21:24 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.set.port 2025-04-17 18:21:24 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.default.port 2025-04-17 18:21:24 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.set.host 2025-04-17 18:21:24 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.default.host 2025-04-17 18:21:24 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.default.ha-cluster-vip 2025-04-17 18:21:24 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.default.ha-cluster-dns 2025-04-17 18:21:24 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.default.extra_sans 2025-04-17 18:21:24 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.set.proxy_read_timeout 2025-04-17 18:21:24 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.default.proxy_read_timeout 2025-04-17 18:21:24 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.default.loadbalancer-ips 2025-04-17 18:21:24 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: Initializing Leadership Layer (is leader) 2025-04-17 18:21:24 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: Initializing Apt Layer 2025-04-17 18:21:24 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer> tracer: starting handler dispatch, 39 flags set tracer: set flag apt.installed.nginx-full tracer: set flag certificates.available tracer: set flag certificates.ca.available tracer: set flag certificates.client.cert.available tracer: set flag config.default.extra_packages tracer: set flag config.default.extra_sans tracer: set flag config.default.ha-cluster-dns tracer: set flag config.default.ha-cluster-vip tracer: set flag config.default.host tracer: set flag config.default.install_keys tracer: set flag config.default.install_sources tracer: set flag config.default.loadbalancer-ips tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.package_status tracer: set flag config.default.port tracer: set flag config.default.proxy_read_timeout tracer: set flag config.set.host tracer: set flag config.set.nagios_context tracer: set flag config.set.package_status tracer: set flag config.set.port tracer: set flag config.set.proxy_read_timeout tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag endpoint.lb-consumers.changed tracer: set flag endpoint.lb-consumers.created tracer: set flag endpoint.lb-consumers.joined tracer: set flag endpoint.lb-consumers.requests_changed tracer: set flag leadership.is_leader tracer: set flag nginx.available tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca.written tracer: set flag tls_client.ca_installed 2025-04-17 18:21:24 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: hooks phase, 0 handlers queued 2025-04-17 18:21:24 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer> tracer: main dispatch loop, 9 handlers queued tracer: ++ queue handler hooks/relations/http/provides.py:15:broken:website tracer: ++ queue handler hooks/relations/http/requires.py:15:broken:apiserver tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/apt.py:50:ensure_package_status tracer: ++ queue handler reactive/load_balancer.py:230:set_nginx_version tracer: ++ queue handler reactive/load_balancer.py:276:provide_lb_consumers tracer: ++ queue handler reactive/load_balancer.py:76:request_server_certificates tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:71:store_client 2025-04-17 18:21:24 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: Invoking reactive handler: reactive/apt.py:50:ensure_package_status 2025-04-17 18:21:24 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: Invoking reactive handler: reactive/load_balancer.py:76:request_server_certificates 2025-04-17 18:21:24 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: Invoking reactive handler: reactive/load_balancer.py:230:set_nginx_version 2025-04-17 18:21:24 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: Invoking reactive handler: reactive/load_balancer.py:276:provide_lb_consumers 2025-04-17 18:21:24 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: cleared flag endpoint.lb-consumers.requests_changed 2025-04-17 18:21:24 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: Invoking reactive handler: reactive/tls_client.py:18:store_ca 2025-04-17 18:21:24 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: Invoking reactive handler: reactive/tls_client.py:71:store_client 2025-04-17 18:21:24 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: Invoking reactive handler: hooks/relations/http/requires.py:15:broken:apiserver 2025-04-17 18:21:24 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: Invoking reactive handler: hooks/relations/http/provides.py:15:broken:website 2025-04-17 18:21:24 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2025-04-17 18:21:25 INFO juju.worker.uniter.operation runhook.go:159 ran "lb-consumers-relation-joined" hook (via explicit, bespoke hook script) 2025-04-17 18:21:25 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-joined (5; unit: kubernetes-control-plane/0) hook" for kubeapi-load-balancer/0 2025-04-17 18:21:25 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2025-04-17 18:21:25 DEBUG juju.machinelock machinelock.go:186 machine lock released for kubeapi-load-balancer/0 uniter (run relation-joined (5; unit: kubernetes-control-plane/0) hook) 2025-04-17 18:21:25 DEBUG juju.worker.uniter.operation executor.go:121 lock released for kubeapi-load-balancer/0 2025-04-17 18:21:25 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2025-04-17 18:21:25 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (5; unit: kubernetes-control-plane/0) hook for kubeapi-load-balancer/0 2025-04-17 18:21:25 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for kubeapi-load-balancer/0 uniter (run relation-changed (5; unit: kubernetes-control-plane/0) hook) 2025-04-17 18:21:40 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for kubeapi-load-balancer/0 uniter (run relation-changed (5; unit: kubernetes-control-plane/0) hook) 2025-04-17 18:21:40 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (5; unit: kubernetes-control-plane/0) hook" for kubeapi-load-balancer/0 2025-04-17 18:21:40 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (5; unit: kubernetes-control-plane/0) hook" for kubeapi-load-balancer/0 2025-04-17 18:21:40 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running lb-consumers-relation-changed hook for kubernetes-control-plane/0 2025-04-17 18:21:40 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-kubeapi-load-balancer-0/agent.socket } 2025-04-17 18:21:40 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: Reactive main running for hook lb-consumers-relation-changed 2025-04-17 18:21:40 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer> tracer: cleared flag endpoint.lb-consumers.changed tracer: ++ queue handler hooks/relations/http/provides.py:15:broken:website tracer: ++ queue handler hooks/relations/http/requires.py:15:broken:apiserver tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/apt.py:50:ensure_package_status tracer: ++ queue handler reactive/load_balancer.py:230:set_nginx_version tracer: ++ queue handler reactive/load_balancer.py:276:provide_lb_consumers tracer: ++ queue handler reactive/load_balancer.py:76:request_server_certificates tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:71:store_client 2025-04-17 18:21:40 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.set.nagios_context 2025-04-17 18:21:40 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.default.nagios_context 2025-04-17 18:21:40 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.default.nagios_servicegroups 2025-04-17 18:21:40 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.default.extra_packages 2025-04-17 18:21:40 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.set.package_status 2025-04-17 18:21:40 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.default.package_status 2025-04-17 18:21:40 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.default.install_sources 2025-04-17 18:21:40 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.default.install_keys 2025-04-17 18:21:40 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.set.port 2025-04-17 18:21:41 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.default.port 2025-04-17 18:21:41 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.set.host 2025-04-17 18:21:41 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.default.host 2025-04-17 18:21:41 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.default.ha-cluster-vip 2025-04-17 18:21:41 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.default.ha-cluster-dns 2025-04-17 18:21:41 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.default.extra_sans 2025-04-17 18:21:41 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.set.proxy_read_timeout 2025-04-17 18:21:41 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.default.proxy_read_timeout 2025-04-17 18:21:41 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: set flag config.default.loadbalancer-ips 2025-04-17 18:21:41 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: Initializing Leadership Layer (is leader) 2025-04-17 18:21:41 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: Initializing Apt Layer 2025-04-17 18:21:41 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer> tracer: starting handler dispatch, 37 flags set tracer: set flag apt.installed.nginx-full tracer: set flag certificates.available tracer: set flag certificates.ca.available tracer: set flag certificates.client.cert.available tracer: set flag config.default.extra_packages tracer: set flag config.default.extra_sans tracer: set flag config.default.ha-cluster-dns tracer: set flag config.default.ha-cluster-vip tracer: set flag config.default.host tracer: set flag config.default.install_keys tracer: set flag config.default.install_sources tracer: set flag config.default.loadbalancer-ips tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.package_status tracer: set flag config.default.port tracer: set flag config.default.proxy_read_timeout tracer: set flag config.set.host tracer: set flag config.set.nagios_context tracer: set flag config.set.package_status tracer: set flag config.set.port tracer: set flag config.set.proxy_read_timeout tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag endpoint.lb-consumers.created tracer: set flag endpoint.lb-consumers.joined tracer: set flag leadership.is_leader tracer: set flag nginx.available tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca.written tracer: set flag tls_client.ca_installed 2025-04-17 18:21:41 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer: hooks phase, 0 handlers queued 2025-04-17 18:21:41 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: tracer> tracer: main dispatch loop, 9 handlers queued tracer: ++ queue handler hooks/relations/http/provides.py:15:broken:website tracer: ++ queue handler hooks/relations/http/requires.py:15:broken:apiserver tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/apt.py:50:ensure_package_status tracer: ++ queue handler reactive/load_balancer.py:230:set_nginx_version tracer: ++ queue handler reactive/load_balancer.py:276:provide_lb_consumers tracer: ++ queue handler reactive/load_balancer.py:76:request_server_certificates tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:71:store_client 2025-04-17 18:21:41 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: Invoking reactive handler: reactive/apt.py:50:ensure_package_status 2025-04-17 18:21:41 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: Invoking reactive handler: reactive/load_balancer.py:76:request_server_certificates 2025-04-17 18:21:41 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: Invoking reactive handler: reactive/load_balancer.py:230:set_nginx_version 2025-04-17 18:21:41 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: Invoking reactive handler: reactive/load_balancer.py:276:provide_lb_consumers 2025-04-17 18:21:41 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: Invoking reactive handler: reactive/tls_client.py:18:store_ca 2025-04-17 18:21:41 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: Invoking reactive handler: reactive/tls_client.py:71:store_client 2025-04-17 18:21:41 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: Invoking reactive handler: hooks/relations/http/requires.py:15:broken:apiserver 2025-04-17 18:21:41 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: Invoking reactive handler: hooks/relations/http/provides.py:15:broken:website 2025-04-17 18:21:41 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:5: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2025-04-17 18:21:41 INFO juju.worker.uniter.operation runhook.go:159 ran "lb-consumers-relation-changed" hook (via explicit, bespoke hook script) 2025-04-17 18:21:41 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (5; unit: kubernetes-control-plane/0) hook" for kubeapi-load-balancer/0 2025-04-17 18:21:41 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2025-04-17 18:21:41 DEBUG juju.machinelock machinelock.go:186 machine lock released for kubeapi-load-balancer/0 uniter (run relation-changed (5; unit: kubernetes-control-plane/0) hook) 2025-04-17 18:21:41 DEBUG juju.worker.uniter.operation executor.go:121 lock released for kubeapi-load-balancer/0 2025-04-17 18:21:41 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2025-04-17 18:21:41 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 12 2025-04-17 18:21:41 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (12; unit: easyrsa/0) hook for kubeapi-load-balancer/0 2025-04-17 18:21:41 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for kubeapi-load-balancer/0 uniter (run relation-changed (12; unit: easyrsa/0) hook) 2025-04-17 18:21:53 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for kubeapi-load-balancer/0 uniter (run relation-changed (12; unit: easyrsa/0) hook) 2025-04-17 18:21:53 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (12; unit: easyrsa/0) hook" for kubeapi-load-balancer/0 2025-04-17 18:21:53 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (12; unit: easyrsa/0) hook" for kubeapi-load-balancer/0 2025-04-17 18:21:53 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running certificates-relation-changed hook for easyrsa/0 2025-04-17 18:21:53 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-kubeapi-load-balancer-0/agent.socket } 2025-04-17 18:21:53 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Reactive main running for hook certificates-relation-changed 2025-04-17 18:21:53 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer> tracer: set flag endpoint.certificates.changed.kubeapi-load-balancer_0.server.cert tracer: ++ queue handler hooks/relations/http/provides.py:15:broken:website tracer: ++ queue handler hooks/relations/http/requires.py:15:broken:apiserver tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/apt.py:50:ensure_package_status tracer: ++ queue handler reactive/load_balancer.py:230:set_nginx_version tracer: ++ queue handler reactive/load_balancer.py:276:provide_lb_consumers tracer: ++ queue handler reactive/load_balancer.py:76:request_server_certificates tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:71:store_client 2025-04-17 18:21:53 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag endpoint.certificates.changed.kubeapi-load-balancer_0.server.key 2025-04-17 18:21:53 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.set.nagios_context 2025-04-17 18:21:53 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.nagios_context 2025-04-17 18:21:53 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.nagios_servicegroups 2025-04-17 18:21:53 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.extra_packages 2025-04-17 18:21:53 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.set.package_status 2025-04-17 18:21:53 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.package_status 2025-04-17 18:21:53 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.install_sources 2025-04-17 18:21:53 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.install_keys 2025-04-17 18:21:53 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.set.port 2025-04-17 18:21:53 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.port 2025-04-17 18:21:53 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.set.host 2025-04-17 18:21:54 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.host 2025-04-17 18:21:54 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.ha-cluster-vip 2025-04-17 18:21:54 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.ha-cluster-dns 2025-04-17 18:21:54 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.extra_sans 2025-04-17 18:21:54 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.set.proxy_read_timeout 2025-04-17 18:21:54 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.proxy_read_timeout 2025-04-17 18:21:54 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag config.default.loadbalancer-ips 2025-04-17 18:21:54 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Initializing Leadership Layer (is leader) 2025-04-17 18:21:54 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Initializing Apt Layer 2025-04-17 18:21:54 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer> tracer: starting handler dispatch, 39 flags set tracer: set flag apt.installed.nginx-full tracer: set flag certificates.available tracer: set flag certificates.ca.available tracer: set flag certificates.client.cert.available tracer: set flag config.default.extra_packages tracer: set flag config.default.extra_sans tracer: set flag config.default.ha-cluster-dns tracer: set flag config.default.ha-cluster-vip tracer: set flag config.default.host tracer: set flag config.default.install_keys tracer: set flag config.default.install_sources tracer: set flag config.default.loadbalancer-ips tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.package_status tracer: set flag config.default.port tracer: set flag config.default.proxy_read_timeout tracer: set flag config.set.host tracer: set flag config.set.nagios_context tracer: set flag config.set.package_status tracer: set flag config.set.port tracer: set flag config.set.proxy_read_timeout tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.kubeapi-load-balancer_0.server.cert tracer: set flag endpoint.certificates.changed.kubeapi-load-balancer_0.server.key tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag endpoint.lb-consumers.created tracer: set flag endpoint.lb-consumers.joined tracer: set flag leadership.is_leader tracer: set flag nginx.available tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca.written tracer: set flag tls_client.ca_installed 2025-04-17 18:21:54 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: hooks phase, 0 handlers queued 2025-04-17 18:21:54 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer> tracer: main dispatch loop, 9 handlers queued tracer: ++ queue handler hooks/relations/http/provides.py:15:broken:website tracer: ++ queue handler hooks/relations/http/requires.py:15:broken:apiserver tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/apt.py:50:ensure_package_status tracer: ++ queue handler reactive/load_balancer.py:230:set_nginx_version tracer: ++ queue handler reactive/load_balancer.py:276:provide_lb_consumers tracer: ++ queue handler reactive/load_balancer.py:76:request_server_certificates tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:71:store_client 2025-04-17 18:21:54 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Invoking reactive handler: reactive/apt.py:50:ensure_package_status 2025-04-17 18:21:54 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Invoking reactive handler: reactive/load_balancer.py:76:request_server_certificates 2025-04-17 18:21:54 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Invoking reactive handler: reactive/load_balancer.py:230:set_nginx_version 2025-04-17 18:21:54 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Invoking reactive handler: reactive/load_balancer.py:276:provide_lb_consumers 2025-04-17 18:21:54 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Invoking reactive handler: reactive/tls_client.py:18:store_ca 2025-04-17 18:21:54 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Invoking reactive handler: reactive/tls_client.py:71:store_client 2025-04-17 18:21:54 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Invoking reactive handler: hooks/relations/http/requires.py:15:broken:apiserver 2025-04-17 18:21:54 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Invoking reactive handler: hooks/relations/http/provides.py:15:broken:website 2025-04-17 18:21:54 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2025-04-17 18:21:54 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag certificates.server.certs.available 2025-04-17 18:21:54 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag certificates.server.certs.changed 2025-04-17 18:21:54 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag certificates.certs.available 2025-04-17 18:21:54 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer> tracer: set flag certificates.certs.changed tracer: ++ queue handler reactive/tls_client.py:98:update_certs 2025-04-17 18:21:54 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer> tracer: set flag certificates.server.cert.available tracer: ++ queue handler reactive/load_balancer.py:120:kick_nginx tracer: ++ queue handler reactive/tls_client.py:44:store_server 2025-04-17 18:21:54 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag certificates.batch.cert.available 2025-04-17 18:21:54 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Invoking reactive handler: reactive/load_balancer.py:120:kick_nginx 2025-04-17 18:21:54 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Certificate information changed, sending SIGHUP to nginx 2025-04-17 18:21:54 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer> tracer: cleared flag tls_client.ca.written tracer: -- dequeue handler reactive/load_balancer.py:120:kick_nginx 2025-04-17 18:21:54 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Invoking reactive handler: reactive/tls_client.py:44:store_server 2025-04-17 18:21:54 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Invoking reactive handler: reactive/tls_client.py:98:update_certs 2025-04-17 18:21:54 WARNING unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: No client certs found using maps. Checking for global client certificates. 2025-04-17 18:21:54 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag tls_client.server.certs.changed 2025-04-17 18:21:54 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag tls_client.server.cert.10.0.0.50.changed 2025-04-17 18:21:54 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer: set flag tls_client.certs.saved 2025-04-17 18:21:54 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer> tracer: set flag tls_client.certs.changed tracer: ++ queue handler reactive/load_balancer.py:120:kick_nginx 2025-04-17 18:21:54 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer> tracer: cleared flag certificates.certs.changed tracer: -- dequeue handler reactive/tls_client.py:98:update_certs 2025-04-17 18:21:54 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Invoking reactive handler: reactive/load_balancer.py:120:kick_nginx 2025-04-17 18:21:54 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Certificate information changed, sending SIGHUP to nginx 2025-04-17 18:21:54 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: tracer> tracer: cleared flag tls_client.certs.changed tracer: -- dequeue handler reactive/load_balancer.py:120:kick_nginx 2025-04-17 18:21:54 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Invoking reactive handler: reactive/load_balancer.py:156:install_load_balancer 2025-04-17 18:21:54 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: status-set: maintenance: Configuring site apilb 2025-04-17 18:21:54 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Writing file /etc/nginx/sites-available/apilb root:root 444 2025-04-17 18:21:54 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: Wrote vhost config {'host': '127.0.0.1', 'port': 443, 'servers': {443: {('10.0.0.50', 6443)}, 6443: set()}, 'server_certificate': '/srv/kubernetes/server.crt', 'server_key': '/srv/kubernetes/server.key', 'proxy_read_timeout': 600} to apilb.conf 2025-04-17 18:21:54 WARNING unit.kubeapi-load-balancer/0.certificates-relation-changed logger.go:60 Job for nginx.service failed. 2025-04-17 18:21:54 WARNING unit.kubeapi-load-balancer/0.certificates-relation-changed logger.go:60 See "systemctl status nginx.service" and "journalctl -xe" for details. 2025-04-17 18:21:54 WARNING unit.kubeapi-load-balancer/0.certificates-relation-changed logger.go:60 Job for nginx.service failed because the control process exited with error code. 2025-04-17 18:21:54 WARNING unit.kubeapi-load-balancer/0.certificates-relation-changed logger.go:60 See "systemctl status nginx.service" and "journalctl -xe" for details. 2025-04-17 18:21:54 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 certificates:12: status-set: active: Loadbalancer ready. 2025-04-17 18:21:55 INFO juju.worker.uniter.operation runhook.go:159 ran "certificates-relation-changed" hook (via explicit, bespoke hook script) 2025-04-17 18:21:55 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (12; unit: easyrsa/0) hook" for kubeapi-load-balancer/0 2025-04-17 18:21:55 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2025-04-17 18:21:55 DEBUG juju.machinelock machinelock.go:186 machine lock released for kubeapi-load-balancer/0 uniter (run relation-changed (12; unit: easyrsa/0) hook) 2025-04-17 18:21:55 DEBUG juju.worker.uniter.operation executor.go:121 lock released for kubeapi-load-balancer/0 2025-04-17 18:21:55 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2025-04-17 18:21:55 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 12 2025-04-17 18:21:55 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-control-plane/0" already joined relation 5 2025-04-17 18:21:55 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-joined (6; unit: kubernetes-control-plane/0) hook for kubeapi-load-balancer/0 2025-04-17 18:21:55 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for kubeapi-load-balancer/0 uniter (run relation-joined (6; unit: kubernetes-control-plane/0) hook) 2025-04-17 18:22:08 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for kubeapi-load-balancer/0 uniter (run relation-joined (6; unit: kubernetes-control-plane/0) hook) 2025-04-17 18:22:08 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-joined (6; unit: kubernetes-control-plane/0) hook" for kubeapi-load-balancer/0 2025-04-17 18:22:08 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-joined (6; unit: kubernetes-control-plane/0) hook" for kubeapi-load-balancer/0 2025-04-17 18:22:08 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running lb-consumers-relation-joined hook for kubernetes-control-plane/0 2025-04-17 18:22:08 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-kubeapi-load-balancer-0/agent.socket } 2025-04-17 18:22:09 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Reactive main running for hook lb-consumers-relation-joined 2025-04-17 18:22:09 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer> tracer: set flag endpoint.lb-consumers.changed tracer: ++ queue handler hooks/relations/http/provides.py:15:broken:website tracer: ++ queue handler hooks/relations/http/requires.py:15:broken:apiserver tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/apt.py:50:ensure_package_status tracer: ++ queue handler reactive/load_balancer.py:156:install_load_balancer tracer: ++ queue handler reactive/load_balancer.py:230:set_nginx_version tracer: ++ queue handler reactive/load_balancer.py:276:provide_lb_consumers tracer: ++ queue handler reactive/load_balancer.py:76:request_server_certificates tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2025-04-17 18:22:09 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag endpoint.lb-consumers.requests_changed 2025-04-17 18:22:09 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.set.nagios_context 2025-04-17 18:22:09 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.default.nagios_context 2025-04-17 18:22:09 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.default.nagios_servicegroups 2025-04-17 18:22:09 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.default.extra_packages 2025-04-17 18:22:09 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.set.package_status 2025-04-17 18:22:09 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.default.package_status 2025-04-17 18:22:09 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.default.install_sources 2025-04-17 18:22:09 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.default.install_keys 2025-04-17 18:22:09 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.set.port 2025-04-17 18:22:09 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.default.port 2025-04-17 18:22:09 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.set.host 2025-04-17 18:22:09 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.default.host 2025-04-17 18:22:09 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.default.ha-cluster-vip 2025-04-17 18:22:09 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.default.ha-cluster-dns 2025-04-17 18:22:09 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.default.extra_sans 2025-04-17 18:22:09 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.set.proxy_read_timeout 2025-04-17 18:22:09 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.default.proxy_read_timeout 2025-04-17 18:22:09 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.default.loadbalancer-ips 2025-04-17 18:22:09 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Initializing Leadership Layer (is leader) 2025-04-17 18:22:09 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Initializing Apt Layer 2025-04-17 18:22:09 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer> tracer: starting handler dispatch, 48 flags set tracer: set flag apt.installed.nginx-full tracer: set flag certificates.available tracer: set flag certificates.batch.cert.available tracer: set flag certificates.ca.available tracer: set flag certificates.certs.available tracer: set flag certificates.client.cert.available tracer: set flag certificates.server.cert.available tracer: set flag certificates.server.certs.available tracer: set flag certificates.server.certs.changed tracer: set flag config.default.extra_packages tracer: set flag config.default.extra_sans tracer: set flag config.default.ha-cluster-dns tracer: set flag config.default.ha-cluster-vip tracer: set flag config.default.host tracer: set flag config.default.install_keys tracer: set flag config.default.install_sources tracer: set flag config.default.loadbalancer-ips tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.package_status tracer: set flag config.default.port tracer: set flag config.default.proxy_read_timeout tracer: set flag config.set.host tracer: set flag config.set.nagios_context tracer: set flag config.set.package_status tracer: set flag config.set.port tracer: set flag config.set.proxy_read_timeout tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.kubeapi-load-balancer_0.server.cert tracer: set flag endpoint.certificates.changed.kubeapi-load-balancer_0.server.key tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag endpoint.lb-consumers.changed tracer: set flag endpoint.lb-consumers.created tracer: set flag endpoint.lb-consumers.joined tracer: set flag endpoint.lb-consumers.requests_changed tracer: set flag leadership.is_leader tracer: set flag nginx.available tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca_installed tracer: set flag tls_client.certs.saved tracer: set flag tls_client.server.cert.10.0.0.50.changed tracer: set flag tls_client.server.certs.changed 2025-04-17 18:22:09 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: hooks phase, 0 handlers queued 2025-04-17 18:22:09 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer> tracer: main dispatch loop, 11 handlers queued tracer: ++ queue handler hooks/relations/http/provides.py:15:broken:website tracer: ++ queue handler hooks/relations/http/requires.py:15:broken:apiserver tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/apt.py:50:ensure_package_status tracer: ++ queue handler reactive/load_balancer.py:156:install_load_balancer tracer: ++ queue handler reactive/load_balancer.py:230:set_nginx_version tracer: ++ queue handler reactive/load_balancer.py:276:provide_lb_consumers tracer: ++ queue handler reactive/load_balancer.py:76:request_server_certificates tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2025-04-17 18:22:09 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Invoking reactive handler: reactive/apt.py:50:ensure_package_status 2025-04-17 18:22:09 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Invoking reactive handler: reactive/load_balancer.py:76:request_server_certificates 2025-04-17 18:22:09 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Invoking reactive handler: reactive/load_balancer.py:156:install_load_balancer 2025-04-17 18:22:09 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: status-set: maintenance: Configuring site apilb 2025-04-17 18:22:09 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Writing file /etc/nginx/sites-available/apilb root:root 444 2025-04-17 18:22:09 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Wrote vhost config {'host': '127.0.0.1', 'port': 443, 'servers': {443: {('10.0.0.50', 6443)}, 6443: {('10.0.0.50', 6443)}}, 'server_certificate': '/srv/kubernetes/server.crt', 'server_key': '/srv/kubernetes/server.key', 'proxy_read_timeout': 600} to apilb.conf 2025-04-17 18:22:09 WARNING unit.kubeapi-load-balancer/0.lb-consumers-relation-joined logger.go:60 nginx.service is not active, cannot reload. 2025-04-17 18:22:09 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Invoking reactive handler: reactive/load_balancer.py:230:set_nginx_version 2025-04-17 18:22:09 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Invoking reactive handler: reactive/load_balancer.py:276:provide_lb_consumers 2025-04-17 18:22:10 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: cleared flag endpoint.lb-consumers.requests_changed 2025-04-17 18:22:10 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Invoking reactive handler: reactive/tls_client.py:18:store_ca 2025-04-17 18:22:10 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Invoking reactive handler: reactive/tls_client.py:44:store_server 2025-04-17 18:22:10 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Invoking reactive handler: reactive/tls_client.py:71:store_client 2025-04-17 18:22:10 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Invoking reactive handler: hooks/relations/http/requires.py:15:broken:apiserver 2025-04-17 18:22:10 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Invoking reactive handler: hooks/relations/http/provides.py:15:broken:website 2025-04-17 18:22:10 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2025-04-17 18:22:10 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: cleared flag certificates.server.certs.changed 2025-04-17 18:22:10 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: status-set: active: Loadbalancer ready. 2025-04-17 18:22:10 INFO juju.worker.uniter.operation runhook.go:159 ran "lb-consumers-relation-joined" hook (via explicit, bespoke hook script) 2025-04-17 18:22:10 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-joined (6; unit: kubernetes-control-plane/0) hook" for kubeapi-load-balancer/0 2025-04-17 18:22:10 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2025-04-17 18:22:10 DEBUG juju.machinelock machinelock.go:186 machine lock released for kubeapi-load-balancer/0 uniter (run relation-joined (6; unit: kubernetes-control-plane/0) hook) 2025-04-17 18:22:10 DEBUG juju.worker.uniter.operation executor.go:121 lock released for kubeapi-load-balancer/0 2025-04-17 18:22:10 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2025-04-17 18:22:10 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 12 2025-04-17 18:22:10 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-control-plane/0" already joined relation 5 2025-04-17 18:22:10 DEBUG juju.worker.uniter.operation executor.go:85 running operation run relation-changed (6; unit: kubernetes-control-plane/0) hook for kubeapi-load-balancer/0 2025-04-17 18:22:10 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for kubeapi-load-balancer/0 uniter (run relation-changed (6; unit: kubernetes-control-plane/0) hook) 2025-04-17 18:22:21 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for kubeapi-load-balancer/0 uniter (run relation-changed (6; unit: kubernetes-control-plane/0) hook) 2025-04-17 18:22:21 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run relation-changed (6; unit: kubernetes-control-plane/0) hook" for kubeapi-load-balancer/0 2025-04-17 18:22:21 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run relation-changed (6; unit: kubernetes-control-plane/0) hook" for kubeapi-load-balancer/0 2025-04-17 18:22:21 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] executing: running lb-consumers-relation-changed hook for kubernetes-control-plane/0 2025-04-17 18:22:21 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-kubeapi-load-balancer-0/agent.socket } 2025-04-17 18:22:21 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Reactive main running for hook lb-consumers-relation-changed 2025-04-17 18:22:21 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer> tracer: cleared flag endpoint.lb-consumers.changed tracer: ++ queue handler hooks/relations/http/provides.py:15:broken:website tracer: ++ queue handler hooks/relations/http/requires.py:15:broken:apiserver tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/apt.py:50:ensure_package_status tracer: ++ queue handler reactive/load_balancer.py:156:install_load_balancer tracer: ++ queue handler reactive/load_balancer.py:230:set_nginx_version tracer: ++ queue handler reactive/load_balancer.py:276:provide_lb_consumers tracer: ++ queue handler reactive/load_balancer.py:76:request_server_certificates tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2025-04-17 18:22:22 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.set.nagios_context 2025-04-17 18:22:22 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.default.nagios_context 2025-04-17 18:22:22 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.default.nagios_servicegroups 2025-04-17 18:22:22 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.default.extra_packages 2025-04-17 18:22:22 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.set.package_status 2025-04-17 18:22:22 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.default.package_status 2025-04-17 18:22:22 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.default.install_sources 2025-04-17 18:22:22 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.default.install_keys 2025-04-17 18:22:22 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.set.port 2025-04-17 18:22:22 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.default.port 2025-04-17 18:22:22 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.set.host 2025-04-17 18:22:22 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.default.host 2025-04-17 18:22:22 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.default.ha-cluster-vip 2025-04-17 18:22:22 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.default.ha-cluster-dns 2025-04-17 18:22:22 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.default.extra_sans 2025-04-17 18:22:22 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.set.proxy_read_timeout 2025-04-17 18:22:22 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.default.proxy_read_timeout 2025-04-17 18:22:22 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: set flag config.default.loadbalancer-ips 2025-04-17 18:22:22 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Initializing Leadership Layer (is leader) 2025-04-17 18:22:22 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Initializing Apt Layer 2025-04-17 18:22:22 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer> tracer: starting handler dispatch, 45 flags set tracer: set flag apt.installed.nginx-full tracer: set flag certificates.available tracer: set flag certificates.batch.cert.available tracer: set flag certificates.ca.available tracer: set flag certificates.certs.available tracer: set flag certificates.client.cert.available tracer: set flag certificates.server.cert.available tracer: set flag certificates.server.certs.available tracer: set flag config.default.extra_packages tracer: set flag config.default.extra_sans tracer: set flag config.default.ha-cluster-dns tracer: set flag config.default.ha-cluster-vip tracer: set flag config.default.host tracer: set flag config.default.install_keys tracer: set flag config.default.install_sources tracer: set flag config.default.loadbalancer-ips tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.package_status tracer: set flag config.default.port tracer: set flag config.default.proxy_read_timeout tracer: set flag config.set.host tracer: set flag config.set.nagios_context tracer: set flag config.set.package_status tracer: set flag config.set.port tracer: set flag config.set.proxy_read_timeout tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.kubeapi-load-balancer_0.server.cert tracer: set flag endpoint.certificates.changed.kubeapi-load-balancer_0.server.key tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag endpoint.lb-consumers.created tracer: set flag endpoint.lb-consumers.joined tracer: set flag leadership.is_leader tracer: set flag nginx.available tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca_installed tracer: set flag tls_client.certs.saved tracer: set flag tls_client.server.cert.10.0.0.50.changed tracer: set flag tls_client.server.certs.changed 2025-04-17 18:22:22 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer: hooks phase, 0 handlers queued 2025-04-17 18:22:22 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: tracer> tracer: main dispatch loop, 11 handlers queued tracer: ++ queue handler hooks/relations/http/provides.py:15:broken:website tracer: ++ queue handler hooks/relations/http/requires.py:15:broken:apiserver tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/apt.py:50:ensure_package_status tracer: ++ queue handler reactive/load_balancer.py:156:install_load_balancer tracer: ++ queue handler reactive/load_balancer.py:230:set_nginx_version tracer: ++ queue handler reactive/load_balancer.py:276:provide_lb_consumers tracer: ++ queue handler reactive/load_balancer.py:76:request_server_certificates tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2025-04-17 18:22:22 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Invoking reactive handler: reactive/apt.py:50:ensure_package_status 2025-04-17 18:22:22 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Invoking reactive handler: reactive/load_balancer.py:76:request_server_certificates 2025-04-17 18:22:22 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Invoking reactive handler: reactive/load_balancer.py:156:install_load_balancer 2025-04-17 18:22:22 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: status-set: maintenance: Configuring site apilb 2025-04-17 18:22:22 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Writing file /etc/nginx/sites-available/apilb root:root 444 2025-04-17 18:22:22 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Wrote vhost config {'host': '127.0.0.1', 'port': 443, 'servers': {443: {('10.0.0.50', 6443)}, 6443: {('10.0.0.50', 6443)}}, 'server_certificate': '/srv/kubernetes/server.crt', 'server_key': '/srv/kubernetes/server.key', 'proxy_read_timeout': 600} to apilb.conf 2025-04-17 18:22:22 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Invoking reactive handler: reactive/load_balancer.py:230:set_nginx_version 2025-04-17 18:22:22 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Invoking reactive handler: reactive/load_balancer.py:276:provide_lb_consumers 2025-04-17 18:22:22 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Invoking reactive handler: reactive/tls_client.py:18:store_ca 2025-04-17 18:22:22 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Invoking reactive handler: reactive/tls_client.py:44:store_server 2025-04-17 18:22:22 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Invoking reactive handler: reactive/tls_client.py:71:store_client 2025-04-17 18:22:22 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Invoking reactive handler: hooks/relations/http/requires.py:15:broken:apiserver 2025-04-17 18:22:22 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Invoking reactive handler: hooks/relations/http/provides.py:15:broken:website 2025-04-17 18:22:22 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2025-04-17 18:22:22 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 lb-consumers:6: status-set: active: Loadbalancer ready. 2025-04-17 18:22:22 INFO juju.worker.uniter.operation runhook.go:159 ran "lb-consumers-relation-changed" hook (via explicit, bespoke hook script) 2025-04-17 18:22:22 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run relation-changed (6; unit: kubernetes-control-plane/0) hook" for kubeapi-load-balancer/0 2025-04-17 18:22:23 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2025-04-17 18:22:23 DEBUG juju.machinelock machinelock.go:186 machine lock released for kubeapi-load-balancer/0 uniter (run relation-changed (6; unit: kubernetes-control-plane/0) hook) 2025-04-17 18:22:23 DEBUG juju.worker.uniter.operation executor.go:121 lock released for kubeapi-load-balancer/0 2025-04-17 18:22:23 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2025-04-17 18:22:23 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 12 2025-04-17 18:22:23 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-control-plane/0" already joined relation 5 2025-04-17 18:22:23 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-control-plane/0" already joined relation 6 2025-04-17 18:22:23 DEBUG juju.worker.uniter agent.go:22 [AGENT-STATUS] idle: 2025-04-17 18:22:23 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2025-04-17 18:22:23 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 12 2025-04-17 18:22:23 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-control-plane/0" already joined relation 5 2025-04-17 18:22:23 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-control-plane/0" already joined relation 6 2025-04-17 18:23:49 DEBUG juju.worker.meterstatus connected.go:93 got meter status change signal from watcher 2025-04-17 18:23:49 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for meterstatus (meter-status-changed) 2025-04-17 18:23:55 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for meterstatus (meter-status-changed) 2025-04-17 18:23:55 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-kubeapi-load-balancer-0/agent.socket } 2025-04-17 18:23:55 INFO juju.worker.meterstatus runner.go:89 skipped "meter-status-changed" hook (missing) 2025-04-17 18:23:55 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2025-04-17 18:23:55 DEBUG juju.machinelock machinelock.go:186 machine lock released for meterstatus (meter-status-changed) 2025-04-17 18:24:06 DEBUG juju.worker.metrics.collect manifold.go:293 recording metrics 2025-04-17 18:24:06 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-kubeapi-load-balancer-0/metrics-collect-agent.socket } 2025-04-17 18:24:06 WARNING unit.unit-kubeapi-load-balancer-0.collect-metrics logger.go:60 /var/lib/juju/agents/unit-kubeapi-load-balancer-0/charm/hooks/collect-metrics:43: YAMLLoadWarning: calling yaml.load() without Loader=... is deprecated, as the default Loader is unsafe. Please read https://msg.pyyaml.org/load for full details. 2025-04-17 18:24:06 WARNING unit.unit-kubeapi-load-balancer-0.collect-metrics logger.go:60 doc = yaml.load(f) 2025-04-17 18:24:07 DEBUG juju.worker.metrics.collect manifold.go:316 ran "collect-metrics" hook (via explicit, bespoke hook script) 2025-04-17 18:26:53 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for kubeapi-load-balancer/0 2025-04-17 18:26:53 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2025-04-17 18:26:53 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 12 2025-04-17 18:26:53 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-control-plane/0" already joined relation 5 2025-04-17 18:26:53 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-control-plane/0" already joined relation 6 2025-04-17 18:26:53 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for kubeapi-load-balancer/0 2025-04-17 18:26:53 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for kubeapi-load-balancer/0 uniter (run update-status hook) 2025-04-17 18:26:54 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for kubeapi-load-balancer/0 uniter (run update-status hook) 2025-04-17 18:26:54 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for kubeapi-load-balancer/0 2025-04-17 18:26:55 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for kubeapi-load-balancer/0 2025-04-17 18:26:55 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-kubeapi-load-balancer-0/agent.socket } 2025-04-17 18:26:55 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Reactive main running for hook update-status 2025-04-17 18:26:55 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/http/provides.py:15:broken:website tracer: ++ queue handler hooks/relations/http/requires.py:15:broken:apiserver tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/apt.py:50:ensure_package_status tracer: ++ queue handler reactive/load_balancer.py:156:install_load_balancer tracer: ++ queue handler reactive/load_balancer.py:230:set_nginx_version tracer: ++ queue handler reactive/load_balancer.py:276:provide_lb_consumers tracer: ++ queue handler reactive/load_balancer.py:76:request_server_certificates tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2025-04-17 18:26:55 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.nagios_context 2025-04-17 18:26:55 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2025-04-17 18:26:55 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.extra_packages 2025-04-17 18:26:55 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.set.package_status 2025-04-17 18:26:55 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.package_status 2025-04-17 18:26:55 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.install_sources 2025-04-17 18:26:55 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.install_keys 2025-04-17 18:26:55 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.set.port 2025-04-17 18:26:55 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.port 2025-04-17 18:26:55 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.set.host 2025-04-17 18:26:55 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.host 2025-04-17 18:26:55 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.ha-cluster-vip 2025-04-17 18:26:55 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.ha-cluster-dns 2025-04-17 18:26:55 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.extra_sans 2025-04-17 18:26:55 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.set.proxy_read_timeout 2025-04-17 18:26:55 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.proxy_read_timeout 2025-04-17 18:26:55 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.loadbalancer-ips 2025-04-17 18:26:55 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Initializing Leadership Layer (is leader) 2025-04-17 18:26:55 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Initializing Apt Layer 2025-04-17 18:26:55 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer> tracer: starting handler dispatch, 45 flags set tracer: set flag apt.installed.nginx-full tracer: set flag certificates.available tracer: set flag certificates.batch.cert.available tracer: set flag certificates.ca.available tracer: set flag certificates.certs.available tracer: set flag certificates.client.cert.available tracer: set flag certificates.server.cert.available tracer: set flag certificates.server.certs.available tracer: set flag config.default.extra_packages tracer: set flag config.default.extra_sans tracer: set flag config.default.ha-cluster-dns tracer: set flag config.default.ha-cluster-vip tracer: set flag config.default.host tracer: set flag config.default.install_keys tracer: set flag config.default.install_sources tracer: set flag config.default.loadbalancer-ips tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.package_status tracer: set flag config.default.port tracer: set flag config.default.proxy_read_timeout tracer: set flag config.set.host tracer: set flag config.set.nagios_context tracer: set flag config.set.package_status tracer: set flag config.set.port tracer: set flag config.set.proxy_read_timeout tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.kubeapi-load-balancer_0.server.cert tracer: set flag endpoint.certificates.changed.kubeapi-load-balancer_0.server.key tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag endpoint.lb-consumers.created tracer: set flag endpoint.lb-consumers.joined tracer: set flag leadership.is_leader tracer: set flag nginx.available tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca_installed tracer: set flag tls_client.certs.saved tracer: set flag tls_client.server.cert.10.0.0.50.changed tracer: set flag tls_client.server.certs.changed 2025-04-17 18:26:55 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2025-04-17 18:26:55 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer> tracer: main dispatch loop, 11 handlers queued tracer: ++ queue handler hooks/relations/http/provides.py:15:broken:website tracer: ++ queue handler hooks/relations/http/requires.py:15:broken:apiserver tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/apt.py:50:ensure_package_status tracer: ++ queue handler reactive/load_balancer.py:156:install_load_balancer tracer: ++ queue handler reactive/load_balancer.py:230:set_nginx_version tracer: ++ queue handler reactive/load_balancer.py:276:provide_lb_consumers tracer: ++ queue handler reactive/load_balancer.py:76:request_server_certificates tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2025-04-17 18:26:55 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/apt.py:50:ensure_package_status 2025-04-17 18:26:55 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/load_balancer.py:76:request_server_certificates 2025-04-17 18:26:55 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/load_balancer.py:156:install_load_balancer 2025-04-17 18:26:55 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 status-set: maintenance: Configuring site apilb 2025-04-17 18:26:55 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 Writing file /etc/nginx/sites-available/apilb root:root 444 2025-04-17 18:26:55 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Wrote vhost config {'host': '127.0.0.1', 'port': 443, 'servers': {443: {('10.0.0.50', 6443)}, 6443: {('10.0.0.50', 6443)}}, 'server_certificate': '/srv/kubernetes/server.crt', 'server_key': '/srv/kubernetes/server.key', 'proxy_read_timeout': 600} to apilb.conf 2025-04-17 18:26:56 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/load_balancer.py:230:set_nginx_version 2025-04-17 18:26:56 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/load_balancer.py:276:provide_lb_consumers 2025-04-17 18:26:56 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:18:store_ca 2025-04-17 18:26:56 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:44:store_server 2025-04-17 18:26:56 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:71:store_client 2025-04-17 18:26:56 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/http/requires.py:15:broken:apiserver 2025-04-17 18:26:56 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/http/provides.py:15:broken:website 2025-04-17 18:26:56 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2025-04-17 18:26:56 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 status-set: active: Loadbalancer ready. 2025-04-17 18:26:56 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2025-04-17 18:26:56 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for kubeapi-load-balancer/0 2025-04-17 18:26:56 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2025-04-17 18:26:56 DEBUG juju.machinelock machinelock.go:186 machine lock released for kubeapi-load-balancer/0 uniter (run update-status hook) 2025-04-17 18:26:56 DEBUG juju.worker.uniter.operation executor.go:121 lock released for kubeapi-load-balancer/0 2025-04-17 18:26:56 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2025-04-17 18:26:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 12 2025-04-17 18:26:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-control-plane/0" already joined relation 5 2025-04-17 18:26:56 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-control-plane/0" already joined relation 6 2025-04-17 18:28:30 DEBUG juju.worker.metrics.collect manifold.go:293 recording metrics 2025-04-17 18:28:30 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-kubeapi-load-balancer-0/metrics-collect-agent.socket } 2025-04-17 18:28:30 WARNING unit.unit-kubeapi-load-balancer-0.collect-metrics logger.go:60 /var/lib/juju/agents/unit-kubeapi-load-balancer-0/charm/hooks/collect-metrics:43: YAMLLoadWarning: calling yaml.load() without Loader=... is deprecated, as the default Loader is unsafe. Please read https://msg.pyyaml.org/load for full details. 2025-04-17 18:28:30 WARNING unit.unit-kubeapi-load-balancer-0.collect-metrics logger.go:60 doc = yaml.load(f) 2025-04-17 18:28:30 DEBUG juju.worker.metrics.collect manifold.go:316 ran "collect-metrics" hook (via explicit, bespoke hook script) 2025-04-17 18:32:04 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for kubeapi-load-balancer/0 2025-04-17 18:32:04 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2025-04-17 18:32:04 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-control-plane/0" already joined relation 5 2025-04-17 18:32:04 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-control-plane/0" already joined relation 6 2025-04-17 18:32:04 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 12 2025-04-17 18:32:04 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for kubeapi-load-balancer/0 2025-04-17 18:32:04 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for kubeapi-load-balancer/0 uniter (run update-status hook) 2025-04-17 18:32:06 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for kubeapi-load-balancer/0 uniter (run update-status hook) 2025-04-17 18:32:06 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for kubeapi-load-balancer/0 2025-04-17 18:32:06 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for kubeapi-load-balancer/0 2025-04-17 18:32:06 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-kubeapi-load-balancer-0/agent.socket } 2025-04-17 18:32:06 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Reactive main running for hook update-status 2025-04-17 18:32:06 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/http/provides.py:15:broken:website tracer: ++ queue handler hooks/relations/http/requires.py:15:broken:apiserver tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/apt.py:50:ensure_package_status tracer: ++ queue handler reactive/load_balancer.py:156:install_load_balancer tracer: ++ queue handler reactive/load_balancer.py:230:set_nginx_version tracer: ++ queue handler reactive/load_balancer.py:276:provide_lb_consumers tracer: ++ queue handler reactive/load_balancer.py:76:request_server_certificates tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2025-04-17 18:32:06 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.nagios_context 2025-04-17 18:32:06 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2025-04-17 18:32:06 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.extra_packages 2025-04-17 18:32:06 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.set.package_status 2025-04-17 18:32:06 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.package_status 2025-04-17 18:32:06 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.install_sources 2025-04-17 18:32:06 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.install_keys 2025-04-17 18:32:06 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.set.port 2025-04-17 18:32:06 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.port 2025-04-17 18:32:06 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.set.host 2025-04-17 18:32:06 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.host 2025-04-17 18:32:06 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.ha-cluster-vip 2025-04-17 18:32:06 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.ha-cluster-dns 2025-04-17 18:32:06 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.extra_sans 2025-04-17 18:32:06 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.set.proxy_read_timeout 2025-04-17 18:32:06 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.proxy_read_timeout 2025-04-17 18:32:06 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.loadbalancer-ips 2025-04-17 18:32:06 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Initializing Leadership Layer (is leader) 2025-04-17 18:32:07 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Initializing Apt Layer 2025-04-17 18:32:07 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer> tracer: starting handler dispatch, 45 flags set tracer: set flag apt.installed.nginx-full tracer: set flag certificates.available tracer: set flag certificates.batch.cert.available tracer: set flag certificates.ca.available tracer: set flag certificates.certs.available tracer: set flag certificates.client.cert.available tracer: set flag certificates.server.cert.available tracer: set flag certificates.server.certs.available tracer: set flag config.default.extra_packages tracer: set flag config.default.extra_sans tracer: set flag config.default.ha-cluster-dns tracer: set flag config.default.ha-cluster-vip tracer: set flag config.default.host tracer: set flag config.default.install_keys tracer: set flag config.default.install_sources tracer: set flag config.default.loadbalancer-ips tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.package_status tracer: set flag config.default.port tracer: set flag config.default.proxy_read_timeout tracer: set flag config.set.host tracer: set flag config.set.nagios_context tracer: set flag config.set.package_status tracer: set flag config.set.port tracer: set flag config.set.proxy_read_timeout tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.kubeapi-load-balancer_0.server.cert tracer: set flag endpoint.certificates.changed.kubeapi-load-balancer_0.server.key tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag endpoint.lb-consumers.created tracer: set flag endpoint.lb-consumers.joined tracer: set flag leadership.is_leader tracer: set flag nginx.available tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca_installed tracer: set flag tls_client.certs.saved tracer: set flag tls_client.server.cert.10.0.0.50.changed tracer: set flag tls_client.server.certs.changed 2025-04-17 18:32:07 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2025-04-17 18:32:07 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer> tracer: main dispatch loop, 11 handlers queued tracer: ++ queue handler hooks/relations/http/provides.py:15:broken:website tracer: ++ queue handler hooks/relations/http/requires.py:15:broken:apiserver tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/apt.py:50:ensure_package_status tracer: ++ queue handler reactive/load_balancer.py:156:install_load_balancer tracer: ++ queue handler reactive/load_balancer.py:230:set_nginx_version tracer: ++ queue handler reactive/load_balancer.py:276:provide_lb_consumers tracer: ++ queue handler reactive/load_balancer.py:76:request_server_certificates tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2025-04-17 18:32:07 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/apt.py:50:ensure_package_status 2025-04-17 18:32:07 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/load_balancer.py:76:request_server_certificates 2025-04-17 18:32:07 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/load_balancer.py:156:install_load_balancer 2025-04-17 18:32:07 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 status-set: maintenance: Configuring site apilb 2025-04-17 18:32:07 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 Writing file /etc/nginx/sites-available/apilb root:root 444 2025-04-17 18:32:07 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Wrote vhost config {'host': '127.0.0.1', 'port': 443, 'servers': {443: {('10.0.0.50', 6443)}, 6443: {('10.0.0.50', 6443)}}, 'server_certificate': '/srv/kubernetes/server.crt', 'server_key': '/srv/kubernetes/server.key', 'proxy_read_timeout': 600} to apilb.conf 2025-04-17 18:32:07 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/load_balancer.py:230:set_nginx_version 2025-04-17 18:32:07 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/load_balancer.py:276:provide_lb_consumers 2025-04-17 18:32:07 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:18:store_ca 2025-04-17 18:32:07 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:44:store_server 2025-04-17 18:32:07 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:71:store_client 2025-04-17 18:32:07 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/http/requires.py:15:broken:apiserver 2025-04-17 18:32:07 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/http/provides.py:15:broken:website 2025-04-17 18:32:07 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2025-04-17 18:32:07 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 status-set: active: Loadbalancer ready. 2025-04-17 18:32:07 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2025-04-17 18:32:07 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for kubeapi-load-balancer/0 2025-04-17 18:32:07 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2025-04-17 18:32:07 DEBUG juju.machinelock machinelock.go:186 machine lock released for kubeapi-load-balancer/0 uniter (run update-status hook) 2025-04-17 18:32:07 DEBUG juju.worker.uniter.operation executor.go:121 lock released for kubeapi-load-balancer/0 2025-04-17 18:32:07 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2025-04-17 18:32:07 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 12 2025-04-17 18:32:07 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-control-plane/0" already joined relation 5 2025-04-17 18:32:07 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-control-plane/0" already joined relation 6 2025-04-17 18:33:26 DEBUG juju.worker.metrics.collect manifold.go:293 recording metrics 2025-04-17 18:33:26 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-kubeapi-load-balancer-0/metrics-collect-agent.socket } 2025-04-17 18:33:26 WARNING unit.unit-kubeapi-load-balancer-0.collect-metrics logger.go:60 /var/lib/juju/agents/unit-kubeapi-load-balancer-0/charm/hooks/collect-metrics:43: YAMLLoadWarning: calling yaml.load() without Loader=... is deprecated, as the default Loader is unsafe. Please read https://msg.pyyaml.org/load for full details. 2025-04-17 18:33:26 WARNING unit.unit-kubeapi-load-balancer-0.collect-metrics logger.go:60 doc = yaml.load(f) 2025-04-17 18:33:26 DEBUG juju.worker.metrics.collect manifold.go:316 ran "collect-metrics" hook (via explicit, bespoke hook script) 2025-04-17 18:37:43 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for kubeapi-load-balancer/0 2025-04-17 18:37:43 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2025-04-17 18:37:43 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 12 2025-04-17 18:37:43 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-control-plane/0" already joined relation 5 2025-04-17 18:37:43 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-control-plane/0" already joined relation 6 2025-04-17 18:37:43 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for kubeapi-load-balancer/0 2025-04-17 18:37:43 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for kubeapi-load-balancer/0 uniter (run update-status hook) 2025-04-17 18:37:44 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for kubeapi-load-balancer/0 uniter (run update-status hook) 2025-04-17 18:37:44 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for kubeapi-load-balancer/0 2025-04-17 18:37:44 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for kubeapi-load-balancer/0 2025-04-17 18:37:44 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-kubeapi-load-balancer-0/agent.socket } 2025-04-17 18:37:45 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Reactive main running for hook update-status 2025-04-17 18:37:45 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/http/provides.py:15:broken:website tracer: ++ queue handler hooks/relations/http/requires.py:15:broken:apiserver tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/apt.py:50:ensure_package_status tracer: ++ queue handler reactive/load_balancer.py:156:install_load_balancer tracer: ++ queue handler reactive/load_balancer.py:230:set_nginx_version tracer: ++ queue handler reactive/load_balancer.py:276:provide_lb_consumers tracer: ++ queue handler reactive/load_balancer.py:76:request_server_certificates tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2025-04-17 18:37:45 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.nagios_context 2025-04-17 18:37:45 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2025-04-17 18:37:45 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.extra_packages 2025-04-17 18:37:45 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.set.package_status 2025-04-17 18:37:45 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.package_status 2025-04-17 18:37:45 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.install_sources 2025-04-17 18:37:45 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.install_keys 2025-04-17 18:37:45 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.set.port 2025-04-17 18:37:45 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.port 2025-04-17 18:37:45 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.set.host 2025-04-17 18:37:45 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.host 2025-04-17 18:37:45 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.ha-cluster-vip 2025-04-17 18:37:45 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.ha-cluster-dns 2025-04-17 18:37:45 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.extra_sans 2025-04-17 18:37:45 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.set.proxy_read_timeout 2025-04-17 18:37:45 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.proxy_read_timeout 2025-04-17 18:37:45 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.loadbalancer-ips 2025-04-17 18:37:45 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Initializing Leadership Layer (is leader) 2025-04-17 18:37:45 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Initializing Apt Layer 2025-04-17 18:37:45 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer> tracer: starting handler dispatch, 45 flags set tracer: set flag apt.installed.nginx-full tracer: set flag certificates.available tracer: set flag certificates.batch.cert.available tracer: set flag certificates.ca.available tracer: set flag certificates.certs.available tracer: set flag certificates.client.cert.available tracer: set flag certificates.server.cert.available tracer: set flag certificates.server.certs.available tracer: set flag config.default.extra_packages tracer: set flag config.default.extra_sans tracer: set flag config.default.ha-cluster-dns tracer: set flag config.default.ha-cluster-vip tracer: set flag config.default.host tracer: set flag config.default.install_keys tracer: set flag config.default.install_sources tracer: set flag config.default.loadbalancer-ips tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.package_status tracer: set flag config.default.port tracer: set flag config.default.proxy_read_timeout tracer: set flag config.set.host tracer: set flag config.set.nagios_context tracer: set flag config.set.package_status tracer: set flag config.set.port tracer: set flag config.set.proxy_read_timeout tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.kubeapi-load-balancer_0.server.cert tracer: set flag endpoint.certificates.changed.kubeapi-load-balancer_0.server.key tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag endpoint.lb-consumers.created tracer: set flag endpoint.lb-consumers.joined tracer: set flag leadership.is_leader tracer: set flag nginx.available tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca_installed tracer: set flag tls_client.certs.saved tracer: set flag tls_client.server.cert.10.0.0.50.changed tracer: set flag tls_client.server.certs.changed 2025-04-17 18:37:45 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2025-04-17 18:37:45 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer> tracer: main dispatch loop, 11 handlers queued tracer: ++ queue handler hooks/relations/http/provides.py:15:broken:website tracer: ++ queue handler hooks/relations/http/requires.py:15:broken:apiserver tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/apt.py:50:ensure_package_status tracer: ++ queue handler reactive/load_balancer.py:156:install_load_balancer tracer: ++ queue handler reactive/load_balancer.py:230:set_nginx_version tracer: ++ queue handler reactive/load_balancer.py:276:provide_lb_consumers tracer: ++ queue handler reactive/load_balancer.py:76:request_server_certificates tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2025-04-17 18:37:45 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/apt.py:50:ensure_package_status 2025-04-17 18:37:45 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/load_balancer.py:76:request_server_certificates 2025-04-17 18:37:45 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/load_balancer.py:156:install_load_balancer 2025-04-17 18:37:45 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 status-set: maintenance: Configuring site apilb 2025-04-17 18:37:45 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 Writing file /etc/nginx/sites-available/apilb root:root 444 2025-04-17 18:37:45 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Wrote vhost config {'host': '127.0.0.1', 'port': 443, 'servers': {443: {('10.0.0.50', 6443)}, 6443: {('10.0.0.50', 6443)}}, 'server_certificate': '/srv/kubernetes/server.crt', 'server_key': '/srv/kubernetes/server.key', 'proxy_read_timeout': 600} to apilb.conf 2025-04-17 18:37:45 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/load_balancer.py:230:set_nginx_version 2025-04-17 18:37:45 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/load_balancer.py:276:provide_lb_consumers 2025-04-17 18:37:45 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:18:store_ca 2025-04-17 18:37:45 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:44:store_server 2025-04-17 18:37:45 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:71:store_client 2025-04-17 18:37:45 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/http/requires.py:15:broken:apiserver 2025-04-17 18:37:45 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/http/provides.py:15:broken:website 2025-04-17 18:37:45 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2025-04-17 18:37:45 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 status-set: active: Loadbalancer ready. 2025-04-17 18:37:46 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2025-04-17 18:37:46 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for kubeapi-load-balancer/0 2025-04-17 18:37:46 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2025-04-17 18:37:46 DEBUG juju.machinelock machinelock.go:186 machine lock released for kubeapi-load-balancer/0 uniter (run update-status hook) 2025-04-17 18:37:46 DEBUG juju.worker.uniter.operation executor.go:121 lock released for kubeapi-load-balancer/0 2025-04-17 18:37:46 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2025-04-17 18:37:46 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-control-plane/0" already joined relation 5 2025-04-17 18:37:46 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-control-plane/0" already joined relation 6 2025-04-17 18:37:46 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 12 2025-04-17 18:37:48 DEBUG juju.worker.metrics.collect manifold.go:293 recording metrics 2025-04-17 18:37:48 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-kubeapi-load-balancer-0/metrics-collect-agent.socket } 2025-04-17 18:37:48 WARNING unit.unit-kubeapi-load-balancer-0.collect-metrics logger.go:60 /var/lib/juju/agents/unit-kubeapi-load-balancer-0/charm/hooks/collect-metrics:43: YAMLLoadWarning: calling yaml.load() without Loader=... is deprecated, as the default Loader is unsafe. Please read https://msg.pyyaml.org/load for full details. 2025-04-17 18:37:48 WARNING unit.unit-kubeapi-load-balancer-0.collect-metrics logger.go:60 doc = yaml.load(f) 2025-04-17 18:37:48 DEBUG juju.worker.metrics.collect manifold.go:316 ran "collect-metrics" hook (via explicit, bespoke hook script) 2025-04-17 18:42:08 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for kubeapi-load-balancer/0 2025-04-17 18:42:08 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2025-04-17 18:42:08 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 12 2025-04-17 18:42:08 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-control-plane/0" already joined relation 5 2025-04-17 18:42:08 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-control-plane/0" already joined relation 6 2025-04-17 18:42:08 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for kubeapi-load-balancer/0 2025-04-17 18:42:08 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for kubeapi-load-balancer/0 uniter (run update-status hook) 2025-04-17 18:42:10 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for kubeapi-load-balancer/0 uniter (run update-status hook) 2025-04-17 18:42:10 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for kubeapi-load-balancer/0 2025-04-17 18:42:10 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for kubeapi-load-balancer/0 2025-04-17 18:42:10 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-kubeapi-load-balancer-0/agent.socket } 2025-04-17 18:42:10 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Reactive main running for hook update-status 2025-04-17 18:42:10 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/http/provides.py:15:broken:website tracer: ++ queue handler hooks/relations/http/requires.py:15:broken:apiserver tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/apt.py:50:ensure_package_status tracer: ++ queue handler reactive/load_balancer.py:156:install_load_balancer tracer: ++ queue handler reactive/load_balancer.py:230:set_nginx_version tracer: ++ queue handler reactive/load_balancer.py:276:provide_lb_consumers tracer: ++ queue handler reactive/load_balancer.py:76:request_server_certificates tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2025-04-17 18:42:10 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.nagios_context 2025-04-17 18:42:10 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2025-04-17 18:42:10 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.extra_packages 2025-04-17 18:42:10 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.set.package_status 2025-04-17 18:42:10 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.package_status 2025-04-17 18:42:11 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.install_sources 2025-04-17 18:42:11 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.install_keys 2025-04-17 18:42:11 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.set.port 2025-04-17 18:42:11 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.port 2025-04-17 18:42:11 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.set.host 2025-04-17 18:42:11 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.host 2025-04-17 18:42:11 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.ha-cluster-vip 2025-04-17 18:42:11 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.ha-cluster-dns 2025-04-17 18:42:11 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.extra_sans 2025-04-17 18:42:11 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.set.proxy_read_timeout 2025-04-17 18:42:11 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.proxy_read_timeout 2025-04-17 18:42:11 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.loadbalancer-ips 2025-04-17 18:42:11 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Initializing Leadership Layer (is leader) 2025-04-17 18:42:11 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Initializing Apt Layer 2025-04-17 18:42:11 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer> tracer: starting handler dispatch, 45 flags set tracer: set flag apt.installed.nginx-full tracer: set flag certificates.available tracer: set flag certificates.batch.cert.available tracer: set flag certificates.ca.available tracer: set flag certificates.certs.available tracer: set flag certificates.client.cert.available tracer: set flag certificates.server.cert.available tracer: set flag certificates.server.certs.available tracer: set flag config.default.extra_packages tracer: set flag config.default.extra_sans tracer: set flag config.default.ha-cluster-dns tracer: set flag config.default.ha-cluster-vip tracer: set flag config.default.host tracer: set flag config.default.install_keys tracer: set flag config.default.install_sources tracer: set flag config.default.loadbalancer-ips tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.package_status tracer: set flag config.default.port tracer: set flag config.default.proxy_read_timeout tracer: set flag config.set.host tracer: set flag config.set.nagios_context tracer: set flag config.set.package_status tracer: set flag config.set.port tracer: set flag config.set.proxy_read_timeout tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.kubeapi-load-balancer_0.server.cert tracer: set flag endpoint.certificates.changed.kubeapi-load-balancer_0.server.key tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag endpoint.lb-consumers.created tracer: set flag endpoint.lb-consumers.joined tracer: set flag leadership.is_leader tracer: set flag nginx.available tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca_installed tracer: set flag tls_client.certs.saved tracer: set flag tls_client.server.cert.10.0.0.50.changed tracer: set flag tls_client.server.certs.changed 2025-04-17 18:42:11 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2025-04-17 18:42:11 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer> tracer: main dispatch loop, 11 handlers queued tracer: ++ queue handler hooks/relations/http/provides.py:15:broken:website tracer: ++ queue handler hooks/relations/http/requires.py:15:broken:apiserver tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/apt.py:50:ensure_package_status tracer: ++ queue handler reactive/load_balancer.py:156:install_load_balancer tracer: ++ queue handler reactive/load_balancer.py:230:set_nginx_version tracer: ++ queue handler reactive/load_balancer.py:276:provide_lb_consumers tracer: ++ queue handler reactive/load_balancer.py:76:request_server_certificates tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2025-04-17 18:42:11 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/apt.py:50:ensure_package_status 2025-04-17 18:42:11 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/load_balancer.py:76:request_server_certificates 2025-04-17 18:42:11 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/load_balancer.py:156:install_load_balancer 2025-04-17 18:42:11 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 status-set: maintenance: Configuring site apilb 2025-04-17 18:42:11 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 Writing file /etc/nginx/sites-available/apilb root:root 444 2025-04-17 18:42:11 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Wrote vhost config {'host': '127.0.0.1', 'port': 443, 'servers': {443: {('10.0.0.50', 6443)}, 6443: {('10.0.0.50', 6443)}}, 'server_certificate': '/srv/kubernetes/server.crt', 'server_key': '/srv/kubernetes/server.key', 'proxy_read_timeout': 600} to apilb.conf 2025-04-17 18:42:11 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/load_balancer.py:230:set_nginx_version 2025-04-17 18:42:11 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/load_balancer.py:276:provide_lb_consumers 2025-04-17 18:42:11 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:18:store_ca 2025-04-17 18:42:11 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:44:store_server 2025-04-17 18:42:11 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:71:store_client 2025-04-17 18:42:11 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/http/requires.py:15:broken:apiserver 2025-04-17 18:42:11 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/http/provides.py:15:broken:website 2025-04-17 18:42:11 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2025-04-17 18:42:11 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 status-set: active: Loadbalancer ready. 2025-04-17 18:42:11 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2025-04-17 18:42:11 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for kubeapi-load-balancer/0 2025-04-17 18:42:11 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2025-04-17 18:42:11 DEBUG juju.machinelock machinelock.go:186 machine lock released for kubeapi-load-balancer/0 uniter (run update-status hook) 2025-04-17 18:42:11 DEBUG juju.worker.uniter.operation executor.go:121 lock released for kubeapi-load-balancer/0 2025-04-17 18:42:11 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2025-04-17 18:42:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 12 2025-04-17 18:42:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-control-plane/0" already joined relation 5 2025-04-17 18:42:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-control-plane/0" already joined relation 6 2025-04-17 18:42:35 DEBUG juju.worker.metrics.collect manifold.go:293 recording metrics 2025-04-17 18:42:35 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-kubeapi-load-balancer-0/metrics-collect-agent.socket } 2025-04-17 18:42:35 WARNING unit.unit-kubeapi-load-balancer-0.collect-metrics logger.go:60 /var/lib/juju/agents/unit-kubeapi-load-balancer-0/charm/hooks/collect-metrics:43: YAMLLoadWarning: calling yaml.load() without Loader=... is deprecated, as the default Loader is unsafe. Please read https://msg.pyyaml.org/load for full details. 2025-04-17 18:42:35 WARNING unit.unit-kubeapi-load-balancer-0.collect-metrics logger.go:60 doc = yaml.load(f) 2025-04-17 18:42:36 DEBUG juju.worker.metrics.collect manifold.go:316 ran "collect-metrics" hook (via explicit, bespoke hook script) 2025-04-17 18:47:00 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for kubeapi-load-balancer/0 2025-04-17 18:47:00 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2025-04-17 18:47:00 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 12 2025-04-17 18:47:00 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-control-plane/0" already joined relation 5 2025-04-17 18:47:00 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-control-plane/0" already joined relation 6 2025-04-17 18:47:00 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for kubeapi-load-balancer/0 2025-04-17 18:47:00 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for kubeapi-load-balancer/0 uniter (run update-status hook) 2025-04-17 18:47:02 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for kubeapi-load-balancer/0 uniter (run update-status hook) 2025-04-17 18:47:02 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for kubeapi-load-balancer/0 2025-04-17 18:47:02 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for kubeapi-load-balancer/0 2025-04-17 18:47:02 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-kubeapi-load-balancer-0/agent.socket } 2025-04-17 18:47:02 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Reactive main running for hook update-status 2025-04-17 18:47:02 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/http/provides.py:15:broken:website tracer: ++ queue handler hooks/relations/http/requires.py:15:broken:apiserver tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/apt.py:50:ensure_package_status tracer: ++ queue handler reactive/load_balancer.py:156:install_load_balancer tracer: ++ queue handler reactive/load_balancer.py:230:set_nginx_version tracer: ++ queue handler reactive/load_balancer.py:276:provide_lb_consumers tracer: ++ queue handler reactive/load_balancer.py:76:request_server_certificates tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2025-04-17 18:47:02 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.nagios_context 2025-04-17 18:47:02 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2025-04-17 18:47:02 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.extra_packages 2025-04-17 18:47:02 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.set.package_status 2025-04-17 18:47:02 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.package_status 2025-04-17 18:47:02 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.install_sources 2025-04-17 18:47:02 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.install_keys 2025-04-17 18:47:02 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.set.port 2025-04-17 18:47:02 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.port 2025-04-17 18:47:02 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.set.host 2025-04-17 18:47:02 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.host 2025-04-17 18:47:02 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.ha-cluster-vip 2025-04-17 18:47:02 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.ha-cluster-dns 2025-04-17 18:47:02 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.extra_sans 2025-04-17 18:47:02 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.set.proxy_read_timeout 2025-04-17 18:47:02 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.proxy_read_timeout 2025-04-17 18:47:02 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.loadbalancer-ips 2025-04-17 18:47:02 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Initializing Leadership Layer (is leader) 2025-04-17 18:47:02 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Initializing Apt Layer 2025-04-17 18:47:02 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer> tracer: starting handler dispatch, 45 flags set tracer: set flag apt.installed.nginx-full tracer: set flag certificates.available tracer: set flag certificates.batch.cert.available tracer: set flag certificates.ca.available tracer: set flag certificates.certs.available tracer: set flag certificates.client.cert.available tracer: set flag certificates.server.cert.available tracer: set flag certificates.server.certs.available tracer: set flag config.default.extra_packages tracer: set flag config.default.extra_sans tracer: set flag config.default.ha-cluster-dns tracer: set flag config.default.ha-cluster-vip tracer: set flag config.default.host tracer: set flag config.default.install_keys tracer: set flag config.default.install_sources tracer: set flag config.default.loadbalancer-ips tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.package_status tracer: set flag config.default.port tracer: set flag config.default.proxy_read_timeout tracer: set flag config.set.host tracer: set flag config.set.nagios_context tracer: set flag config.set.package_status tracer: set flag config.set.port tracer: set flag config.set.proxy_read_timeout tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.kubeapi-load-balancer_0.server.cert tracer: set flag endpoint.certificates.changed.kubeapi-load-balancer_0.server.key tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag endpoint.lb-consumers.created tracer: set flag endpoint.lb-consumers.joined tracer: set flag leadership.is_leader tracer: set flag nginx.available tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca_installed tracer: set flag tls_client.certs.saved tracer: set flag tls_client.server.cert.10.0.0.50.changed tracer: set flag tls_client.server.certs.changed 2025-04-17 18:47:02 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2025-04-17 18:47:02 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer> tracer: main dispatch loop, 11 handlers queued tracer: ++ queue handler hooks/relations/http/provides.py:15:broken:website tracer: ++ queue handler hooks/relations/http/requires.py:15:broken:apiserver tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/apt.py:50:ensure_package_status tracer: ++ queue handler reactive/load_balancer.py:156:install_load_balancer tracer: ++ queue handler reactive/load_balancer.py:230:set_nginx_version tracer: ++ queue handler reactive/load_balancer.py:276:provide_lb_consumers tracer: ++ queue handler reactive/load_balancer.py:76:request_server_certificates tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2025-04-17 18:47:02 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/apt.py:50:ensure_package_status 2025-04-17 18:47:02 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/load_balancer.py:76:request_server_certificates 2025-04-17 18:47:02 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/load_balancer.py:156:install_load_balancer 2025-04-17 18:47:02 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 status-set: maintenance: Configuring site apilb 2025-04-17 18:47:02 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 Writing file /etc/nginx/sites-available/apilb root:root 444 2025-04-17 18:47:02 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Wrote vhost config {'host': '127.0.0.1', 'port': 443, 'servers': {443: {('10.0.0.50', 6443)}, 6443: {('10.0.0.50', 6443)}}, 'server_certificate': '/srv/kubernetes/server.crt', 'server_key': '/srv/kubernetes/server.key', 'proxy_read_timeout': 600} to apilb.conf 2025-04-17 18:47:03 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/load_balancer.py:230:set_nginx_version 2025-04-17 18:47:03 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/load_balancer.py:276:provide_lb_consumers 2025-04-17 18:47:03 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:18:store_ca 2025-04-17 18:47:03 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:44:store_server 2025-04-17 18:47:03 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:71:store_client 2025-04-17 18:47:03 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/http/requires.py:15:broken:apiserver 2025-04-17 18:47:03 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/http/provides.py:15:broken:website 2025-04-17 18:47:03 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2025-04-17 18:47:03 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 status-set: active: Loadbalancer ready. 2025-04-17 18:47:03 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2025-04-17 18:47:03 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for kubeapi-load-balancer/0 2025-04-17 18:47:03 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2025-04-17 18:47:03 DEBUG juju.machinelock machinelock.go:186 machine lock released for kubeapi-load-balancer/0 uniter (run update-status hook) 2025-04-17 18:47:03 DEBUG juju.worker.uniter.operation executor.go:121 lock released for kubeapi-load-balancer/0 2025-04-17 18:47:03 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2025-04-17 18:47:03 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 12 2025-04-17 18:47:03 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-control-plane/0" already joined relation 5 2025-04-17 18:47:03 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-control-plane/0" already joined relation 6 2025-04-17 18:47:36 DEBUG juju.worker.metrics.collect manifold.go:293 recording metrics 2025-04-17 18:47:36 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-kubeapi-load-balancer-0/metrics-collect-agent.socket } 2025-04-17 18:47:36 WARNING unit.unit-kubeapi-load-balancer-0.collect-metrics logger.go:60 /var/lib/juju/agents/unit-kubeapi-load-balancer-0/charm/hooks/collect-metrics:43: YAMLLoadWarning: calling yaml.load() without Loader=... is deprecated, as the default Loader is unsafe. Please read https://msg.pyyaml.org/load for full details. 2025-04-17 18:47:36 WARNING unit.unit-kubeapi-load-balancer-0.collect-metrics logger.go:60 doc = yaml.load(f) 2025-04-17 18:47:36 DEBUG juju.worker.metrics.collect manifold.go:316 ran "collect-metrics" hook (via explicit, bespoke hook script) 2025-04-17 18:52:50 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for kubeapi-load-balancer/0 2025-04-17 18:52:50 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2025-04-17 18:52:50 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 12 2025-04-17 18:52:50 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-control-plane/0" already joined relation 5 2025-04-17 18:52:50 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-control-plane/0" already joined relation 6 2025-04-17 18:52:50 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for kubeapi-load-balancer/0 2025-04-17 18:52:50 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for kubeapi-load-balancer/0 uniter (run update-status hook) 2025-04-17 18:52:52 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for kubeapi-load-balancer/0 uniter (run update-status hook) 2025-04-17 18:52:52 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for kubeapi-load-balancer/0 2025-04-17 18:52:52 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for kubeapi-load-balancer/0 2025-04-17 18:52:52 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-kubeapi-load-balancer-0/agent.socket } 2025-04-17 18:52:52 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Reactive main running for hook update-status 2025-04-17 18:52:53 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/http/provides.py:15:broken:website tracer: ++ queue handler hooks/relations/http/requires.py:15:broken:apiserver tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/apt.py:50:ensure_package_status tracer: ++ queue handler reactive/load_balancer.py:156:install_load_balancer tracer: ++ queue handler reactive/load_balancer.py:230:set_nginx_version tracer: ++ queue handler reactive/load_balancer.py:276:provide_lb_consumers tracer: ++ queue handler reactive/load_balancer.py:76:request_server_certificates tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2025-04-17 18:52:53 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.nagios_context 2025-04-17 18:52:53 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2025-04-17 18:52:53 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.extra_packages 2025-04-17 18:52:53 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.set.package_status 2025-04-17 18:52:53 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.package_status 2025-04-17 18:52:53 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.install_sources 2025-04-17 18:52:53 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.install_keys 2025-04-17 18:52:53 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.set.port 2025-04-17 18:52:53 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.port 2025-04-17 18:52:53 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.set.host 2025-04-17 18:52:53 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.host 2025-04-17 18:52:53 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.ha-cluster-vip 2025-04-17 18:52:53 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.ha-cluster-dns 2025-04-17 18:52:53 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.extra_sans 2025-04-17 18:52:53 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.set.proxy_read_timeout 2025-04-17 18:52:53 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.proxy_read_timeout 2025-04-17 18:52:53 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.loadbalancer-ips 2025-04-17 18:52:53 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Initializing Leadership Layer (is leader) 2025-04-17 18:52:53 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Initializing Apt Layer 2025-04-17 18:52:53 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer> tracer: starting handler dispatch, 45 flags set tracer: set flag apt.installed.nginx-full tracer: set flag certificates.available tracer: set flag certificates.batch.cert.available tracer: set flag certificates.ca.available tracer: set flag certificates.certs.available tracer: set flag certificates.client.cert.available tracer: set flag certificates.server.cert.available tracer: set flag certificates.server.certs.available tracer: set flag config.default.extra_packages tracer: set flag config.default.extra_sans tracer: set flag config.default.ha-cluster-dns tracer: set flag config.default.ha-cluster-vip tracer: set flag config.default.host tracer: set flag config.default.install_keys tracer: set flag config.default.install_sources tracer: set flag config.default.loadbalancer-ips tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.package_status tracer: set flag config.default.port tracer: set flag config.default.proxy_read_timeout tracer: set flag config.set.host tracer: set flag config.set.nagios_context tracer: set flag config.set.package_status tracer: set flag config.set.port tracer: set flag config.set.proxy_read_timeout tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.kubeapi-load-balancer_0.server.cert tracer: set flag endpoint.certificates.changed.kubeapi-load-balancer_0.server.key tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag endpoint.lb-consumers.created tracer: set flag endpoint.lb-consumers.joined tracer: set flag leadership.is_leader tracer: set flag nginx.available tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca_installed tracer: set flag tls_client.certs.saved tracer: set flag tls_client.server.cert.10.0.0.50.changed tracer: set flag tls_client.server.certs.changed 2025-04-17 18:52:53 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2025-04-17 18:52:53 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer> tracer: main dispatch loop, 11 handlers queued tracer: ++ queue handler hooks/relations/http/provides.py:15:broken:website tracer: ++ queue handler hooks/relations/http/requires.py:15:broken:apiserver tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/apt.py:50:ensure_package_status tracer: ++ queue handler reactive/load_balancer.py:156:install_load_balancer tracer: ++ queue handler reactive/load_balancer.py:230:set_nginx_version tracer: ++ queue handler reactive/load_balancer.py:276:provide_lb_consumers tracer: ++ queue handler reactive/load_balancer.py:76:request_server_certificates tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2025-04-17 18:52:53 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/apt.py:50:ensure_package_status 2025-04-17 18:52:53 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/load_balancer.py:76:request_server_certificates 2025-04-17 18:52:53 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/load_balancer.py:156:install_load_balancer 2025-04-17 18:52:53 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 status-set: maintenance: Configuring site apilb 2025-04-17 18:52:53 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 Writing file /etc/nginx/sites-available/apilb root:root 444 2025-04-17 18:52:53 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Wrote vhost config {'host': '127.0.0.1', 'port': 443, 'servers': {443: {('10.0.0.50', 6443)}, 6443: {('10.0.0.50', 6443)}}, 'server_certificate': '/srv/kubernetes/server.crt', 'server_key': '/srv/kubernetes/server.key', 'proxy_read_timeout': 600} to apilb.conf 2025-04-17 18:52:53 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/load_balancer.py:230:set_nginx_version 2025-04-17 18:52:53 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/load_balancer.py:276:provide_lb_consumers 2025-04-17 18:52:53 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:18:store_ca 2025-04-17 18:52:53 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:44:store_server 2025-04-17 18:52:53 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:71:store_client 2025-04-17 18:52:53 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/http/requires.py:15:broken:apiserver 2025-04-17 18:52:53 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/http/provides.py:15:broken:website 2025-04-17 18:52:53 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2025-04-17 18:52:53 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 status-set: active: Loadbalancer ready. 2025-04-17 18:52:53 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2025-04-17 18:52:54 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for kubeapi-load-balancer/0 2025-04-17 18:52:54 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2025-04-17 18:52:54 DEBUG juju.machinelock machinelock.go:186 machine lock released for kubeapi-load-balancer/0 uniter (run update-status hook) 2025-04-17 18:52:54 DEBUG juju.worker.uniter.operation executor.go:121 lock released for kubeapi-load-balancer/0 2025-04-17 18:52:54 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2025-04-17 18:52:54 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 12 2025-04-17 18:52:54 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-control-plane/0" already joined relation 5 2025-04-17 18:52:54 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-control-plane/0" already joined relation 6 2025-04-17 18:53:35 DEBUG juju.worker.metrics.collect manifold.go:293 recording metrics 2025-04-17 18:53:35 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-kubeapi-load-balancer-0/metrics-collect-agent.socket } 2025-04-17 18:53:35 WARNING unit.unit-kubeapi-load-balancer-0.collect-metrics logger.go:60 /var/lib/juju/agents/unit-kubeapi-load-balancer-0/charm/hooks/collect-metrics:43: YAMLLoadWarning: calling yaml.load() without Loader=... is deprecated, as the default Loader is unsafe. Please read https://msg.pyyaml.org/load for full details. 2025-04-17 18:53:35 WARNING unit.unit-kubeapi-load-balancer-0.collect-metrics logger.go:60 doc = yaml.load(f) 2025-04-17 18:53:35 DEBUG juju.worker.metrics.collect manifold.go:316 ran "collect-metrics" hook (via explicit, bespoke hook script) 2025-04-17 18:58:11 DEBUG juju.worker.uniter.remotestate watcher.go:666 update status timer triggered for kubeapi-load-balancer/0 2025-04-17 18:58:11 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2025-04-17 18:58:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-control-plane/0" already joined relation 6 2025-04-17 18:58:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 12 2025-04-17 18:58:11 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-control-plane/0" already joined relation 5 2025-04-17 18:58:11 DEBUG juju.worker.uniter.operation executor.go:85 running operation run update-status hook for kubeapi-load-balancer/0 2025-04-17 18:58:11 DEBUG juju.machinelock machinelock.go:162 acquire machine lock for kubeapi-load-balancer/0 uniter (run update-status hook) 2025-04-17 18:58:12 DEBUG juju.machinelock machinelock.go:172 machine lock acquired for kubeapi-load-balancer/0 uniter (run update-status hook) 2025-04-17 18:58:12 DEBUG juju.worker.uniter.operation executor.go:132 preparing operation "run update-status hook" for kubeapi-load-balancer/0 2025-04-17 18:58:12 DEBUG juju.worker.uniter.operation executor.go:132 executing operation "run update-status hook" for kubeapi-load-balancer/0 2025-04-17 18:58:12 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-kubeapi-load-balancer-0/agent.socket } 2025-04-17 18:58:13 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Reactive main running for hook update-status 2025-04-17 18:58:13 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer> tracer: set flag config.set.nagios_context tracer: ++ queue handler hooks/relations/http/provides.py:15:broken:website tracer: ++ queue handler hooks/relations/http/requires.py:15:broken:apiserver tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/apt.py:50:ensure_package_status tracer: ++ queue handler reactive/load_balancer.py:156:install_load_balancer tracer: ++ queue handler reactive/load_balancer.py:230:set_nginx_version tracer: ++ queue handler reactive/load_balancer.py:276:provide_lb_consumers tracer: ++ queue handler reactive/load_balancer.py:76:request_server_certificates tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2025-04-17 18:58:13 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.nagios_context 2025-04-17 18:58:13 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.nagios_servicegroups 2025-04-17 18:58:13 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.extra_packages 2025-04-17 18:58:13 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.set.package_status 2025-04-17 18:58:13 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.package_status 2025-04-17 18:58:13 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.install_sources 2025-04-17 18:58:13 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.install_keys 2025-04-17 18:58:13 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.set.port 2025-04-17 18:58:13 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.port 2025-04-17 18:58:13 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.set.host 2025-04-17 18:58:13 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.host 2025-04-17 18:58:13 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.ha-cluster-vip 2025-04-17 18:58:13 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.ha-cluster-dns 2025-04-17 18:58:13 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.extra_sans 2025-04-17 18:58:13 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.set.proxy_read_timeout 2025-04-17 18:58:13 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.proxy_read_timeout 2025-04-17 18:58:13 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: set flag config.default.loadbalancer-ips 2025-04-17 18:58:13 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Initializing Leadership Layer (is leader) 2025-04-17 18:58:13 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Initializing Apt Layer 2025-04-17 18:58:13 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer> tracer: starting handler dispatch, 45 flags set tracer: set flag apt.installed.nginx-full tracer: set flag certificates.available tracer: set flag certificates.batch.cert.available tracer: set flag certificates.ca.available tracer: set flag certificates.certs.available tracer: set flag certificates.client.cert.available tracer: set flag certificates.server.cert.available tracer: set flag certificates.server.certs.available tracer: set flag config.default.extra_packages tracer: set flag config.default.extra_sans tracer: set flag config.default.ha-cluster-dns tracer: set flag config.default.ha-cluster-vip tracer: set flag config.default.host tracer: set flag config.default.install_keys tracer: set flag config.default.install_sources tracer: set flag config.default.loadbalancer-ips tracer: set flag config.default.nagios_context tracer: set flag config.default.nagios_servicegroups tracer: set flag config.default.package_status tracer: set flag config.default.port tracer: set flag config.default.proxy_read_timeout tracer: set flag config.set.host tracer: set flag config.set.nagios_context tracer: set flag config.set.package_status tracer: set flag config.set.port tracer: set flag config.set.proxy_read_timeout tracer: set flag endpoint.certificates.changed tracer: set flag endpoint.certificates.changed.ca tracer: set flag endpoint.certificates.changed.client.cert tracer: set flag endpoint.certificates.changed.client.key tracer: set flag endpoint.certificates.changed.egress-subnets tracer: set flag endpoint.certificates.changed.ingress-address tracer: set flag endpoint.certificates.changed.kubeapi-load-balancer_0.server.cert tracer: set flag endpoint.certificates.changed.kubeapi-load-balancer_0.server.key tracer: set flag endpoint.certificates.changed.private-address tracer: set flag endpoint.certificates.joined tracer: set flag endpoint.lb-consumers.created tracer: set flag endpoint.lb-consumers.joined tracer: set flag leadership.is_leader tracer: set flag nginx.available tracer: set flag tls_client.ca.saved tracer: set flag tls_client.ca_installed tracer: set flag tls_client.certs.saved tracer: set flag tls_client.server.cert.10.0.0.50.changed tracer: set flag tls_client.server.certs.changed 2025-04-17 18:58:13 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer: hooks phase, 0 handlers queued 2025-04-17 18:58:13 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 tracer> tracer: main dispatch loop, 11 handlers queued tracer: ++ queue handler hooks/relations/http/provides.py:15:broken:website tracer: ++ queue handler hooks/relations/http/requires.py:15:broken:apiserver tracer: ++ queue handler hooks/relations/tls-certificates/requires.py:79:joined:certificates tracer: ++ queue handler reactive/apt.py:50:ensure_package_status tracer: ++ queue handler reactive/load_balancer.py:156:install_load_balancer tracer: ++ queue handler reactive/load_balancer.py:230:set_nginx_version tracer: ++ queue handler reactive/load_balancer.py:276:provide_lb_consumers tracer: ++ queue handler reactive/load_balancer.py:76:request_server_certificates tracer: ++ queue handler reactive/tls_client.py:18:store_ca tracer: ++ queue handler reactive/tls_client.py:44:store_server tracer: ++ queue handler reactive/tls_client.py:71:store_client 2025-04-17 18:58:13 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/apt.py:50:ensure_package_status 2025-04-17 18:58:13 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/load_balancer.py:76:request_server_certificates 2025-04-17 18:58:13 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/load_balancer.py:156:install_load_balancer 2025-04-17 18:58:13 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 status-set: maintenance: Configuring site apilb 2025-04-17 18:58:13 DEBUG unit.kubeapi-load-balancer/0.juju-log server.go:316 Writing file /etc/nginx/sites-available/apilb root:root 444 2025-04-17 18:58:13 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Wrote vhost config {'host': '127.0.0.1', 'port': 443, 'servers': {443: {('10.0.0.50', 6443)}, 6443: {('10.0.0.50', 6443)}}, 'server_certificate': '/srv/kubernetes/server.crt', 'server_key': '/srv/kubernetes/server.key', 'proxy_read_timeout': 600} to apilb.conf 2025-04-17 18:58:13 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/load_balancer.py:230:set_nginx_version 2025-04-17 18:58:13 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/load_balancer.py:276:provide_lb_consumers 2025-04-17 18:58:13 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:18:store_ca 2025-04-17 18:58:13 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:44:store_server 2025-04-17 18:58:13 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: reactive/tls_client.py:71:store_client 2025-04-17 18:58:13 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/http/requires.py:15:broken:apiserver 2025-04-17 18:58:13 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/http/provides.py:15:broken:website 2025-04-17 18:58:13 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 Invoking reactive handler: hooks/relations/tls-certificates/requires.py:79:joined:certificates 2025-04-17 18:58:14 INFO unit.kubeapi-load-balancer/0.juju-log server.go:316 status-set: active: Loadbalancer ready. 2025-04-17 18:58:14 INFO juju.worker.uniter.operation runhook.go:159 ran "update-status" hook (via explicit, bespoke hook script) 2025-04-17 18:58:14 DEBUG juju.worker.uniter.operation executor.go:132 committing operation "run update-status hook" for kubeapi-load-balancer/0 2025-04-17 18:58:14 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5 2025-04-17 18:58:14 DEBUG juju.machinelock machinelock.go:186 machine lock released for kubeapi-load-balancer/0 uniter (run update-status hook) 2025-04-17 18:58:14 DEBUG juju.worker.uniter.operation executor.go:121 lock released for kubeapi-load-balancer/0 2025-04-17 18:58:14 DEBUG juju.worker.uniter resolver.go:188 no operations in progress; waiting for changes 2025-04-17 18:58:14 DEBUG juju.worker.uniter.relation resolver.go:285 unit "easyrsa/0" already joined relation 12 2025-04-17 18:58:14 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-control-plane/0" already joined relation 5 2025-04-17 18:58:14 DEBUG juju.worker.uniter.relation resolver.go:285 unit "kubernetes-control-plane/0" already joined relation 6 2025-04-17 18:59:18 DEBUG juju.worker.metrics.collect manifold.go:293 recording metrics 2025-04-17 18:59:18 DEBUG juju.worker.uniter.runner runner.go:728 starting jujuc server {unix @/var/lib/juju/agents/unit-kubeapi-load-balancer-0/metrics-collect-agent.socket } 2025-04-17 18:59:18 WARNING unit.unit-kubeapi-load-balancer-0.collect-metrics logger.go:60 /var/lib/juju/agents/unit-kubeapi-load-balancer-0/charm/hooks/collect-metrics:43: YAMLLoadWarning: calling yaml.load() without Loader=... is deprecated, as the default Loader is unsafe. Please read https://msg.pyyaml.org/load for full details. 2025-04-17 18:59:18 WARNING unit.unit-kubeapi-load-balancer-0.collect-metrics logger.go:60 doc = yaml.load(f) 2025-04-17 18:59:19 DEBUG juju.worker.metrics.collect manifold.go:316 ran "collect-metrics" hook (via explicit, bespoke hook script)